Information interaction method and device, electronic equipment and computer program product

Abstract

The invention discloses an information interaction method, an information interaction device, electronic equipment and a computer program product. The method comprises the following steps: generating a language teaching video according to a language teaching material to be teaching through a preset video generation algorithm; playing the language teaching video on a preset playing interface, and receiving user voice input by a user based on the language teaching video; and carrying out teaching interaction with the user according to the user voice. Through the scheme of the application, the interactivity and interestingness of language learning can be enhanced, and the enthusiasm of students to language learning is improved.

Description

Technical Field

[0001] The present application belongs to the field of information technology, and in particular relates to an information interaction method, an information interaction device, an electronic device and a computer program product. Background Art

[0002] Most existing language learning methods rely on traditional textbooks and classroom teaching, which is usually boring and difficult to stimulate students' interest and enthusiasm in learning. In response to this, modern educational technology has introduced multimedia means and point-reading tools. However, these means and tools lack interactivity and fun, and only support students' static browsing, resulting in students' learning enthusiasm still needs to be improved. Summary of the invention

[0003] The present application provides an information interaction method, an information interaction device, an electronic device and a computer program product, which can enhance the interactivity and fun of language learning and improve students' enthusiasm for language learning.

[0004] In a first aspect, the present application provides an information interaction method, comprising:

[0005] Generate a language teaching video based on the language teaching material to be taught through a preset video generation algorithm;

[0006] Playing the language teaching video on a preset playing interface and receiving a user voice input based on the language teaching video;

[0007] Conduct teaching interaction with users based on their voice.

[0008] In a second aspect, the present application provides an information interaction device, comprising:

[0009] A generation module, used to generate a language teaching video according to the language teaching material to be taught by using a preset video generation algorithm;

[0010] A receiving module, used to play the language teaching video on a preset playing interface, and receive a user voice input based on the language teaching video;

[0011] The interactive module is used to conduct teaching interaction with the user based on the user's voice.

[0012] In a third aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method of the first aspect when executing the computer program.

[0013] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method of the first aspect are implemented.

[0014] In a fifth aspect, the present application provides a computer program product, which includes a computer program. When the computer program is executed by one or more processors, it implements the steps of the method of the first aspect.

[0015] Compared with the prior art, the present application has the following beneficial effects: on the one hand, the present application scheme can generate a language teaching video according to the language teaching material to be taught through a preset video generation algorithm, so that the user is no longer limited to static browsing, but can dynamically browse through the language teaching video, thereby enhancing the interest of language learning and encouraging the user to actively learn the language. On the other hand, when playing the language teaching video on the preset playback interface, the present application scheme can receive the user's voice input based on the language teaching video, and interact with the user according to the user's voice, so that the user can interact with the teaching through voice input during the learning process, further encouraging the user to actively learn the language. Therefore, the present application scheme enhances the interactivity and interest of language learning and enhances the user's enthusiasm for language learning.

[0016] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 It is a schematic diagram of the implementation flow of the information interaction method provided in the embodiment of the present application;

[0019] Figure 2 It is a schematic diagram of the playback interface, bullet screen area and subtitle area provided in an embodiment of the present application;

[0020] Figure 3 is a structural diagram of an information interaction device provided in an embodiment of the present application;

[0021] Figure 4 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the embodiments described below are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0023] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0024] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0025] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0026] As used in this specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0027] In addition, in the description of the present application, the terms "first", "second", "third", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0028] The information interaction method provided in the embodiment of the present application is described below. The execution subject of the information interaction method is an electronic device. The electronic device may be provided with or connected to a display screen and a microphone, which are not limited here. As an example only, the electronic device may be a learning machine, a smart phone, a tablet computer, a personal computer, etc. The embodiment of the present application does not limit the specific type of the electronic device. Please refer to Figure 1 , the information interaction method proposed in the embodiment of the present application includes:

[0029] Step 101 , generating a language teaching video according to the language teaching material to be taught by using a preset video generation algorithm.

[0030] In some embodiments, when the electronic device has a certain computing power, the electronic device can actively call a preset video generation algorithm to generate a language teaching video based on the language teaching material to be taught; when the computing power of the electronic device is relatively insufficient, the electronic device can also trigger the cloud with high computing power to call the video generation algorithm, so that the cloud generates a language teaching video based on the language teaching material to be taught. That is, in the embodiments of the present application, depending on the computing power supported by the electronic device, the language teaching video can be generated by the electronic device itself, or the electronic device can trigger other devices (such as the cloud) to generate the language teaching video, and the embodiments of the present application are not limited to this.

[0031] In some embodiments, the language teaching material to be taught can be a preset teaching material, or it can be a teaching material imported by a user through an electronic device, and the embodiments of the present application do not limit this. In the case where the language teaching material to be taught is a preset teaching material, a language teaching video can be generated in advance by a video generation algorithm and stored in a preset storage space. Wherein, the storage space can be deployed locally or in the cloud of the electronic device. In this way, the electronic device only needs to receive the teaching material selection instruction input by the user, and load the language teaching video corresponding to the selected language teaching material from the storage space according to the teaching material selection instruction, and the embodiments of the present application do not limit this. In the case where the language teaching material to be taught is a teaching material actively imported by a user through an electronic device, a language teaching video can be generated by the electronic device itself or other devices (such as the cloud) can be triggered by the electronic device to generate a language teaching video, and the language teaching video is loaded, and the embodiments of the present application do not limit this.

[0032] In some embodiments, the language teaching material to be taught may be analyzed first to obtain the scene information and keyword information in the language teaching material, the keyword information includes but is not limited to character information, entity information and action information, etc., which are not limited here; then the corresponding playback material is generated according to the keyword information, and the material type of the playback material is not limited in the embodiment of the present application; finally, according to the scene information, the playback material is connected and rendered by a preset video generation algorithm to generate a language teaching video. Of course, in this process, if the language teaching material to be taught contains a static picture, a dynamic picture can be directly generated based on the static picture according to the scene information and keyword information, and then the dynamic picture can be expanded, or the generated multiple dynamic pictures can be connected and rendered to generate a language teaching video with a longer duration. Alternatively, it is also possible to introduce an artificial intelligence function in the process of calling the video generation algorithm to generate a language teaching video, which is not limited in the embodiment of the present application.

[0033] Step 102: Play the language teaching video on a preset playing interface, and receive a user voice input based on the language teaching video.

[0034] The electronic device can play the language teaching video corresponding to the language teaching material to be taught selected by the user in a preset playing interface. The playing interface can also display a virtual button for voice input, through which the user can pause the playing of the language teaching video at any time and trigger the microphone of the electronic device to start working, so that the user can input the user voice based on the language teaching video during the playing of the language teaching video.

[0035] In some examples, the user may follow along based on the language teaching video, thereby inputting user voice into the electronic device; or the user may ask questions based on the language teaching video, thereby inputting user voice into the electronic device; or the user may give relevant suggestions, opinions and / or thoughts based on the language teaching video, thereby inputting user voice into the electronic device; it can be understood that the user may input voice into the electronic device according to his or her own needs when watching the language teaching video, and the embodiments of the present application do not limit the specific content of the user voice.

[0036] Step 103: Conduct teaching interaction with the user according to the user's voice.

[0037] After receiving the user's voice, the electronic device can process and analyze the user's voice, and thereby perform teaching interactions with the user based on the processing results and / or analysis results, such as providing a learning evaluation of the user, or providing feedback on the user's questions, or publishing the user's suggestions, opinions and / or thoughts to a specific social platform, etc. The embodiments of the present application are not limited to this.

[0038] In some embodiments, there may be multiple virtual buttons for voice input, and each virtual button corresponds to a different voice input function. As an example only, a first virtual button for posting a barrage, a second virtual button for following the evaluation, and a third virtual button for asking questions can be distinguished; and, in order to facilitate users to distinguish the voice input functions corresponding to different virtual buttons, the icons of each virtual button can be adaptively generated according to the corresponding voice input function, which is not limited in the embodiments of the present application. Alternatively, after receiving the user's voice, the electronic device may first identify the target user intention corresponding to the user's voice, and then trigger the subsequent corresponding teaching interaction operation based on the target user intention, which is not limited in the embodiments of the present application.

[0039] In one application scenario, when a user gives relevant suggestions, opinions and / or thoughts based on a language teaching video, thereby inputting user voice into an electronic device (that is, the user voice is a suggestion, opinion and / or thought), the electronic device may perform the following operations:

[0040] A1. Generate bullet screen information based on user voice.

[0041] If the electronic device supports voice barrage, voice barrage information can be directly generated according to the user's voice; if the electronic device does not support voice barrage but only supports text barrage, the user's voice can be first converted into text, and then text barrage information can be generated according to the text. In the embodiment of the present application, the type of the barrage information can be determined based on the type supported by the electronic device, which is not limited here.

[0042] A2. Display the barrage information in the preset barrage area in the playback interface.

[0043] The bullet screen area is usually within the playback interface and will not be larger than or exceed the playback interface. To avoid affecting user learning, the electronic device can determine the remaining area of ​​the language teaching video, except for the subtitle area, as the bullet screen area. Figure 2 , Figure 2 Examples of the playback interface, bullet screen area, and subtitle area are given. Figure 2The largest rectangle in the figure is the playback interface, and the dotted lines inside it divide the playback interface into a bullet screen area and a subtitle area; the area above the dotted line is the bullet screen area, and the area below the dotted line is the subtitle area. The electronic device can display the bullet screen information in the bullet screen area of ​​the playback interface, and can also upload the bullet screen information to the cloud. Through the playback time corresponding to the current language teaching video when the bullet screen is released, the cloud will associate the bullet screen information with the language teaching video, so that when any device plays the same language teaching video to the same playback time, the bullet screen information can also be displayed in the bullet screen area of ​​the device. In this way, the bullet screen information can be viewed by all devices that play the same language teaching video, and different users can exchange their opinions, suggestions and / or thoughts in the form of bullet screens, thereby achieving benign learning interaction between users.

[0044] In another application scenario, when the user follows the language teaching video and inputs the user voice into the electronic device (that is, the user voice is the user's follow-up voice), the electronic device can perform the following operations:

[0045] B1. Convert user voice into text.

[0046] To determine whether the user's voice is accurate, the electronic device may first convert the user's voice into text using voice recognition technology. In some examples, to avoid the influence of noise, before converting the user's voice into text, the electronic device may first perform noise reduction processing on the user's voice to highlight the human voice in the user's voice and improve the accuracy of the converted text.

[0047] B2. Compare the text with the reference text.

[0048] The electronic device can compare the converted text with the reference text to determine the accuracy of the user's follow-up reading. Considering that in this application scenario, the user often repeats a voice immediately after the language teaching video outputs a voice to achieve the effect of follow-up reading, the reference text here can be specifically: the text corresponding to the audio played last in the language teaching video before the input time of the user's voice.

[0049] B3. Based on the comparison result, output a first evaluation of the user's voice.

[0050] Based on the result of comparing the text converted from the user's voice with the reference text, the electronic device can determine the accuracy of the user's current follow-up reading, and then output a first evaluation of the user's voice based on the accuracy to let the user know whether his current follow-up reading is correct.

[0051] In another application scenario, when the user follows the language teaching video and inputs the user voice into the electronic device (that is, the user voice is the user following voice), or when the user asks questions based on the language teaching video and inputs the user voice into the electronic device (that is, the user voice is the user questioning voice), the electronic device may further perform the following operations:

[0052] C1. Analyze the user's voice according to the preset language evaluation criteria.

[0053] It can be understood that through steps B1 to B3, the accuracy of the content followed by the user can be evaluated. In this step, the user's oral ability is mainly evaluated. Among them, the language evaluation standard proposed here can be specifically determined according to the target teaching language, and the target teaching language is: the language that the language teaching material is expected to teach. Just as an example, when the language teaching material to be taught is an English teaching material, the target teaching language is English; when the language teaching material to be taught is a Japanese teaching material, the target teaching language is Japanese, which will not be repeated here.

[0054] In some examples, for application scenarios where the user's voice is a user's voice of following or a user's voice of asking questions, the preset language evaluation criteria may include: pronunciation criteria. The electronic device may first identify the acoustic features of the user's voice through a preset acoustic model, including but not limited to the various morphemes and rising and falling tones in the user's voice, which are not limited here; then, according to the preset pronunciation criteria, the electronic device may perform pronunciation analysis on the acoustic features, thereby obtaining information about the user's oral fluency and existing pronunciation problems.

[0055] In other examples, for application scenarios where the user voice is a user's question voice (specifically, questions are asked in the target teaching language), the preset language evaluation criteria may include: grammar criteria. The electronic device may first identify the language features of the user's voice through a preset language model, including but not limited to: semantic features and structural features, etc.; then, according to the preset grammar criteria, the electronic device may perform grammar analysis on the language features, thereby obtaining grammar and / or sentence structure problems in the user's expression, etc.

[0056] C2. Based on the analysis results, output a second evaluation of the user's voice.

[0057] Based on the result of analyzing the user's voice, the electronic device can determine the user's problems in pronunciation, grammar and / or sentence structure, and output a second evaluation of the user's voice. It can be understood that the second evaluation can include the analyzed problem, and the correct pronunciation, correct grammar and / or correct sentence structure corresponding to the problem, so as to deepen the user's impression and enable the user to conduct in-depth learning through the second evaluation.

[0058] Of course, in an application scenario where the user asks questions based on the language teaching video and thus inputs user voice into the electronic device (that is, the user voice is the user's question voice), the electronic device can also analyze the semantics of the user voice, and after knowing the user's target question, query the target question online to obtain the answer to the target question, and output the answer in the form of voice and / or text, which will not be repeated here.

[0059] In some embodiments, the user can also check the barrage information sent by other users through the barrage area of ​​the display interface, and can comment on and / or like the barrage information sent by other users; that is, the electronic device can receive the user's like instructions and / or comment instructions for the barrage information in the barrage area, so that different users can share learning or make suggestions by posting barrages, likes and / or comments, so as to form an online teaching environment that is conducive to user learning.

[0060] In some embodiments, when an electronic device is playing a language teaching video, if there are other devices currently playing the same language teaching video (that is, more than two users are playing the same language teaching video through their respective devices), any user can initiate a battle command through his device, and the battle command can be forwarded by the cloud to other devices; after the cloud receives the confirmation command fed back by other devices for the battle command, it can trigger the two or more devices (including the device that initiated the battle command, and the device that feeds back the confirmation command) to enter the battle mode. In the device entering the battle mode, its bullet screen area can be evenly divided into N bullet screen sub-areas, where N is the number of devices entering the battle mode this time, and each device corresponds to a different bullet screen sub-area. In this way, the user can send the user voice that he follows as bullet screen information, thereby realizing a verbal battle with other users. It should be noted that the bullet message information sent by each device in battle mode is only displayed in its corresponding bullet message sub-area, and other bullet message sub-areas will display the bullet message information sent by other devices in the battle mode; and the bullet message information sent by each device in battle mode will only be visible to these devices in battle mode, ensuring the data privacy of the bullet message information sent in battle mode. Through the above operations, the interaction between users is further strengthened, thereby improving the enthusiasm of users to learn.

[0061] In some embodiments, the electronic device may also perform statistical analysis on all user voices input by the user during the current playback of the language teaching video. The results of the statistical analysis may include, but are not limited to: the number of times the user follows the reading, the accuracy of the following reading, the number of questions asked, the pronunciation errors when asking questions or following the reading, the grammatical errors when asking questions, the number of times the bullet screen is posted, and the number of times the bullet screen information of other users is interacted with (including but not limited to likes and comments), etc. According to the results of the statistical analysis, the electronic device may output suggestion information for the user's current language learning. For example, when the number of times the user follows the reading is small, the output suggestion information may be to encourage the user to follow the reading more next time, and so on, which will not be repeated here.

[0062] As can be seen from the above, in the embodiments of the present application, on the one hand, a language teaching video can be generated according to the language teaching material to be taught through a preset video generation algorithm, so that the user is no longer limited to static browsing, but can be dynamically browsed through the language teaching video, thereby enhancing the interest of language learning and prompting the user to actively learn the language. On the other hand, when the language teaching video can be played on the preset playback interface, the user's voice input based on the language teaching video is received, and teaching interaction is performed with the user according to the user's voice, so that the user can perform teaching interaction through voice input during the learning process, further prompting the user to actively learn the language. Therefore, the embodiments of the present application enhance the interactivity and interest of language learning and enhance the user's enthusiasm for language learning.

[0063] Corresponding to the information interaction method provided above, the present application embodiment also provides an information interaction device. Figure 3 , the information interaction device 3 comprises:

[0064] A generation module 301 is used to generate a language teaching video according to the language teaching material to be taught by using a preset video generation algorithm;

[0065] The receiving module 302 is used to play the language teaching video in a preset playing interface and receive the user's voice input based on the language teaching video;

[0066] The interaction module 303 is used to perform teaching interaction with the user according to the user's voice.

[0067] In some embodiments, the interaction module 303 includes:

[0068] A generating unit, used to generate bullet screen information according to user voice;

[0069] The display unit is used to display the bullet screen information in the preset bullet screen area in the playback interface, so that the bullet screen information can be viewed by all devices that play the language teaching video.

[0070] In some embodiments, the interaction module 303 includes:

[0071] A conversion unit, used to convert user speech into text;

[0072] A comparison unit, used to compare the text with a reference text, where the reference text is: the text corresponding to the last audio played in the language teaching video before the input time of the user's voice;

[0073] The first output unit is used to output a first evaluation of the user's voice according to the comparison result.

[0074] In some embodiments, the interaction module 303 includes:

[0075] An analysis unit, used for analyzing the user's speech according to a preset language evaluation standard, wherein the language evaluation standard is determined according to a target teaching language, and the target teaching language is: the language that the language teaching material expects to teach;

[0076] The second output unit is used to output a second evaluation of the user's voice according to the analysis result.

[0077] In some embodiments, the language assessment criteria include pronunciation criteria, and the analysis unit includes:

[0078] The first recognition subunit is used to recognize the acoustic features of the user's voice through a preset acoustic model;

[0079] The first analysis subunit is used to perform pronunciation analysis on the acoustic features according to a preset pronunciation standard.

[0080] In some embodiments, the language assessment criteria include grammatical criteria, analysis units, including:

[0081] The second recognition subunit is used to recognize the language features of the user's voice through a preset language model, and the language features include: semantic features and structural features;

[0082] The second analysis subunit is used to perform grammatical analysis on the language features according to a preset grammatical standard.

[0083] In some embodiments, the information interaction device 3 further includes:

[0084] The analysis module is used to perform statistical analysis on all user voice inputs during the playback of the language teaching video;

[0085] The suggestion module is used to output suggestion information for the user's current language learning based on the results of statistical analysis.

[0086] As can be seen from the above, in the embodiments of the present application, on the one hand, a language teaching video can be generated according to the language teaching material to be taught through a preset video generation algorithm, so that the user is no longer limited to static browsing, but can be dynamically browsed through the language teaching video, thereby enhancing the interest of language learning and prompting the user to actively learn the language. On the other hand, when the language teaching video can be played on the preset playback interface, the user's voice input based on the language teaching video is received, and teaching interaction is performed with the user according to the user's voice, so that the user can perform teaching interaction through voice input during the learning process, further prompting the user to actively learn the language. Therefore, the embodiments of the present application enhance the interactivity and interest of language learning and enhance the user's enthusiasm for language learning.

[0087] Corresponding to the information interaction method provided above, the embodiment of the present application further provides an electronic device. Figure 4 The electronic device 4 in the embodiment of the present application includes: a memory 401, one or more processors 402 ( Figure 4 In addition, the electronic device may also be provided with a microphone and a display screen, etc. Figure 4 The memory 401 is used to store software programs and units, and the processor 402 executes various functional applications and data processing by running the software programs and units stored in the memory 401 to obtain the resources corresponding to the above-mentioned preset events. Specifically, the processor 402 implements the following steps when running the computer program stored in the memory 401:

[0088] Generate a language teaching video based on the language teaching material to be taught through a preset video generation algorithm;

[0089] Playing the language teaching video on a preset playing interface and receiving a user voice input based on the language teaching video;

[0090] Conduct teaching interaction with users based on their voice.

[0091] Assuming that the above is the first possible implementation mode, in a second possible implementation mode provided on the basis of the first possible implementation mode, teaching interaction with the user according to the user voice includes:

[0092] Generate bullet screen information based on user voice;

[0093] The barrage information is displayed in a preset barrage area in the playback interface so that the barrage information can be viewed by all devices that play the language teaching video.

[0094] In a third possible implementation manner provided on the basis of the first possible implementation manner, teaching interaction with a user according to the user voice includes:

[0095] Convert user speech into text;

[0096] Compare the text with a reference text, where the reference text is: the text corresponding to the last audio played in the language teaching video before the user's voice input time;

[0097] According to the comparison result, a first evaluation of the user's voice is output.

[0098] In a fourth possible implementation provided on the basis of the first possible implementation, teaching interaction with a user according to the user voice includes:

[0099] Analyze the user's speech according to the preset language evaluation standard, wherein the language evaluation standard is determined according to the target teaching language, and the target teaching language is: the language that the language teaching material expects to teach;

[0100] Based on the analysis result, a second evaluation of the user's voice is output.

[0101] In a fifth possible implementation provided on the basis of the fourth possible implementation, the language evaluation standard includes a pronunciation standard, and the second evaluation includes a pronunciation evaluation; analyzing the user's speech according to the preset language evaluation standard includes:

[0102] Identify the acoustic features of the user's voice through a preset acoustic model;

[0103] According to the preset pronunciation standard, the acoustic features are analyzed for pronunciation.

[0104] In a sixth possible implementation provided on the basis of the fourth possible implementation, the language evaluation standard includes a grammar standard, and the second evaluation includes a grammar evaluation; analyzing the user speech according to the preset language evaluation standard includes:

[0105] Identify the language features of the user's voice through the preset language model. The language features include: semantic features and structural features;

[0106] Perform grammatical analysis on language features according to preset grammatical standards.

[0107] In a seventh possible implementation provided on the basis of the first possible implementation, or the second possible implementation, or the third possible implementation, or the fourth possible implementation, or the fifth possible implementation, or the sixth possible implementation, the processor 402 implements the following steps by running a computer program stored in the memory 401:

[0108] During the playback of the language teaching video, statistical analysis is performed on all user voice inputs;

[0109] Based on the results of statistical analysis, output recommended information for the user's current language learning.

[0110] It should be understood that in the embodiment of the present application, the processor 402 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0111] The memory 401 may include a read-only memory and a random access memory, and provide instructions and data to the processor 402. A part or all of the memory 401 may also include a non-volatile random access memory. For example, the memory 401 may also store information of a device category.

[0112] As can be seen from the above, in the embodiments of the present application, on the one hand, a language teaching video can be generated according to the language teaching material to be taught through a preset video generation algorithm, so that the user is no longer limited to static browsing, but can be dynamically browsed through the language teaching video, thereby enhancing the interest of language learning and prompting the user to actively learn the language. On the other hand, when the language teaching video can be played on the preset playback interface, the user's voice input based on the language teaching video is received, and teaching interaction is performed with the user according to the user's voice, so that the user can perform teaching interaction through voice input during the learning process, further prompting the user to actively learn the language. Thus, the embodiments of the present application enhance the interactivity and interest of language learning and enhance the user's enthusiasm for language learning.

[0113] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the above-mentioned device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0114] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0115] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the associated hardware through a computer program. The above-mentioned computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the above-mentioned computer program includes computer program code, and the above-mentioned computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The above-mentioned computer-readable storage medium may include: any entity or device capable of carrying the above-mentioned computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer-readable memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the above-mentioned computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable storage media does not include electrical carrier signals and telecommunication signals.

[0116] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An information interaction method, characterized in that: include: Generate a language teaching video based on the language teaching material to be taught through a preset video generation algorithm; Playing the language teaching video on a preset playing interface, and receiving a user voice input based on the language teaching video; Perform teaching interaction with the user according to the user voice.

2. The information interaction method according to claim 1, characterized in that: The performing teaching interaction with the user according to the user voice includes: Generate bullet screen information according to the user voice; The barrage information is displayed in a barrage area preset in the playback interface, so that the barrage information can be viewed by all devices that play the language teaching video.

3. The information interaction method according to claim 1, characterized in that: The performing teaching interaction with the user according to the user voice includes: Converting the user's speech into text; Comparing the text with a reference text, the reference text being: the text corresponding to the last audio played in the language teaching video before the input time of the user's voice; According to the comparison result, a first evaluation of the user voice is output.

4. The information interaction method according to claim 1, characterized in that: The performing teaching interaction with the user according to the user voice includes: Analyzing the user's speech according to a preset language evaluation standard, wherein the language evaluation standard is determined according to a target teaching language, and the target teaching language is: the language that the language teaching material is expected to teach; According to the analysis result, a second evaluation of the user voice is output.

5. The information interaction method according to claim 4, characterized in that: The language evaluation standard includes a pronunciation standard, and the second evaluation includes a pronunciation evaluation; and the analyzing the user speech according to the preset language evaluation standard includes: Identify the acoustic features of the user's voice using a preset acoustic model; The acoustic features are subjected to pronunciation analysis according to a preset pronunciation standard.

6. The information interaction method according to claim 4, characterized in that: The language assessment criteria include grammatical criteria, and the second evaluation includes grammatical evaluation; The analyzing the user's speech according to a preset language evaluation standard includes: Identify the language features of the user's speech through a preset language model, wherein the language features include: semantic features and structural features; According to a preset grammatical standard, the language feature is subjected to grammatical analysis.

7. The information interaction method according to any one of claims 1 to 6, characterized in that: The information interaction method further includes: During the playing of the language teaching video, statistical analysis is performed on all the user voices input by the user; According to the result of the statistical analysis, suggestion information for the current language learning of the user is output.

8. An information interaction device, characterized in that: include: A generation module, used to generate a language teaching video according to the language teaching material to be taught by using a preset video generation algorithm; A receiving module, used to play the language teaching video on a preset playing interface, and receive a user voice input based on the language teaching video; An interaction module is used to perform teaching interaction with the user according to the user's voice.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by one or more processors, the method according to any one of claims 1 to 7 is implemented.

Images