Method and apparatus for exchanging information - Patents.com

The method and apparatus for task-based oral practice address the limitations of template-based scoring by allowing users to interactively complete tasks, enhancing the intelligence and efficiency of language learning through personalized feedback and assistance.

JP7586919B2Active Publication Date: 2024-11-19DOUYIN VISION CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2022551245
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-02-26
Filing Date
2021-02-26
Publication Date
2024-11-19
Estimated Expiration
2041-02-26

AI Technical Summary

Technical Problem

Current oral practice methods based on computer technology are limited to automatic scoring of predefined templates, lacking flexibility and efficiency in user interaction and feedback.

Method used

A method and apparatus for task-based oral practice that includes outputting task information, recognizing user audio input, generating matching results, and providing assistance to complete tasks, allowing users to organize their language skills through interactive and flexible oral practice.

Benefits of technology

Enhances the intelligence and flexibility of oral practice by enabling users to complete tasks based on their own language organization, improving the efficiency and completeness of language learning.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007586919000001
    Figure 0007586919000001
  • Figure 0007586919000002
    Figure 0007586919000002
  • Figure 0007586919000003
    Figure 0007586919000003
Patent Text Reader

Abstract

The present invention provides a method and apparatus for exchanging information. The method includes the steps of: outputting task information for indicating a target oral practice task in response to receiving a user-initiated oral practice request, the task information corresponding to task intention information and task keyword information (201); acquiring speech information input by the user in response to the task information (202); recognizing the speech information to determine the user's corresponding user intention information and user keyword information (203); generating a matching result for indicating whether the user has completed the target oral practice task, the matching result being obtained by matching the user intention information with the task intention information and the user keyword information with the task keyword information (204); and displaying the matching result to the user (205). The method can achieve more flexible and efficient oral practice.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] This application claims priority to a Chinese patent application, Application No. 202010120450.X, filed on February 26, 2020, entitled "Method and Apparatus for Exchanging Information," the entire contents of which are incorporated herein by reference. TECHNICAL FIELD Embodiments of the present disclosure relate to the field of computers, and more particularly to methods and apparatus for exchanging information. [Background technology]

[0002] With the development of computer technology, the prior art allows for computer-based oral training, which may be for various languages, such as English, French, and so on.

[0003] Currently, the primary form of oral practice is automatic marking, where the user reads a template or phrase provided by the system and the system marks it. Summary of the Invention

[0004] SUMMARY OF THE DISCLOSURE Embodiments of the present disclosure provide methods and apparatus for exchanging information.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for exchanging information, including: in response to receiving an oral practice request initiated by a user, outputting task information for indicating a target oral practice task, the task information corresponding to task intention information and task keyword information; obtaining speech information input by the user for the task information; recognizing the speech information to determine corresponding user intention information and user keyword information of the user; generating a matching result for indicating whether the user has completed the target oral practice task, the matching result being obtained by matching the user intention information with the task intention information and the user keyword information with the task keyword information, respectively; and displaying the matching result to the user.

[0006] In some embodiments, the method further includes generating a score for characterizing the user's oral ability based on the audio information and the matching results, and displaying the generated score to the user.

[0007] In some embodiments, the method further includes, in response to the matching result indicating that the user has not completed the target oral practice task, outputting assistance information for assisting the user to complete the target oral practice task, obtaining supplemental audio information input by the user for the assistance information, and generating a new matching result based on the supplemental audio information for indicating whether the user has completed the target oral practice task.

[0008] In some embodiments, the step of outputting assistance information to assist the user in completing the target oral practice task in response to the matching result indicating that the user will not complete the target oral practice task includes the steps of determining whether an oral practice end request input by the user has been received in response to the matching result indicating that the user will not complete the target oral practice task, and outputting assistance information to assist the user in completing the target oral practice task in response to the oral practice end request not being received.

[0009] In some embodiments, the step of outputting assistance information to assist the user in completing the target oral practice task in response to the matching result indicating that the user will not complete the target oral practice task includes the step of determining whether the number of times the assistance information to assist the user in completing the target oral practice task is output is less than or equal to a preset number in response to the matching result indicating that the user will not complete the target oral practice task, and the step of outputting the assistance information to assist the user in completing the target oral practice task in response to the number of times the assistance information is output is less than or equal to the preset number.

[0010] In some embodiments, the step of outputting task information for indicating the target oral practice task includes the steps of acquiring a user's historical oral practice result, determining a target oral practice task based on the acquired historical oral practice result, acquiring task information for indicating the target oral practice task, and outputting the acquired task information.

[0011] In a second aspect, an embodiment of the present disclosure provides an apparatus for exchanging information, including: a first output unit configured to output task information for indicating a target oral practice task in response to receiving an oral practice request initiated by a user, the task information corresponding to task intention information and task keyword information; a first acquisition unit configured to acquire speech information input by a user for the task information; a recognition unit configured to recognize the speech information to determine corresponding user intention information and user keyword information of the user; a first generation unit configured to generate a matching result for indicating whether a user has completed the target oral practice task, the matching result being obtained by steps of matching the user intention information with the task intention information, and the user keyword information with the task keyword information, respectively; and a first display unit configured to display the matching result to a user.

[0012] In some embodiments, the apparatus further includes a second generation unit configured to generate a score for characterizing the user's oral ability based on the audio information and the matching result, and a second display unit configured to display the generated score to the user.

[0013] In some embodiments, the apparatus further includes a second output unit configured to output assistance information for assisting the user to complete the target oral practice task in response to the matching result indicating that the user has not completed the target oral practice task, a second acquisition unit configured to acquire supplemental audio information input by the user for the assistance information, and a third generation unit configured to generate a new matching result based on the supplemental audio information for indicating whether the user has completed the target oral practice task.

[0014] In some embodiments, the second output unit includes a first determination module configured to determine whether an oral practice end request input by the user has been received in response to the matching result indicating that the user will not complete the target oral practice task, and a first output module configured to output assistance information to assist the user in completing the target oral practice task in response to the oral practice end request not being received.

[0015] In some embodiments, the second output unit includes a second determination module configured to determine whether a number of times of outputting assistance information to assist the user in completing the target oral practice task is less than or equal to a preset number in response to the matching result indicating that the user will not complete the target oral practice task, and a second output module configured to output assistance information to assist the user in completing the target oral practice task in response to the number of times of outputting the assistance information being less than or equal to the preset number.

[0016] In some embodiments, the first output unit includes: an acquisition module configured to acquire a user's historical oral practice result; a third determination module configured to determine a target oral practice task based on the acquired historical oral practice result; and a third output module configured to acquire task information for indicating the target oral practice task and output the acquired task information.

[0017] In a third aspect, an embodiment of the present disclosure provides an electronic device including one or more processors and a storage device having one or more programs stored therein, wherein when the one or more programs are executed by the one or more processors, the one or more processors realize a method of any one of the embodiments of the methods for exchanging information described above.

[0018] In a fourth aspect, an embodiment of the present disclosure provides a computer readable medium having a computer program stored thereon, the computer readable medium implementing the method of any one of the embodiments of the methods for exchanging information described above when the program is executed by a processor.

[0019] The method and apparatus for exchanging information provided by the embodiment of the present disclosure, in response to receiving an oral practice request initiated by a user, outputs task information for indicating a target oral practice task, where the task information corresponds to task intention information and task keyword information, then obtains speech information input by the user for the task information, then recognizes the speech information to determine the user's corresponding user intention information and user keyword information, and finally matches the user intention information with the task intention information, and the user keyword information with the task keyword information, respectively, generates a matching result for indicating whether the user has completed the target oral practice task, and displays the matching result to the user. Thus, oral practice can be performed in a task-based dialogue form, and compared with the template-based oral practice method in the prior art, the intelligent level of the solution of the present disclosure is higher, and the user can organize language by himself to complete the task, which contributes to realizing more flexible and efficient oral practice. [Brief description of the drawings]

[0020] Other features, objects and advantages of the present disclosure will become more apparent upon reading the detailed description of the non-limiting embodiments given below with reference to the drawings, in which:

[0021] [Figure 1] FIG. 1 illustrates an exemplary system architecture applicable to one embodiment of the present disclosure. [Diagram 2] 1 is a flow chart of one embodiment of a method for exchanging information in accordance with the present disclosure. [Diagram 3] FIG. 2 is a schematic diagram of an application scene of a method for exchanging information according to an embodiment of the present disclosure; [Figure 4]1 is a flow chart of another embodiment of a method for exchanging information in accordance with the present disclosure. [Diagram 5] FIG. 1 is a block diagram of an embodiment of an apparatus for exchanging information according to the present disclosure. [Figure 6] FIG. 1 is a block diagram of a computer system of an electronic device suitable for implementing an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] The present disclosure will be described in more detail below with reference to the drawings and examples. It can be understood that the specific examples described herein are merely for interpreting the related invention and are not intended to limit the invention. It should be further explained that, for the convenience of explanation, the drawings show only a part related to the invention.

[0023] It should be noted that the embodiments and features in the embodiments of the present disclosure may be combined with each other unless they are inconsistent. The present disclosure will be described in detail below in conjunction with the embodiments with reference to the drawings.

[0024] FIG. 1 illustrates an exemplary system architecture 100 in which the disclosed method for exchanging information or apparatus for exchanging information may be applied.

[0025] 1, system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. Network 104 is used to provide a medium for a communication link between terminal devices 101, 102, 103 and server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, etc.

[0026] Users can use terminal devices 101, 102, 103 to interact with server 105 via network 104 to send and receive messages, etc. Various client applications can be installed on terminal devices 101, 102, 103, such as language instruction applications, voice dialogue applications, web browser applications, search applications, instant messaging tools, social platform software, etc.

[0027] The terminal devices 101, 102, 103 may be hardware or software. If the terminal devices 101, 102, 103 are hardware, they may be various electronic devices with audio capture capabilities, including but not limited to smartphones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III), MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop portable computers, and desktop computers. If the terminal devices 101, 102, 103 are software, they may be installed in the electronic devices listed above. They may be realized as multiple software or software modules (e.g., multiple software or software modules for providing distributed services), or as a single software or software module. There is no specific limitation here.

[0028] The server 105 may be a server that provides various services, for example, a background server of a language teaching application installed on the terminal device 101, 102, 103. The background server may output task information of a target oral practice task in response to receiving an oral practice request initiated by a user through the terminal device 101, 102, 103, obtain voice information input by the user using the terminal device 101, 102, 103, perform processing such as analysis on the received voice information and other data, and obtain and output a processing result (for example, a matching result for indicating whether the user has completed the target oral practice task).

[0029] It should be noted that the method for exchanging information provided by the embodiments of the present disclosure may be performed by the terminal devices 101, 102, 103 or by the server 105, and correspondingly, the device for exchanging information may be located in the terminal devices 101, 102, 103 or in the server 105.

[0030] It should be noted that the server may be hardware or software. If the server is hardware, it may be realized as a distributed server cluster composed of multiple servers, or as a single server. If the server is software, it may be realized as multiple software or software modules (e.g., multiple software or software modules for providing distributed services), or as a single software or software module. No specific limitations are provided here.

[0031] It should be understood that the number of terminal devices, networks and servers in Fig. 1 is merely exemplary. According to the needs of implementation, the number of terminal devices, networks and servers may be any. In particular, when the data used in the process of generating a matching result for indicating whether the user has completed the target oral practice task does not need to be obtained from other electronic devices, the above system architecture may include only a terminal device or a server without including a network.

[0032] 2, which illustrates a flow 200 of one embodiment of a method for exchanging information according to the present disclosure. The method for exchanging information includes the following steps.

[0033] In step 201, in response to receiving a user initiated oral practice request, task information is output to indicate a target oral practice task.

[0034] In this embodiment, the executing entity of the method for exchanging information (e.g., the terminal device shown in FIG. 1) can output task information for indicating a target oral practice task in response to receiving an oral practice request initiated by a user through a wired or wireless connection. The oral practice request is used to request to perform oral practice. Specifically, the oral practice requested by the user may be oral practice in various languages, such as English oral practice, French oral practice, Chinese oral practice, etc.

[0035] In practice, the user may initiate an oral practice request using a variety of methods, such as by clicking an oral practice button displayed on the page or by touching a pre-configured oral practice switch.

[0036] In this embodiment, the execution entity can output task information for indicating a target oral practice task in response to receiving the oral practice request. The target oral practice task is an oral practice task that should be completed by the user who initiated the oral practice request. The oral practice task is a task that the user can complete through voice dialogue. For example, the oral practice task may be a food delivery task, a self-introduction task, an airline ticket purchase task, etc. Specifically, the target oral practice task may be a preset task, or a task selected by the user from a plurality of preset oral practice tasks.

[0037] The task information can be used to characterize the specific content of the target oral practice task. For example, if the target oral practice task is a meal delivery task, the corresponding task information may be "reserve one Kung Pao chicken bowl to be delivered to Zhichunlu Yingdu Building". Specifically, the task information may be information preset for the target oral practice task, or may be information generated after receiving the oral practice request. For example, if the target oral practice task is a meal delivery task, the executing subject can generate task information of "reserve one Kung Pao chicken bowl to be delivered to Xidan Joy City" after receiving the oral practice request and detecting that the current location is "Xidan Joy City".

[0038] In this embodiment, the task information corresponds to task intention information and task keyword information. The task intention information can be used to characterize the goal of the target oral practice task. The task keyword information can be used to characterize the key points of the goal. The task intention information and task keyword information can be extracted from the task information. For example, for the task information of "reserve one Kung Pao Chicken Bowl for delivery to Xidan Joy City", it can be extracted therefrom that the task intention information is "meal delivery" and the task keyword information is "Kung Pao Chicken Bowl, Xidan Joy City".

[0039] Specifically, the task intention information and the task keyword information can be extracted from the task information using various methods. For example, if the task information is preset information, the engineer can extract the task intention information and the task keyword information from the task information in advance, or the engineer can extract the task intention information and the task keyword information from the task information using conventional natural language processing methods.

[0040] It should be noted that when the execution entity is a user terminal, the execution entity can directly detect the user's operation to receive an oral practice request initiated by the user, and output task information to the user; when the execution entity is a server that communicates with the user terminal, the execution entity can receive the oral practice request sent from the user terminal, and output the task information to the user terminal so that the user terminal can display the task information to the user.

[0041] In some alternative implementations of this embodiment, the execution entity can output task information for indicating a target oral practice task by the following steps: First, the execution entity can obtain a user's historical oral practice result; Then, the execution entity can determine a target oral practice task based on the obtained historical oral practice result; Finally, the execution entity can obtain task information for indicating a target oral practice task, and output the obtained task information.

[0042] Here, the historical oral practice result may be a result obtained when the user performs a historical oral practice task, such as a score for characterizing the user's oral ability obtained when the user performs an oral practice task last time.

[0043] In this embodiment, the pre-defined oral practice tasks can be classified according to the degree of difficulty (e.g., the difficulty level can be characterized by a pre-defined difficulty factor). Furthermore, the execution entity can determine a difficult target oral practice task for the user (e.g., an oral practice task whose corresponding difficulty factor is greater than the pre-defined difficulty factor) when the historical oral practice result is good (e.g., the score obtained previously is greater than the pre-defined score), and can determine an easy target oral practice task for the user (e.g., an oral practice task whose corresponding difficulty factor is less than the pre-defined difficulty factor) when the historical oral practice result is poor (e.g., the score obtained previously is less than the pre-defined score).

[0044] In this embodiment, a task that is more suitable for the user's oral ability can be determined for the user according to the user's historical oral practice results, which contributes to realizing more effective oral practice.

[0045] In step 202, voice information input by the user in response to the task information is acquired.

[0046] In this embodiment, after the task information is output, the user can input voice information for the acquired task information, and the executing entity can acquire the voice information input by the user for the task information. The voice information is information for completing the target oral practice task corresponding to the task information. It can be understood that the user can input the voice information in the language in which oral practice is required.

[0047] In step 203, the speech information is recognized to determine the corresponding user intent information and user keyword information of the user.

[0048] In this embodiment, based on the voice information obtained in step 202, the executing entity can recognize the voice information to determine the user's corresponding user intention information and user keyword information. The user intention information is used to characterize the user intention. The user keyword information is used to characterize the key points of the user intention. For example, if the voice information input by the user is "I want to check the weather in Xiamen today", after recognizing the voice information, the user intention information of "check the weather" and the user keyword information of "Xiamen today" can be obtained.

[0049] Specifically, the executing entity can recognize voice information using a conventional natural language processing method to obtain user intention information and user keyword information. For example, the executing entity can first convert voice information into text information using a voice recognition method, and then recognize user intention information and user keyword information from the converted text information using a semantic recognition method.

[0050] In particular, in the process of recognizing the speech information, the executing entity can further translate the speech information so as to make the acquired user intention information and user keyword information similar to the corresponding language of the task intention information and task keyword information, respectively, which contributes to the execution of the subsequent matching step.

[0051] Step 204 generates a matching result to indicate whether the user has completed the target oral practice task.

[0052] In this embodiment, the execution entity can match the user intention information obtained in step 203 with the task intention information obtained in step 201, and match the user keyword information obtained in step 203 with the task keyword information obtained in step 201, to generate a matching result for indicating whether the user has completed the target oral practice task.

[0053] Specifically, the execution entity may generate the matching result using various methods based on the matching of the intention information (including the user intention information and the task intention information) and the matching of the keyword information (including the user keyword information and the task keyword information). For example, the execution entity may generate a matching result to indicate that the user has completed the target oral practice task if the matching of the intention information is successful and the matching of the keyword information is successful, and may generate a matching result to indicate that the user has not completed the target oral practice task if the matching of any one of the intention information and the keyword information is unsuccessful. Alternatively, the execution entity may generate a matching result to indicate that the user has not completed the target oral practice task if the matching of the intention information is unsuccessful and the matching of the keyword information is unsuccessful, and may generate a matching result to indicate that the user has completed the target oral practice task if the matching of any one of the intention information and the keyword information is successful.

[0054] Specifically, the execution entity can use various methods to perform information matching (including intention information matching and keyword information matching). For example, the execution entity can perform information matching by comparing whether two pieces of information are similar, and if the two pieces of information are similar, the matching is successful. Alternatively, the execution entity can perform information matching by a similarity calculation method, and if the similarity of the two pieces of information is equal to or greater than a preset similarity threshold, the matching is successful.

[0055] In particular, it should be noted that when matching information, if the corresponding languages ​​of the two pieces of information are different, the executing entity can first translate the information so that the corresponding languages ​​of the two pieces of information are the same, and then match the two pieces of information.

[0056] It can be understood that a unique target oral practice task can be determined based on the task intention information and the task keyword information, and further, whether the user has completed the target oral practice task can be determined by determining whether the user's corresponding user intention information and task keyword information match the task intention information and task keyword information, respectively.

[0057] In step 205, the matching results are displayed to the user.

[0058] In this embodiment, based on the matching result obtained in step 204, the execution entity can display the matching result to the user.

[0059] Specifically, the execution entity can display the matching result in various forms, such as audio, image, text, etc. The user can know whether or not the task has been completed according to the matching result displayed by the execution entity.

[0060] In some alternative implementations of this embodiment, the execution entity can further generate a score for characterizing the user's oral ability based on the voice information and the matching result, and display the generated score to the user. The execution entity can display the matching result, and further score the user's oral ability based on the matching result and the user's voice information, and display the obtained score. Specifically, the execution entity can score the user's oral ability based on the matching result, the fluency of the voice information, the word usage accuracy of the voice information, etc., and the proportion of each of the above-mentioned influencing factors in the score can be preset by the engineer.

[0061] Continuing to refer to FIG. 3, which is a schematic diagram of an application scenario of the method for exchanging information according to the present embodiment. In the application scenario of FIG. 3, the terminal device 301 can first output task information 304 (e.g., “reserve Kung Pao chicken bowl delivered to Zhichun Lu Yingdu Building”) to indicate a target oral practice task (e.g., meal delivery task) in response to receiving an oral practice request 303 initiated by the user 302, where the task information 304 corresponds to task intention information 305 (e.g., “meal delivery”) and task keyword information 306 (e.g., “Kung Pao chicken bowl, Zhichun Lu Yingdu Building”). Then, the terminal device 301 can obtain the voice information 307 input by the user 302 for the task information 304. Next, the terminal device 301 can recognize the speech information 307 to determine the corresponding user intention information 308 (e.g., "meal delivery") and user keyword information 309 (e.g., "Kung Pao Chicken Bowl, Yingdu Building") of the user 302. Then, the terminal device 301 can match the user intention information 308 with the task intention information 305, and the user keyword information 309 with the task keyword information 306, respectively, and generate a matching result 310 to indicate whether the user has completed the target oral practice task. Finally, the terminal device 301 can display the matching result 310 to the user 302.

[0062] The method provided by the above embodiments of the present disclosure can conduct oral practice in a task-based interactive form. Compared with the template-based oral practice method in the prior art, the intelligent level of the solution of the present disclosure is higher, and users can organize language by themselves to complete tasks, which contributes to realizing more flexible and efficient oral practice.

[0063] Further reference is made to Fig. 4, which illustrates a flow 400 of another embodiment of a method for exchanging information. The flow 400 of the method for exchanging information includes the following steps.

[0064] In step 401, in response to receiving a user initiated oral practice request, task information is output to indicate a target oral practice task.

[0065] In this embodiment, an entity executing the method for exchanging information (e.g., the terminal device shown in FIG. 1) can output task information for indicating a target oral practice task in response to receiving an oral practice request initiated by a user via a wired or wireless connection. The oral practice request is used to request to perform oral practice. The target oral practice task is an oral practice task to be completed by the user who initiated the oral practice request. The oral practice task is a task that the user can complete through voice interaction. The task information can be used to characterize the specific content of the target oral practice task.

[0066] In this embodiment, the task information corresponds to task intention information and task keyword information. The task intention information can be used to characterize the objectives of the target oral practice task. The task keyword information can be used to characterize the key points of the objectives. The task intention information and task keyword information can be extracted from the task information.

[0067] In step 402, voice information input by the user in response to the task information is acquired.

[0068] In this embodiment, after the task information is output, the user can input voice information for the acquired task information, and the executing entity can acquire the voice information input by the user for the task information. The voice information is information for completing the target oral practice task corresponding to the task information. It can be understood that the user can input the voice information in the language in which oral practice is required.

[0069] In step 403, the speech information is recognized to determine the corresponding user intent information and user keyword information of the user.

[0070] In this embodiment, based on the voice information obtained in step 402, the actor can recognize the voice information to determine the corresponding user intention information and user keyword information of the user. The user intention information is used to characterize the user intention. The user keyword information is used to characterize the key points of the user intention.

[0071] Step 404 generates a matching result to indicate whether the user has completed the target oral practice task.

[0072] In this embodiment, the execution entity can match the user intention information obtained in step 403 with the task intention information obtained in step 401, and match the user keyword information obtained in step 403 with the task keyword information obtained in step 401, to generate a matching result for indicating whether the user has completed the target oral practice task.

[0073] In step 405, the matching results are displayed to the user.

[0074] In this embodiment, based on the matching result obtained in step 404, the execution entity can display the matching result to the user.

[0075] The above steps 401, 402, 403, 404, and 405 can be performed in a manner similar to steps 201, 202, 203, 204, and 205 in the previous embodiment, respectively, and the above description of steps 201, 202, 203, 204, and 205 also applies to steps 401, 402, 403, 404, and 405, and the description will be omitted here.

[0076] At step 406, in response to the matching result indicating that the user has not completed the target oral practice task, output assistance information for assisting the user to complete the target oral practice task.

[0077] In this embodiment, the execution entity can output support information for supporting the user to complete the target oral practice task in response to an indication that the user will not complete the target oral practice task based on the matching result obtained in step 404. The support information may be information generated for user information (user intention information and / or user keyword information) that does not match information corresponding to the task (task intention information and / or task keyword information), and is used to guide the user to input information matching the information corresponding to the task.

[0078] Specifically, as an example, the target oral practice task may be a meal delivery task, and after the executing entity matches the user intention information with the task intention information, and the user keyword information with the task keyword information based on the voice information, if the executing entity determines that the matching between the meal delivery address information in the user keyword information and the meal delivery address information in the task keyword information is not successful, the executing entity can generate assistance information such as “Please enter the correct meal delivery address.”

[0079] In some alternative implementations of this embodiment, the execution entity can determine whether an oral practice end request input by the user is received in response to the matching result indicating that the user will not complete the target oral practice task, and output assistance information to assist the user in completing the target oral practice task in response to the oral practice end request not being received. The oral practice end request is used to request the end of the current oral practice.

[0080] In reality, completing the oral practice task may not be the user's purpose, and the user may only want to obtain the matching result, so if the matching result is output and the support information is subsequently output, it may cause the user to feel uncomfortable. In this embodiment, the operation of outputting the support information can be controlled by the user, and if the user inputs a request to end the oral practice, the support information is not output, and if the user does not input a request to end the oral practice, the support information is output. This can improve the completeness of the oral practice and the flexibility of the oral practice.

[0081] In step 407, supplemental voice information input by the user in response to the assistance information is obtained.

[0082] In this embodiment, after outputting the support information, the execution subject can obtain supplementary voice information input by the user for the support information. The supplementary voice information may be voice information input by the user after obtaining the support information, for supplementing the voice information input in step 402.

[0083] For example, after the execution entity completes matching of the user intention information and the user keyword information corresponding to the voice information obtained in step 402, if the execution entity determines that the matching between the food delivery address information in the user keyword information and the food delivery address information ("Yingto Building") in the task keyword information is not successful, the execution entity can output support information such as "Please enter the correct food delivery address". Then, the user can input supplemental voice information of "Yingto Building" for the support information.

[0084] In step 408, a new matching result is generated based on the supplemental audio information to indicate whether the user has completed the target oral practice task.

[0085] In this embodiment, based on the supplementary speech information obtained in step 407, the actor can generate a new matching result to indicate whether the user has completed the target oral practice task.

[0086] Specifically, since the support information is generated for mismatched information (including intention information and keyword information), and the supplementary voice information is information input for the support information, the executing entity only needs to match the supplementary voice information with task information (including task intention information and task keyword information) for which matching is not successful, and information that is not mentioned in the supplementary voice information is information for which matching is successful.

[0087] Specifically, if the information that is not successfully matched is intention information, the execution entity can first recognize the supplementary voice information, obtain the supplementary intention information, and then match the supplementary intention information with the task intention information to obtain a new matching result. If the information that is not successfully matched is keyword information, the execution entity can first recognize the supplementary voice information, obtain the supplementary keyword information, and then match the supplementary keyword information with the task keyword information to obtain a new matching result.

[0088] Following the above example, the user inputs supplementary voice information of "Yingto Building" in response to the assistance information "Please enter the correct food delivery address", and then the executing entity recognizes the voice information of "Yingto Building" and obtains text information of "Yingto Building", and then matches the text information "Yingto Building" with the food delivery address information "Yingto Building" in the task keyword information, and obtains a new matching result to indicate that the user has completed the target oral practice task.

[0089] Optionally, if the target oral practice task is still not completed after the user inputs the supplementary voice information (i.e., the new matching result indicates that the user does not complete the target oral practice task), the execution entity can further output assistance information based on the information that the matching is not successful, and further guide the user to complete the target oral practice task.

[0090] In some alternative implementations of this embodiment, the execution entity can, in response to the matching result indicating that the user will not complete the target oral practice task, determine whether the number of times that support information is output to assist the user in completing the target oral practice task is less than or equal to a preset number, and, in response to the number of times that the support information is output being less than or equal to the preset number, output support information to assist the user in completing the target oral practice task.

[0091] This embodiment can limit the number of times support information is output, thereby outputting support information without restrictions and contributing to reducing the possibility of causing discomfort to the user. Furthermore, since outputting support information requires consuming device resources, limiting the number of times support information is output also contributes to reducing the consumption of device resources.

[0092] As can be seen from Fig. 4, compared with the embodiment corresponding to Fig. 2, the flow 400 of the method for exchanging information in this embodiment emphasizes that when the matching result indicates that the user does not complete the target oral practice task, outputting support information to assist the user to complete the target oral practice task. Thus, the solution described in this embodiment can guide the user to complete the target oral practice task by outputting support information, thereby improving the completeness of oral practice and contributing to improving the characteristics of oral instruction in the oral practice process.

[0093] Further referring to FIG. 5, as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of an apparatus for exchanging information, which corresponds to the embodiment of the method shown in FIG. 2, and which can be specifically applied to various electronic devices.

[0094] As shown in FIG. 5 , the apparatus 500 for exchanging information in this embodiment includes: a first output unit 501 configured to output task information for indicating a target oral practice task in response to receiving an oral practice request initiated by a user, where the task information corresponds to task intention information and task keyword information; a first acquisition unit 502 configured to acquire voice information input by a user for the task information; a recognition unit 503 configured to recognize the voice information to determine corresponding user intention information and user keyword information of the user; a first generation unit 504 configured to generate a matching result for indicating whether the user has completed the target oral practice task, where the matching result is obtained by the steps of matching the user intention information with the task intention information, and the user keyword information with the task keyword information, respectively; and a first display unit 505 configured to display the matching result to the user.

[0095] In this embodiment, the first output unit 501 of the device 500 for exchanging information can output task information for indicating a target oral practice task in response to receiving a user-initiated oral practice request via wired or wireless connection. The oral practice request is used to request to perform oral practice. The target oral practice task is an oral practice task to be completed by the user who initiated the oral practice request. The oral practice task is a task that the user can complete by voice interaction. The task information can be used to characterize the specific content of the target oral practice task.

[0096] In this embodiment, the task information corresponds to task intention information and task keyword information. The task intention information can be used to characterize the objectives of the target oral practice task. The task keyword information can be used to characterize the key points of the objectives. The task intention information and task keyword information can be extracted from the task information.

[0097] In this embodiment, after the first output unit 501 outputs the task information, the user can input voice information for the acquired task information, and the first acquisition unit 502 can acquire the voice information input by the user for the task information. The voice information is information for completing the target oral practice task corresponding to the task information. It can be understood that the user can input the voice information in the language in which oral practice is required.

[0098] In this embodiment, based on the voice information obtained by the first acquisition unit 502, the recognition unit 503 can recognize the voice information to determine corresponding user intention information and user keyword information of the user. The user intention information is used to characterize the user intention. The user keyword information is used to characterize the key points of the user intention.

[0099] In this embodiment, the first generation unit 504 can match the user intention information obtained by the recognition unit 503 with the task intention information obtained by the first output unit 501, and match the user keyword information obtained by the recognition unit 503 with the task keyword information obtained by the first output unit 501, so as to generate a matching result for indicating whether the user has completed the target oral practice task.

[0100] In this embodiment, based on the matching result obtained by the first generating unit 504, the first displaying unit 505 can display the matching result to the user.

[0101] In some alternative implementations of this embodiment, the device 500 further includes a second generation unit (not shown) configured to generate a score for characterizing the user's oral ability based on the audio information and the matching result, and a second display unit (not shown) configured to display the generated score to the user.

[0102] In some alternative implementations of this embodiment, the apparatus 500 further includes a second output unit (not shown) configured to output assistance information for assisting the user to complete the target oral practice task in response to the matching result indicating that the user has not completed the target oral practice task, a second acquisition unit (not shown) configured to acquire supplementary audio information input by the user for the assistance information, and a third generation unit (not shown) configured to generate a new matching result for indicating whether the user has completed the target oral practice task based on the supplementary audio information.

[0103] In some alternative implementations of this embodiment, the second output unit includes a first determination module (not shown) configured to determine whether an oral practice end request input by the user has been received in response to the matching result indicating that the user will not complete the target oral practice task, and a first output module (not shown) configured to output assistance information to assist the user in completing the target oral practice task in response to the oral practice end request not being received.

[0104] In some alternative implementations of this embodiment, the second output unit includes a second determination module (not shown) configured to determine whether the number of times that the support information is output to assist the user in completing the target oral practice task is less than or equal to a preset number in response to the matching result indicating that the user will not complete the target oral practice task, and a second output module (not shown) configured to output the support information to assist the user in completing the target oral practice task in response to the number of times that the support information is output being less than or equal to the preset number.

[0105] In some alternative implementations of this embodiment, the first output unit 501 includes an acquisition module (not shown) configured to acquire a user's historical oral practice results, a third determination module (not shown) configured to determine a target oral practice task based on the acquired historical oral practice results, and a third output module (not shown) configured to acquire task information for indicating the target oral practice task and output the acquired task information.

[0106] It can be understood that each unit described in the apparatus 500 corresponds to each step of the method described with reference to Fig. 2. Thereby, the operations, features and resulting beneficial effects described above for the method are similarly applied to the apparatus 500 and the units contained therein, and will not be described here.

[0107] The device 500 provided by the above embodiment of the present disclosure can perform oral practice in a task-based interactive manner. Compared with the template-based oral practice method in the prior art, the intelligent level of the solution of the present disclosure is higher, and users can organize language by themselves to complete tasks, which contributes to realizing more flexible and efficient oral practice.

[0108] Hereinafter, reference will be made to FIG. 6, which shows a configuration diagram of an electronic device (e.g., the terminal device in FIG. 1) 600 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG. 6 is merely an example and does not limit the functions and scope of use of the embodiment of the present disclosure in any way.

[0109] 6, the electronic device 600 may include a processing device (e.g., a central processing unit, an image processor, etc.) 601, which can realize various appropriate operations and processes by programs stored in a read-only memory (ROM) 602 or programs loaded from a storage device 608 into a random access memory (RAM) 603. The RAM 603 stores various programs and data necessary for the operation of the electronic device 600. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a communication bus 604. An input / output (I / O) interface 605 is also connected to the communication bus 604.

[0110] In general, input devices 606 including, for example, a touch screen, touch panel, keyboard, mouse, camera, microphone, accelerometer, gyro, etc., output devices 607 including, for example, a liquid crystal display (LCD), speaker, oscillator, etc., storage devices 608 including, for example, a magnetic tape, hard disk, etc., and communication devices 609 may be connected to the I / O interface 605. The communication devices 609 enable the electronic device 600 to communicate wirelessly or via wires with other devices to exchange data. Although the electronic device 600 is shown in FIG. 6 with various devices, it should be understood that it is not required to implement or include all of the devices shown. Alternatively, more or fewer devices may be implemented or included.

[0111] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowcharts may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product including a computer program carried on a computer-readable medium, the computer program including program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network by the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, it performs the above-mentioned functions defined in the method of the embodiment of the present disclosure.

[0112] It should be explained that the computer readable medium described in this disclosure may be a computer readable signal medium, or a computer readable storage medium, or any combination of the two. The computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read only memory (EPROM or flash memory), optical fiber, a compact disk read only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this disclosure, a computer readable storage medium may be any tangible medium that contains or stores a program, which may be used in or in combination with an instruction execution system, apparatus, or device. In this disclosure, a computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, in which computer readable program code is embedded. The data signal thus propagated may take many forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use in or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wire, optical cable, RF (radio frequency), or the like, or any suitable combination thereof.

[0113] The computer-readable medium may be included in the electronic device, or may exist independently and not be integrated into the electronic device. The computer-readable medium is loaded with one or more programs, and when the one or more programs are executed by the electronic device, the electronic device performs the following steps: in response to receiving an oral practice request initiated by a user, outputting task information for indicating a target oral practice task, the task information corresponding to task intention information and task keyword information; acquiring voice information input by a user for the task information; recognizing the voice information to determine the user's corresponding user intention information and user keyword information; generating a matching result for indicating whether the user has completed the target oral practice task, the matching result being obtained by matching the user intention information with the task intention information and the user keyword information with the task keyword information, respectively; and displaying the matching result to the user.

[0114] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages ​​or combinations thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and general procedural programming languages ​​such as "C" or similar. The program code can run entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer by any network, including a local area network (LAN) or wide area network (WAN), or can be connected to an external computer (e.g., connected via the Internet using an Internet service provider).

[0115] The flowcharts and block diagrams in the drawings illustrate possible system architectures, functions, and operations of the systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or part of code, which includes one or more executable instructions for implementing a specified logical function. It should be noted that in some alternative implementations, the functions depicted in the blocks may be implemented in a different order than that depicted in the drawings. For example, two successively depicted blocks may be executed substantially simultaneously, or, depending on the functionality, they may be executed in the reverse order. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated system based on hardware that executes the specified functions or operations, or by a combination of dedicated hardware and computer instructions.

[0116] The units according to the embodiments of the present disclosure may be realized by software or hardware. The names of the units do not limit the units themselves depending on the case, for example, the first output unit may be further described as a "unit for outputting task information."

[0117] The above is merely a description of the preferred embodiments and the technical principles applied in the present disclosure. It is obvious to those skilled in the art that the scope of the disclosure of the present disclosure is not limited to the technical solution of the specific combination of the above technical features, but should also include other technical solutions formed by any combination of the above technical features or features equivalent thereto without departing from the concept of the disclosure. For example, it also includes technical solutions formed by replacing the above features with technical features having similar functions according to the disclosure of the present disclosure (not limited thereto).

Claims

1. outputting task information for indicating a target oral practice task to be completed by voice interaction in response to receiving a user initiated oral practice request, the task information corresponding to task intention information and task keyword information, the task intention information being used to characterize an objective of a target task, and the task keyword information including at least one keyword in the task information; acquiring voice information input by the user in response to the task information; recognizing the speech information to determine corresponding user intent information and user keyword information of the user, the user intent information being used to characterize a goal of the speech information, and the user keyword information including at least one keyword in the speech information; generating a matching result for indicating whether the user has completed the target oral practice task, the matching result being obtained by matching user intention information with task intention information, and user keyword information with task keyword information, respectively; and displaying the matching results to the user.

2. generating a score based on the speech information and the matching results to characterize the user's oral proficiency; The method of claim 1 , further comprising the step of: displaying the generated score to the user.

3. in response to the matching result indicating that the user will not complete the target oral practice task, outputting assistance information for assisting the user in completing the target oral practice task; acquiring supplementary voice information input by the user in response to the assistance information; The method of claim 1 , further comprising: generating a new matching result based on the supplemental audio information to indicate whether the user has completed the target oral practice task.

4. the step of outputting support information for supporting the user to complete the target oral practice task in response to the matching result indicating that the user will not complete the target oral practice task, determining whether an oral practice end request input by the user is received in response to the matching result indicating that the user will not complete the target oral practice task; and in response to the oral practice completion request not being received, outputting assistance information to assist the user in completing the target oral practice task.

5. the step of outputting support information for supporting the user to complete the target oral practice task in response to the matching result indicating that the user will not complete the target oral practice task, determining whether a number of times of outputting assistance information for assisting the user to complete the target oral practice task is less than or equal to a preset number of times in response to the matching result indicating that the user has not completed the target oral practice task; and in response to the number of times the assistance information is output being equal to or less than a preset number of times, outputting assistance information for assisting the user in completing the target oral practice task.

6. The step of outputting task information for indicating a target oral practice task includes: obtaining historical oral practice results of the user; determining a target oral practice task based on the acquired historical oral practice results; The method of any one of claims 1 to 5, further comprising the steps of: obtaining task information for indicating the target oral practice task; and outputting the obtained task information.

7. a first output unit configured to output task information for indicating a target oral practice task to be completed by voice interaction in response to receiving a user initiated oral practice request, the task information corresponding to task intention information and task keyword information, the task intention information being used to characterize an objective of a target task, and the task keyword information including at least one keyword in the task information; A first acquisition unit configured to acquire voice information input by the user for the task information; a recognition unit configured to recognize the speech information to determine corresponding user intent information and user keyword information of the user, the user intent information being used to characterize a goal of the speech information, and the user keyword information including at least one keyword in the speech information; a first generating unit configured to generate a matching result for indicating whether the user has completed the target oral practice task, the matching result being obtained by the steps of matching user intention information with task intention information, and matching user keyword information with task keyword information, respectively; a first display unit configured to display the matching results to the user.

8. a second generation unit configured to generate a score for characterizing the user's oral proficiency based on the speech information and the matching result; The apparatus of claim 7 , further comprising: a second display unit configured to display the generated score to the user.

9. a second output unit configured to output, in response to the matching result indicating that the user will not complete the target oral practice task, assistance information for assisting the user to complete the target oral practice task; and A second acquisition unit configured to acquire supplementary voice information input by the user for the assistance information; and a third generating unit configured to generate a new matching result based on the supplemental audio information to indicate whether the user has completed the target oral practice task.

10. The second output unit is a first determination module configured to determine whether an oral practice end request input by the user is received in response to the matching result indicating that the user will not complete the target oral practice task; and a first output module configured to output assistance information to assist the user in completing the target oral practice task in response to the oral practice termination request not being received.

11. The second output unit is a second determination module configured to determine whether a number of times of outputting assistance information for assisting the user to complete the target oral practice task is equal to or less than a preset number of times in response to the matching result indicating that the user will not complete the target oral practice task; and a second output module configured to output assistance information to assist the user in completing the target oral practice task in response to a number of times that the assistance information is outputted less than or equal to a preset number of times.

12. The first output unit is an acquisition module configured to acquire historical oral practice results of the user; a third determination module configured to determine a target oral practice task based on the acquired historical oral practice results; and a third output module configured to obtain task information for indicating the target oral practice task and to output the obtained task information.

13. one or more processors; a storage device having one or more programs stored therein; An electronic device, wherein, when the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 6.

14. A computer readable medium having stored thereon a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Terminal and spoken language learning method thereof

    CN109039647A

  • Robot for language learning and language learning system

    JP2005106876A

  • Reading aloud evaluation program, reading aloud evaluation device, and reading aloud evaluation method

    JP2005274830A

  • Language learning device

    JP2007147783A

  • Presentation coaching system

    JP2012255866A