Electronic device, learning support system, learning processing method and program

The electronic device integrates speech recognition with dictionary functions to automatically identify and correct mispronunciations, providing tailored learning methods for enhanced language learning efficiency.

JP7806833B2Active Publication Date: 2026-01-27CASIO COMPUTER CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2024094535
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-03-23
Filing Date
2024-06-11
Publication Date
2026-01-27
Estimated Expiration
2042-05-24

AI Technical Summary

Technical Problem

Conventional electronic devices require users to manually select and execute different learning functions for language learning, leading to isolated study without effective integration of multiple functions.

Method used

An electronic device performs speech recognition on user pronunciation, identifies mispronounced words, and provides a learning method list for corrective learning functions, integrating speech recognition with dictionary functions to enhance language learning efficiency.

Benefits of technology

Facilitates integrated language learning by automatically identifying mispronunciations and offering tailored learning methods, enhancing user engagement and effectiveness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007806833000001
    Figure 0007806833000001
  • Figure 0007806833000002
    Figure 0007806833000002
  • Figure 0007806833000003
    Figure 0007806833000003
Patent Text Reader

Abstract

To provide electronic equipment allowing one to learn a language by effectively using multiple learning functions.SOLUTION: Electronic equipment includes a control part for outputting a learning method list for listing executable learning methods with a word that is determined to have a wrong pronunciation as an object from among words included in a speech when a user reads sentences aloud, and executing a learning function by a learning method selected from the learning method list.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an electronic device, a learning support system, a learning processing method, and a program. [Background technology]

[0002] Some electronic devices, such as electronic dictionaries and personal computers, are equipped with learning functions aimed at learning foreign languages. Language learning includes, for example, a function for learning vocabulary using a dictionary (see, for example, Patent Document 1), a function for learning grammar using example sentences and the like published in a dictionary, a listening learning function for listening to sentences read aloud in the foreign language, and a speaking learning function for learning to pronounce the foreign language correctly. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2021-047769 Summary of the Invention [Problem to be solved by the invention]

[0004] As described above, conventional electronic devices have multiple learning functions for language learning, but even when learning the same language, different learning methods are used depending on the purpose. Therefore, users have had to select a function that uses content that suits their learning purpose from multiple learning functions, specify the learning target (e.g., vocabulary), and then execute the learning function. Therefore, when learning a language, users tend to study content alone.

[0005] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an electronic device, a learning support system, a learning processing method, and a program that enable language learning by effectively using multiple learning functions. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, an electronic device according to an embodiment of the present invention performs a speech recognition process on the voice of a user when reading a sentence aloud, and as a result, determines whether the pronunciation of words included in the sentence is correct or incorrect; extracts from the sentence any mispronounced words whose pronunciation has been determined to be incorrect from among the words included in the sentence as a result of the accuracy determination; and changes the extracted mispronounced words to original words whose original forms are derived from the mispronounced words; outputting the original word obtained by changing the misread word; The control unit outputs a learning method list that lists learning methods that can be implemented for the original word, and executes a learning function using a learning method selected from the learning method list. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide an electronic device, a learning support system, a learning processing method, and a program that enable language learning by effectively using a plurality of learning functions. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a schematic diagram of a learning support system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a front view showing the external configuration of an electronic dictionary according to an embodiment of the present invention. [Figure 3] FIG. 2 is a functional block diagram showing the configuration of an electronic circuit of another electronic device that is connected to the electronic dictionary via communication when used according to the embodiment of the present invention. [Figure 4] 4 is a flowchart showing the operation of the electronic dictionary according to the present embodiment. [Figure 5] 4 is a flowchart showing the operation of the tablet PC (digital textbook) in this embodiment. [Figure 6] FIG. 3 is a diagram showing an example of a textbook screen displayed on a touch panel display unit of a tablet PC according to the embodiment. [Figure 7] FIG. 3 is a diagram showing an example of an extracted word list displayed in the electronic dictionary according to the embodiment. [Figure 8] FIG. 3 is a diagram showing an example of a textbook screen displayed on a touch panel display unit of a tablet PC according to the embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a learning method list displayed on the electronic dictionary according to the embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a learning function execution screen when "vocabulary learning" is selected from the learning method list in this embodiment. [Figure 11] FIG. 10 is a diagram showing an execution screen of a wordbook registration function executed in accordance with the learning method "word learning" in this embodiment. [Figure 12] FIG. 10 is a diagram showing an example of a learning function execution screen when "pronunciation training" is selected from the learning method list in this embodiment. [Figure 13] FIG. 10 is a diagram showing an example of an execution screen of the example sentence search function when "Example Sentence Study" is selected from the learning method list in this embodiment. [Figure 14] 1 is a schematic diagram of a learning support system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] FIG. 1 is a schematic diagram of a learning support system according to an embodiment of the present invention. The learning support system 1 includes an electronic dictionary 10 as an electronic device (first electronic device) and a tablet PC 20 as an electronic device (second electronic device). The learning support system 1 may further include a server 30. The server 30 provides images and test data including digital textbook data to the tablet PC 20 and the like via a network N. FIG. 1 shows a functional block diagram illustrating the configuration of the electronic circuitry of the electronic dictionary 10.

[0011] In this embodiment, an example is shown in which the electronic device is configured as, for example, an electronic dictionary 10. Note that the electronic device can be realized by various electronic devices such as the electronic dictionary 10, a personal computer, a smartphone, a tablet PC, a game device, and the like.

[0012] The electronic dictionary 10 stores multiple types of dictionary content as dictionary data. The dictionary content stores at least one piece of information about the meaning of each of multiple headwords. The dictionary content stored in the electronic dictionary 10 is generally created by publishers and includes content that has also been published in print form, making it highly reliable. Therefore, by effectively utilizing the highly reliable dictionary content for study, correct and effective study results can be expected.

[0013] The dictionary content is not limited to dictionaries about foreign languages ​​such as English or Japanese languages, but also includes content such as encyclopedias, study guides, workbooks, literary works, and commentaries.

[0014] The dictionary content can be used not only through the dictionary search function, but also as learning content for language learning.

[0015] The electronic dictionary 10 has the configuration of a computer that reads programs recorded on various recording media or transmitted programs and whose operation is controlled by the read programs, and its electronic circuitry is equipped with a CPU (central processing unit) 11.

[0016] The CPU 11 functions as a control unit that controls the entire electronic dictionary 10. The CPU 11 controls the operation of each circuit unit in accordance with a control program that is pre-stored in the memory 12, or a control program that is read into the memory 12 from a recording medium 13 such as a ROM card via a recording medium reader 14, or a control program that is downloaded from an external device (such as a server) and read into the memory 12 via a network N such as the Internet.

[0017] The control program stored in the memory 12 is activated in response to an input signal from the key input unit 16 in response to a user operation, an input signal from the touch panel display unit 17 as a display unit in response to a user operation, or a connection communication signal with an external recording medium 13 such as an EEPROM (registered trademark), RAM, or ROM connected via the recording medium reading unit 14.

[0018] The CPU 11 is connected to a memory 12, a recording medium reading unit 14, a communication unit 15, a key input unit 16, a touch panel display unit 17 (display), an audio input unit (microphone) 18, an audio output unit (speaker) 19, etc. In one embodiment, the display unit does not need to have a touch panel function. For example, an LCD (Liquid Crystal Display) may be used as the display unit instead of the touch panel display unit 17.

[0019] The control programs stored in the memory 12 include a dictionary control program 12a, a voice recognition program 12b, a learning method processing program 12c, etc. The dictionary control program 12a is a program for controlling the overall operation of the electronic dictionary 10. The dictionary control program 12a also realizes a dictionary search function that searches dictionary content based on a character string input via the input unit (key input unit 16, touch panel display unit 17, voice input unit 18) and displays the information.

[0020] The dictionary control program 12a not only provides a dictionary search function that searches dictionary content and displays information, but also implements multiple different learning functions that can be used to learn foreign languages. The foreign languages ​​can include, for example, English, Chinese, Korean, German, and French. The multiple learning functions include, for example, a word search function that is effective for vocabulary learning, a sentence search function that is suitable for learning sentences, a listening learning function that allows users to listen to sentences and words read aloud in the foreign language, a speaking learning function (pronunciation training function) that allows users to practice correctly pronouncing sentences and words in the foreign language, and a vocabulary book registration function that registers specific words and other information that need to be learned. Furthermore, the program can also be provided with functions for studying grammar and long passages, a function for viewing reference books for foreign language qualification exams, and a test question function that presents and prompts users to answer test questions. The above-mentioned learning functions are merely examples, and other functions that can be used to learn foreign languages ​​can also be provided.

[0021] Each learning function can process multiple contents. For example, the word search function can use multiple dictionary contents as search targets, and can search all of them or select one of them. The speaking learning function can selectively use sentence content for practicing sentence pronunciation and word content for practicing word pronunciation. The test question function has multiple test question contents with different test types and question levels, and can process any of them.

[0022] The speech recognition program 12b is a program that realizes a speech recognition function that recognizes speech of a learner reading aloud sentences, etc. input from the speech input unit 18, and outputs the sentences, etc. read aloud by the learner. The speech recognition program 12b can recognize speech in a plurality of languages, for example, English, Chinese, Korean, German, and French. In speech recognition by the speech recognition program 12b, for example, an acoustic analysis is performed on speech data of speech read aloud by the learner, and the spoken sentences, etc. are detected by comparing the acoustic analysis results with a speech recognition dictionary (including an acoustic model, a language model, a pronunciation dictionary, etc.) prepared in advance for each language.

[0023] In the voice recognition program 12b of this embodiment, when there is data of a sentence or the like to be read aloud, the result of voice recognition of the voice of the sentence or the like being read aloud is compared with the data of the sentence or the like to be read aloud, thereby making it possible to determine whether the pronunciation of words included in the sentence or the like being read aloud is correct. Also, when there is no data of the sentence or the like to be read aloud, if a word obtained from the result of voice recognition of the voice of the sentence or the like being read aloud is not included in pre-registered words to be recognized as voices (for example, a database in which words to be recognized as voices are registered), it is possible to determine that the word is pronounced incorrectly.

[0024] The learning method processing program 12c utilizes the results of the speech recognition processing by the speech recognition program 12b, and realizes the function of identifying a learning function (learning method) that can be used for learning, for example, a mispronounced word, from among the multiple learning functions provided by the dictionary control program 12a, and providing a learning method list that lists the learning functions (learning methods).

[0025] The memory 12 stores dictionary data 12d, extracted word data 12e, learning method search data 12f, learning content data 12g, and the like.

[0026] The dictionary data 12d includes a database that collects dictionary content, such as multiple dictionaries, including an English-Japanese dictionary, a Japanese-English dictionary, an English-English dictionary, an English-Chinese dictionary, and a Japanese dictionary, as well as multiple types of encyclopedias. It is noted that the dictionary data 12d may include not only English dictionary content but also dictionary content in other languages. The dictionary data 12d associates semantic information that explains the meaning (semantics) of each entry word with each dictionary. The dictionary data 12d may be stored in an external device (such as a server) accessible via the network N, rather than being built into the electronic dictionary 10.

[0027] The extracted word data 12e is data indicating words that are extracted from the speech recognition result of the speech recognition by the speech recognition program 12b and that are determined to be incorrect by the accuracy judgment of the pronunciation. Note that the extracted word data 12e may also be data indicating words that are obtained by speech recognition of speech in which a sentence or the like is read aloud, regardless of the accuracy judgment.

[0028] The learning method search data 12f is data indicating learning functions that can be executed for the words determined to be incorrectly pronounced as indicated by the extracted word data 12e. The learning functions indicated by the learning method search data 12f are listed as learning methods that can be used to learn words through processing by the learning method processing program 12c, and are output by displaying them on the touch panel display unit 17, etc.

[0029] The learning content data 12g is data relating to content used by various learning functions of the dictionary control program 12a.

[0030] The communication unit 15 performs communication control to communicate with other electronic devices via a network N such as the Internet or a LAN (Local Area Network), or to perform communication control for short-range wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark) with other electronic devices in the vicinity (e.g., tablet PC 20).

[0031] By connecting to other electronic devices (for example, tablet PC 20) through communication unit 15, electronic dictionary 10 can execute processes linked with the other electronic devices.

[0032] In the electronic dictionary 10 configured in this manner, the CPU 11 controls the operation of each part of the circuit in accordance with the instructions written in various programs such as the dictionary control program 12a, the voice recognition program 12b, and the learning method processing program 12c, and the software and hardware work together to realize the functions described in the following operational explanation.

[0033] FIG. 2 is a front view showing the external configuration of electronic dictionary 10 according to this embodiment.

[0034] In the case of electronic dictionary 10 in Figure 2, the lower section of the device body, which can be opened and closed, houses CPU 11, memory 12, recording medium reading section 14, communication section 15, voice input section 18, voice output section 19, as well as key input section 16, and the upper section houses touch panel display section 17.

[0035] The key input section 16 is provided with character input keys 16a, a dictionary selection key 16b for selecting various dictionaries and various functions, a [Translate / Confirm] key 16c, a [Back] key 16d, cursor keys (up, down, left, right keys) 16e, a delete key 16f, a power button, and various other function keys.

[0036] Various menus, buttons 17a, etc. are displayed on touch panel display unit 17 in accordance with the execution of various functions. Touch panel display unit 17 allows touch operations to select various menus or buttons 17a, and handwritten character input to input characters, using, for example, a pen.

[0037] 3 is a functional block diagram showing the configuration of an electronic circuit of another electronic device (second electronic device) that is connected to the electronic dictionary 10 via communication and used according to this embodiment. In this embodiment, an example is shown in which the other electronic device (second electronic device) is configured as, for example, a tablet PC 20. The tablet PC 20 is a device used, for example, as a digital textbook. Note that the present invention is not limited to the tablet PC 20, and can be realized by various electronic devices such as a personal computer, a smartphone, a game device, etc.

[0038] The tablet PC 20 can access a server 30 connected via a network N including the Internet, and display web pages and text files including digital textbook data provided by the server 30 for the user to view.

[0039] The tablet PC 20 has the configuration of a computer that reads programs recorded on various recording media or transmitted programs and whose operation is controlled by the read programs, and its electronic circuitry is equipped with a CPU (central processing unit) 21.

[0040] The CPU 21 functions as a control unit that controls the entire tablet PC 20. The CPU 21 controls the operation of each circuit unit in accordance with a control program that is pre-stored in the memory 22, or a control program that is read into the memory 22 from a recording medium 23 such as a ROM card via a recording medium reading unit 24, or a control program that is downloaded from an external device (such as a server) and read into the memory 22 via a network N such as the Internet.

[0041] The control program stored in the memory 22 is activated in response to an input signal in response to a user operation from the button input unit 26, an input signal in response to a user operation from the touch panel display unit 27, or a connection communication signal with an external recording medium 23 such as an EEPROM (registered trademark), RAM, or ROM connected via the recording medium reading unit 24.

[0042] Connected to the CPU 21 are a memory 22, a recording medium reading unit 24, a communication unit 25, a button input unit 26, a touch panel display unit 27 as a display unit, an audio input unit (microphone) 28, an audio output unit (speaker) 29, and the like.

[0043] The control programs stored in memory 22 include a basic program 22a (OS (Operating System)) that controls the overall operation of tablet PC 20, and a textbook processing program 22b for displaying textbook screens (including text, images, etc.) based on textbook data.

[0044] The tablet PC 20 executes the basic program 22a and the textbook processing program 22b to transmit, for example, sentence data (text data) included in the textbook data to be displayed on the tablet PC 20 to the electronic dictionary 10 via communication.

[0045] The memory 22 stores textbook data 22c, extracted word data 22d, and the like, which are to be displayed by the textbook processing program 22b.

[0046] The textbook data 22c includes text data and image data representing various textbooks. The textbook data 22c is displayed on the touch panel display unit 27 under the control of the textbook processing program 22b. When the tablet PC 20 is connected to the electronic dictionary 10 and executes a linked process, the data to be processed (e.g., sentence data) displayed on the touch panel display unit 27 is transmitted to the electronic dictionary 10.

[0047] The extracted word data 22d is data received from the electronic dictionary 10 when the tablet PC 20 is connected to the electronic dictionary 10 and executes linked processing. When sentence data to be processed is transmitted to the electronic dictionary 10, the extracted word data 22d is data indicating words that are extracted from the speech recognition results of the speech recognition in the electronic dictionary 10 and that have been determined to be incorrect by a pronunciation accuracy determination, among the words included in the sentence data. Based on the extracted word data 22d, under the control of the textbook processing program 22b, the words indicated by the extracted word data 22d in the sentence displayed on the touch panel display unit 27 are displayed in a display form that is different from the others.

[0048] The communication unit 25 performs communication control to communicate with other information processing devices (e.g., server 30) via a network N such as the Internet or a LAN (Local Area Network), or to perform communication control for short-range wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark) with other electronic devices (e.g., electronic dictionary 10) in the short range.

[0049] The voice input unit 28 inputs voices of learners reading aloud sentences, etc. The voice output unit 29 outputs various sounds in accordance with the processing by the CPU 21.

[0050] Next, the operations of the electronic dictionary 10 and the tablet PC 20 (digital textbook) as the second electronic device in this embodiment will be described.

[0051] First, a case where the electronic dictionary 10 and the tablet PC 20 operate in cooperation with each other will be described.

[0052] Fig. 4 is a flowchart showing the operation of the electronic dictionary 10 in this embodiment. Fig. 5 is a flowchart showing the operation of the tablet PC 20 (digital textbook) in this embodiment.

[0053] First, the user starts processing to connect (set up a link) the electronic dictionary 10 and the tablet PC 20 by wireless communication. When the CPU 11 of the electronic dictionary 10 receives an instruction to set up a link (Yes in step A1), it executes a communication program to set up wireless communication with the tablet PC 20 via the communication unit 15. When the CPU 21 of the tablet PC 20 receives an instruction to set up a link (Yes in step B1), it executes a communication program to set up wireless communication with the electronic dictionary 10 via the communication unit 25. As a result, the electronic dictionary 10 and the tablet PC 20 each execute processing to set up a communication link (steps A2 and B2), and become ready for data communication.

[0054] When tablet PC 20 is instructed to execute textbook processing program 22b in response to a user operation, it reads out textbook data 22c from memory 22 (step B3) and displays a textbook screen (text, images, etc.) on touch panel display unit 27 based on textbook data 22c (step B4). Tablet PC 20 changes the display content of the textbook screen in response to an operation on touch panel display unit 27 or button input unit 26.

[0055] 6A and 6B show examples of textbook screens displayed on the touch panel display unit 27 of the tablet PC 20 in this embodiment. The textbook screen shown in Fig. 6A displays, for example, "Did you enjoy your homestay in London?" as a sentence representing the content of a conversation in English.

[0056] When the tablet PC 20 displays a sentence as shown in FIG. 6(A), it is possible to use the voice recognition function of the electronic dictionary 10 to determine whether the sentence data is read aloud.

[0057] For example, when the range of text to be read aloud is specified by touch operation or the like for a sentence displayed on the touch panel display unit 27 (step B5, Yes), the CPU 21 of the tablet PC 20 transmits the sentence data (text data) to the electronic dictionary 10 via the communication unit 25 (step B6).

[0058] Meanwhile, when the CPU 11 of the electronic dictionary 10 receives the text data to be read aloud from the tablet PC 20 via the communication unit 15 (step A3, Yes), it temporarily stores the text data in the memory 12 (step A4).

[0059] In response to receiving the text data from the tablet PC 20, the CPU 11 starts the voice recognition program 12b, and transitions to a state in which voice recognition by the voice recognition function for voice input from the voice input unit 18 is possible.

[0060] Here, the user instructs the electronic dictionary 10 to start reading aloud, for example, by operating the key input unit 16, and the tablet PC 20 starts reading aloud the sentence selected as the subject of reading aloud (text data transmitted from the tablet PC 20).

[0061] When an instruction to start reading aloud is input (step A5), CPU 11 executes a speech recognition process on the speech data of the speech input from speech input unit 18 (the speech of the user reading aloud the text) (step A6). In the speech recognition process, processing is performed according to the language to be read aloud. For example, when an English text is to be read aloud, the language may be specified as English in advance, and speech recognition processing using a speech recognition dictionary for English may be executed. Similarly, by specifying languages ​​such as Chinese, Korean, German, and French, speech recognition processing for each language may be executed using a speech recognition dictionary for each language.

[0062] Furthermore, speech recognition processing for each language may be performed without specifying the language in advance. For example, an acoustic analysis is performed on speech data, and the language is determined by comparing the acoustic analysis results with a speech recognition dictionary (including an acoustic model, a language model, a pronunciation dictionary, etc.) for each language that has been prepared in advance, and speech recognition processing is performed using the speech recognition dictionary for the determined language. Furthermore, a speech recognition function using AI (Artificial Intelligence) technology may be provided and multiple languages ​​may be learned, so that speech recognition processing for each language can be performed without specifying the language in advance.

[0063] The CPU 11 performs speech recognition processing on the input speech data and outputs text data as the speech recognition result. Furthermore, the CPU 11 compares the text data as the speech recognition result with the sentence data received from the tablet PC 20 to determine whether the pronunciation of words included in the sentence is correct. That is, the text data as the speech recognition result and the text data of the sentence are compared word by word, and if they match, the word is determined to be correctly pronounced, and if they differ, the word is determined to be incorrectly pronounced.

[0064] The CPU 11 extracts the words determined to be incorrectly pronounced as mispronounced words, associates the mispronounced words with the original words of the sentence data, and records the associations as extracted word data 12e in the memory 12 (step A7). The CPU 11 transmits the extracted word data 12e indicating the words determined to be incorrectly pronounced to the tablet PC 20 as the speech recognition result for the reading of the sentence (step A8).

[0065] When the CPU 21 of the tablet PC 20 receives the extracted word data 12e from the electronic dictionary 10 (step B7, Yes), it stores the extracted word data 12e in the memory 22 (extracted word data 22d). In accordance with the extracted word data 22d, the CPU 21 displays, for the sentence selected as the subject of reading aloud currently displayed on the touch panel display unit 27, words corresponding to the mispronounced words indicated by the extracted word data 22d, i.e., words that could not be pronounced correctly, in a display format different from the display of the other sentences (step B8).

[0066] The textbook screen shown in Figure 6(B) shows an example in which the display format has been changed for the words "enjoy" and "homestay." Examples of different display formats that can be applied to words include changing the font color, highlighting, and underlining. Other display formats can also be used.

[0067] In this way, by linking with the electronic dictionary 10, the tablet PC 20 uses the voice recognition function of the electronic dictionary 10 to change the display format (performs a reading determination) of words that could not be pronounced correctly (words determined to be incorrectly pronounced) in the sentence being displayed on the touch panel display unit 27. This allows the user to easily visually confirm words determined to be incorrectly pronounced.

[0068] When an instruction to change the display content of the textbook screen is input in response to an operation on the touch panel display unit 27 (step B9, No), the CPU 21 reads out the textbook data 22c from the memory 22 (step B3) and displays the changed textbook screen on the touch panel display unit 27 based on the textbook data 22c (step B4).

[0069] Furthermore, when an instruction to end the display of the textbook screen is given (step B9, Yes), the CPU 21 ends the process.

[0070] Meanwhile, the electronic dictionary 10 records the extracted word data 12e in the memory 12, and also makes a list (extracted word list) of the misread words indicated by the extracted word data 12e and displays it on the touch panel display unit 17 (step A9).

[0071] In this embodiment, an extracted word list is created and displayed, but it is also possible to register words using the vocabulary book registration function of the dictionary control program 12a and display a screen that lists the words registered in the vocabulary book registration function.

[0072] 7 is a diagram showing an example of an extracted word list displayed in the electronic dictionary 10 according to this embodiment. The extracted word list shown in FIG. 7 shows an example in which two words, "enjoy" and "homestay," are displayed.

[0073] In the example shown in Figure 7, the word "enjoy" (see Figure 6(A)) in the text data received from the tablet PC 20 is voice-recognized as, for example, "enjoying," and similarly, the word "homestay" (see Figure 6(A)) is voice-recognized as, for example, "hamster," and each pronunciation is determined to be incorrect.

[0074] In the examples shown in Figures 6 and 7, when creating the extracted word list, the words are listed as they are spelled in the text data ("enjoy", "homestay"), but as explained below, it is also possible to list words with their spelling changed from the text data.

[0075] Fig. 8(A) shows an example of a textbook screen displayed on the touch panel display unit 27 of the tablet PC 20 in this embodiment. The textbook screen shown in Fig. 8(A) displays, for example, "Are you enjoying your homestay in London?" as a sentence representing the content of a conversation in English.

[0076] In the same manner as described above, the sentence shown in Fig. 8(A) is read aloud, and the speech recognition function of the electronic dictionary 10 is used to determine whether the speech read aloud is correct. As a result, the word "enjoying" in the sentence data is recognized as "join," for example, and the pronunciation is determined to be incorrect (the pronunciation of the word "homestay" is determined to be correct). On the textbook screen, the display format of the word "enjoying" is changed and it is displayed as a word that was not pronounced correctly, as shown in Fig. 8(B).

[0077] In this case, instead of listing the word "enjoying" as it is in the text data, for example, the word "enjoying" in the text data is converted to its root form and listed. In other words, in the same way as in Figure 7, the root form of the word "enjoying" is listed, and the extracted word list is displayed.

[0078] The extracted word list does not display duplicates of the same word, or even duplicates of the same word with different spellings (for example, "enjoying" and "enjoy"), making it easier to select words from the extracted word list.

[0079] Note that the sentence shown in Figure 8(A) shows an example of the word "enjoying" written in the present participle form, but this is not limited to the present participle form, and can also apply to words written in a different form from their original form.

[0080] For example, the same can be done for words in the third person singular present notation, past tense, past participle, plural, and notations with prefixes / suffixes added, and the notation can be changed to the original form of the word to create an extracted word list.

[0081] If the dictionary data 12d contains a relationship between the root form of a word and a word with a different spelling from the root form, the spelling of the word in the text data is changed to the root form by referring to the dictionary data 12d. Also, table data indicating the relationship between the root form of a word and a word with a different spelling from the root form may be prepared separately from the dictionary data 12d, and the spelling of the word in the text data may be changed to the root form by referring to this table data.

[0082] Here, when an instruction to select one of the words from the extracted word list displayed on the touch panel display unit 17 is input (for example, by touching the check button corresponding to the word) (step A10), the CPU 11 searches for a learning method corresponding to the word and displays a learning method list on the touch panel display unit 17 (step A11).

[0083] That is, the CPU 11 searches for a learning function that can learn a word selected from the extracted word list from among the multiple learning functions provided by the dictionary control program 12a. For example, if the content to be processed by each learning function contains a word selected from the extracted word list, the CPU 11 can determine that the learning function is capable of learning (executable).

[0084] Alternatively, an index may be created in advance in which executable learning functions (learning methods) are registered for each word, and this index may be searched based on a word selected from the extracted word list to determine the executable learning functions corresponding to the word.

[0085] 9 is a diagram showing an example of a learning method list displayed on the electronic dictionary 10 in this embodiment. The learning method list shown in FIG. 9 shows an example in which the word "enjoy" is selected from the extracted word list.

[0086] As shown in Figure 9, the learning method list makes it easy to recognize that the word "enjoy" can be learned through "vocabulary learning," "example sentence learning," "pronunciation training," and "grammar learning." The learning method list does not include learning methods that cannot be used to learn the word "enjoy." Therefore, by using the learning method list, it is possible to efficiently select from multiple learning methods a learning method that can be used to learn. Furthermore, by selecting and executing multiple learning methods included in the learning method list, it is possible to effectively learn words selected from the extracted word list (i.e., words determined to be incorrectly pronounced).

[0087] When a learning method is selected from the learning method list (step A12, Yes), CPU 11 executes the selected learning function (step A13) using the word selected from the extracted word list as the processing target (based on the selected word), and displays an execution screen for the learning function on touch panel display 17 (step A14). In one embodiment, the execution screen includes at least a portion of the content to be processed by the learning function. Specifically, the execution screen may include a portion of the content to be processed that includes the word to be processed (for example, an explanation of the word in the dictionary content, or, in the case of executing the example sentence search function described below, a sentence including the word to be processed).

[0088] FIG. 10 is a diagram showing an example of a learning function execution screen when "vocabulary learning" is selected from the learning method list in this embodiment.

[0089] 10 shows the execution screen of the word search function executed in accordance with the learning method "vocabulary study." When the word search function is normally executed, it is started with the entry word input area 40 blank, but when it is started when selected from the learning method list, a screen is displayed showing the results of a word search performed using a word selected from the extracted word list as the entry word.

[0090] This eliminates the need to start the learning function and then specify the words to be learned (enter them as headwords), allowing for efficient learning.

[0091] The execution screen of the word search function shown in Fig. 10 shows search results for multiple different dictionaries (such as "G English-Japanese," "W English-Japanese," and "O English-Japanese") included in the dictionary data 12d. In other words, the word search function processes multiple contents. Here, the word search function can be executed not only on multiple contents (dictionaries), but also by selecting one of the dictionaries (contents) to execute the word search function.

[0092] Furthermore, in the above explanation, when "word learning" is selected from the learning method list, the word search function is executed, but multiple different learning functions may be associated with the learning method "word learning."

[0093] For example, the learning method "vocabulary learning" can be associated with a word search function as well as a word book registration function. This allows the user to select one of multiple learning functions that process different content for one learning method, depending on the learning content they need.

[0094] 11 shows an execution screen of the wordbook registration function executed in accordance with the learning method "vocabulary learning" in this embodiment. As shown in FIG. 11, the execution screen of the wordbook registration function displays an execution screen in which the word "enjoy" selected from the extracted word list has been registered.

[0095] FIG. 12 is a diagram showing an example of a learning function execution screen when "pronunciation training" is selected from the learning method list in this embodiment.

[0096] The execution screen of the speaking learning function executed according to the learning method "Pronunciation Training" shown in Figure 12 shows the execution screen of the function for practicing pronunciation by word. The speaking learning function can execute not only the function for practicing pronunciation by word shown in Figure 12, but also the function for practicing pronunciation by sentence unit including the word "enjoy" selected from the extracted word list.

[0097] 13 is a diagram showing an example of an execution screen of the example sentence search function when "Example Sentence Study" is selected from the learning method list in this embodiment. As shown in Fig. 13, the execution screen of the example sentence search function displays a list of example sentences obtained by searching a dictionary (for example, "G Dictionary") included in the dictionary data 12d for example sentences based on the word "enjoy" selected from the extracted word list.

[0098] After selecting a learning method from the learning method list and executing one of the learning functions, if, for example, the [Back] key 16d of the key input unit 16 is operated (step A15, No), the CPU 11 returns to the state in which the learning method list before the execution of the learning function is displayed on the touch panel display unit 17 (in this case, there is no need to search for a learning method). Thereafter, the CPU 11 executes the same processes as described above (steps A11 to A14).

[0099] This allows for effective learning by sequentially selecting and executing different learning functions from the learning method list for one word selected from the extracted word list. Furthermore, the learning support system of this embodiment allows the user to efficiently learn words that the user was unable to pronounce correctly, i.e., words that are highly necessary to learn.

[0100] When the CPU 11 receives an instruction to end the process (Yes in step A15), it ends the learning process that uses the results of the voice recognition process.

[0101] Next, a case where the electronic dictionary 10 and the tablet PC 20 do not cooperate with each other will be described.

[0102] In this case, when tablet PC 20 is instructed to execute textbook processing program 22b in response to a user operation, it reads out textbook data 22c from memory 22 (step B10) and displays a textbook screen (text, images, etc.) on touch panel display unit 27 based on textbook data 22c (step B11). Tablet PC 20 changes the display content of the textbook screen in response to the operation on touch panel display unit 27.

[0103] When using the voice recognition function of the electronic dictionary 10, the user instructs the electronic dictionary 10 to start reading aloud, for example, by operating the key input unit 16, and the electronic dictionary 10 starts reading aloud a sentence or the like displayed on the touch panel display unit 27 of the tablet PC 20.

[0104] When an instruction to start reading aloud is input (step A5), the CPU 11 inputs the voice input from the voice input unit 18 (step A6) and executes a voice recognition process on this voice data (step A7). In the voice recognition process, similar to the above, processing according to the language to be read aloud is executed.

[0105] However, when not linked with tablet PC 20, the text data to be read aloud is not received, so CPU 11 refers to, for example, a database in which words to be recognized are registered for the text data that is the result of speech recognition, and if the text data contains a word that does not exist in the database, it determines that the pronunciation of that word is incorrect. If a word that has been speech-recognized is not included in the database, the word obtained as a result of the speech recognition can also be said to be a non-existent word.

[0106] In this case, the CPU 11 may compare the word obtained as a result of the speech recognition with a plurality of pre-registered words to be the target of speech recognition, and may determine, as an incorrectly pronounced word, a pre-registered word whose degree of match (recognition accuracy, i.e., recognition likelihood) with the word obtained as a result of the speech recognition is equal to or less than a predetermined reference value. Furthermore, in one embodiment, the CPU 11 may determine, as an incorrectly pronounced word, a pre-registered word with the greatest degree of match.

[0107] The degree of match is calculated, for example, by converting input data (audio data) of a voice read aloud by a user into pronunciation data (phonetic symbols), comparing the sequence of the pronunciation data of the audio data with the sequence of the pronunciation data of pre-registered words, and calculating the ratio of the number of correctly pronounced characters to the total number of characters constituting the words to be compared. The pronunciation data of the pre-registered words is registered in a database in advance in association with the words. The degree of match may be used to determine whether the pronunciation is correct or incorrect as described above.

[0108] Furthermore, CPU 11 can also display all words extracted by speech recognition processing of the read aloud on touch panel display unit 17 and allow the user to arbitrarily select any word to generate extracted word data 12e. That is, the user designates a word that has been misread (misrecognized) from the words displayed on touch panel display unit 17 as a word whose pronunciation is to be determined to be incorrect.

[0109] Thereafter, the CPU 11 stores the extracted word data 12e indicating the word determined to be incorrectly pronounced in the memory 12, and executes the same processes as described above (steps A9 to A15). In this way, even when the electronic dictionary 10 is not linked to the tablet PC 20, it can use the voice recognition function of the electronic dictionary 10 to perform a reading aloud judgment on a sentence read aloud by the user and display a learning method list based on words that are judged to be incorrectly pronounced as a result of the judgment, thereby achieving the same effect as when linked to the tablet PC 20.

[0110] In the above explanation, the electronic dictionary 10 and the tablet PC 20 are described as independent electronic devices, but if the electronic device has the functions of the electronic dictionary 10 and the tablet PC 20 (digital textbook), the functions of the electronic dictionary 10 and the tablet PC 20 can be realized in a single electronic device.

[0111] In the above description, the electronic dictionary 10 determines whether the pronunciation of words included in a sentence is correct by comparing text data resulting from the speech recognition with sentence data received from the tablet PC 20. However, the tablet PC 20 may determine whether the pronunciation is correct. In this case, the tablet PC 20 has a speech recognition function (not shown), and transmits word data indicating words determined to be incorrectly pronounced as a result of the accuracy determination of speech input from the speech input unit 28 to the electronic dictionary 10. The electronic dictionary 10 creates a list of misread words (creates an extracted word list) based on the word data received from the tablet PC 20. In this case, the tablet PC 20 does not need to transmit sentence data to be read aloud to the electronic dictionary 10.

[0112] Furthermore, in the above explanation, the learning support system is described as a system in which the tablet PC 20 is connected to the electronic dictionary 10 and executes processing in cooperation with the electronic dictionary 10, but the electronic dictionary 10 and the server may work together to execute processing similar to that described above, or processing may be executed in cooperation with only the server instead of the electronic dictionary 10.

[0113] Fig. 14 is a schematic diagram of a learning support system according to another embodiment of the present invention. The learning support system 1 of this embodiment further includes a server 40. Fig. 14 shows a functional block diagram illustrating the configuration of the electronic circuit of the server 40. The configuration and operation of this embodiment that are not specifically described are the same as those of the above-described embodiment, and therefore, redundant description thereof will be omitted.

[0114] The server 40 is provided as an electronic device (external electronic device) in the same way as the electronic dictionary 10, and is used, for example, in cooperation with the electronic dictionary 10 or in place of the electronic dictionary 10. By providing the server 40 with a voice recognition function (voice recognition program) in the same way as the electronic dictionary 10, it is possible to perform reading aloud determination using the voice recognition function (including determination of word pronunciation errors) realized by the electronic dictionary 10 and the server 40 working together, or using only the voice recognition function of the server 40.

[0115] The server 40 has a computer configuration that reads programs recorded on various recording media or transmitted programs and whose operation is controlled by the read programs, and its electronic circuitry is equipped with a CPU (central processing unit) 41.

[0116] The CPU 41 functions as a control unit that controls the entire server 40. The CPU 41 controls the operation of each circuit unit in accordance with a control program that is pre-stored in the memory 42, or a control program that is read into the memory 42 from a recording medium 43 such as a ROM card via a recording medium reading unit 44, or a control program that is downloaded from an external device (such as a server) and read into the memory 42 via a network N such as the Internet.

[0117] The CPU 41 is connected to a memory 42, a recording medium reading unit 44, a communication unit 45, etc. Control programs stored in the memory 42 include a dictionary control program 42a, a voice recognition program 42b, a learning method processing program 42c, etc. The programs and data stored in the memory 42 shown in Fig. 14 are substantially the same as the programs and data of the same names shown in Fig. 1, and therefore description thereof will be omitted.

[0118] Furthermore, each unit of the server 40 has basically the same function as each unit of the same name in the electronic dictionary 10 shown in FIG. 1, and therefore a description thereof will be omitted.

[0119] First, a case will be described in which the electronic dictionary 10 and the server 40 cooperate with each other. That is, the CPU 11 (controller) of the electronic dictionary 10 and the CPU 41 (controller) of the server 40 cooperate with each other based on their respective programs to function as a controller of the learning support system.

[0120] For example, in the above description, speech recognition is performed using the speech recognition function (speech recognition program 12b) of the electronic dictionary 10. However, speech recognition may also be performed using the speech recognition function (speech recognition program 42b) of the server 40. In this case, the learner's speech to be recognized is input through the speech input unit 18 of the electronic dictionary 10, as described above, and the speech data and text data to be read aloud received from the tablet PC 20 are transmitted from the electronic dictionary 10 to the server 40, where speech recognition processing (including determination of pronunciation errors of words) can be performed. Alternatively, speech reading of text may be input through the speech input unit 28 of the tablet PC 20, along with the specification of the text range to be read aloud (FIG. 5, steps B5 and B6). In this case, the speech data of the speech input through the speech input unit 28, together with the text data to be read aloud, can be transmitted to the server 40 via the electronic dictionary 10, where speech recognition processing can be performed.

[0121] Generally, the processing power of the server 40 is higher than that of electronic devices such as the electronic dictionary 10. Therefore, by having the server 40 execute the speech recognition process, which has a large processing load, the load on the electronic dictionary 10 can be significantly reduced, thereby improving the overall processing efficiency.

[0122] Furthermore, in addition to the speech recognition process, for example, the function of providing a learning method list of the electronic dictionary 10 (the process of the learning method processing program 12c) may be executed using the function of the learning method processing program 42c of the server 40. In this case, the processing results executed by the learning method processing program 42c of the server 40 are transmitted to the tablet PC 20 via the electronic dictionary 10, and the learning method list as the processing result is displayed in the same manner as described above.

[0123] Next, a case will be described in which the tablet PC 20 cooperates with only the server 40 instead of the electronic dictionary 10. In this case, the tablet PC 20 cooperates with an external electronic device 50 (for example, a personal computer) and establishes a link with the server 40 through the electronic device 50 and the network N. The electronic device 50 functions in the same manner as the electronic dictionary 10 that cooperates with the server 40 described above, and displays a screen according to the results of processing executed by the server 40.

[0124] The tablet PC 20 inputs the learner's voice to be recognized from the voice input unit 28 along with the specification of the text range to be read aloud (FIG. 5, steps B5 and B6), and transmits the text data of the specified text range and the voice data of the voice to the server 40. This enables the server 40 to perform voice recognition processing on the voice uttered by the learner.

[0125] The other processes performed by the server 40 (CPU 11) are executed in the same manner as in the flowchart shown in FIG. 4, and therefore the description thereof will be omitted.

[0126] Furthermore, in the above description, the learner's voice is input into the tablet PC 20, but if the electronic device 50 is provided with a voice input unit (microphone), the voice of the sentence specified in the tablet PC 20 may be input from the electronic device 50, similar to the above-mentioned electronic dictionary 10. In this case, the electronic device 50 transmits the input voice data to the server 40 together with the sentence data received from the tablet PC 20.

[0127] In the above description, the tablet PC 20 is linked to the server 40 via the external electronic device 50, but the tablet PC 20 may also be linked to the server 40 without the electronic device 50. In this case, the server 40 executes processing in the same manner as the electronic dictionary 10 described above, and displays a screen as the processing result on the display unit (touch panel display unit 27) of the tablet PC 20.

[0128] In this way, in the learning support system of this embodiment, by using the electronic dictionary 10, by having the electronic dictionary 10 cooperate with the server 40, or by using the server 40 instead of the electronic dictionary 10 to execute the support process, it is possible to effectively use the learning function to learn a language. The methods described in the embodiments, i.e., the methods such as the processes shown in the flowcharts, can be stored as a program that can be executed by a computer and distributed on a recording medium such as a memory card (a ROM card, a RAM card, etc.), a magnetic disk (a flexible disk, a hard disk, etc.), an optical disk (a CD-ROM, a DVD, etc.), a semiconductor memory, etc. Then, the computer reads the program recorded on the external recording medium, and the operation is controlled by this program, thereby realizing the same processes as the functions described in the embodiments.

[0129] In addition, the program data for realizing each technique can be transmitted over a network (Internet) in the form of program code, and the program data can be imported from a computer connected to this network to realize functions similar to those of the above-mentioned embodiments.

[0130] The present invention is not limited to the embodiments, and various modifications can be made in the implementation stage without departing from the gist of the invention. Furthermore, the embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining the disclosed multiple constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiments or some constituent elements are combined, if the problem stated in the "Problem to be Solved by the Invention" section can be solved and the effect stated in the "Effects of the Invention" section can be obtained, the configuration in which these constituent elements are deleted or combined can be extracted as an invention.

[0131] The inventions described in the original claims of this application are set forth below.

[0132] [1] outputting a list of learning methods that can be implemented for words that are determined to be incorrectly pronounced among the words included in the speech when the user reads the sentence aloud; An electronic device having a control unit that executes a learning function using a learning method selected from the learning method list.

[0133] [2] The control unit A speech recognition process is performed on the speech to determine whether the pronunciation of words included in the sentence is correct or incorrect; Extract words that are judged to be incorrectly pronounced, The electronic device according to [1], wherein the learning method list is output for the extracted words.

[0134] [3] The control unit receiving text data of a text to be read aloud from another device; By comparing the sentence data with the results of speech recognition of the speech read aloud, the pronunciation of words is determined to be correct; The electronic device according to [1], which transmits words determined to be incorrect to the other device.

[0135] [4] The control unit causing an external electronic device to perform a speech recognition process including determining whether a word in the speech is mispronounced; The electronic device according to [1] outputs the learning method list based on the judgment result by the external electronic device.

[0136] [5] The control unit The electronic device according to [1], executes a learning function using a learning method selected from the learning method list, with the word determined to be incorrectly pronounced as the processing target.

[0137] [6] The control unit The electronic device according to any one of [1] to [5], which executes a learning function for one of a plurality of contents included in a learning method selected from the learning method list.

[0138] [7] The control unit The electronic device according to [6], wherein when the learning function is executed, a part of the content including the word whose pronunciation is determined to be incorrect is displayed on a display device.

[0139] [8] The control unit If the words obtained by speech recognition of the speech read aloud are not included in the pre-registered words targeted for speech recognition, The electronic device described in [1] determines that a pre-registered word whose degree of match with the word obtained by the speech recognition is below a predetermined reference value is an incorrectly pronounced word.

[0140] [9] The speech recognition process includes: The electronic device according to either [2] or [4], further comprising a process of performing speech recognition for each of the speeches pronounced in a plurality of different languages.

[0141]

[10] In an electronic device having a control unit, The control unit Displaying the text to be read aloud on a display device; Transmitting the sentence data of the sentence to another device; receiving word data indicating words in the sentence that have been determined to be incorrectly pronounced by the other device; The electronic device displays the word determined to be incorrectly pronounced based on the word data in a display format different from other words.

[0142]

[11] outputting a list of learning methods that can be implemented for words that are determined to be incorrectly pronounced among the words included in the speech when the user reads the sentence aloud; A learning support system having a control unit that executes a learning function according to a learning method selected from the learning method list.

[0143]

[12] a first electronic device having a first control unit; a second electronic device having a second control unit; Equipped with The first control unit is outputting a list of learning methods that can be implemented for words that are determined to be incorrectly pronounced among the words included in the speech when the user reads the sentence aloud; execute a learning function according to a learning method selected from the learning method list; The second control unit is Displaying the text to be read aloud on a display device; Transmitting text data of the text to the second electronic device; receiving word data indicating words in the sentence that have been determined to be incorrectly pronounced by the second electronic device; displaying the word determined to be incorrectly pronounced based on the word data in a display form different from other words; Learning support system.

[0144]

[13] A learning processing method in an electronic device having a control unit, The control unit outputting a list of learning methods that can be implemented for words that are determined to be incorrectly pronounced among the words included in the speech when the user reads the sentence aloud; a learning processing method for executing a learning function according to a learning method selected from the learning method list;

[0145]

[14] Computer, outputting a list of learning methods that can be implemented for words that are determined to be incorrectly pronounced among the words included in the speech when the user reads the sentence aloud; a program for causing the program to function to execute a learning function according to a learning method selected from the learning method list; [Explanation of symbols]

[0146] 1...learning support system, 10...electronic dictionary, 11, 21...CPU, 12, 22...memory, 12a...dictionary control processing program, 12b...voice recognition program, 12c...learning method processing program, 12d...dictionary data, 12e...extracted word data, 12f...learning method search data, 12g...learning content data, 13, 23...external recording medium, 14, 24...recording medium reading unit, 15, 25...communication unit, 16...key input unit, 26...button input unit, 17, 27...touch panel display unit, 18...voice input unit, 19...voice output unit, 20...tablet PC, 22a...basic program, 22b...textbook processing program, 22c...text data, 22d...extracted word data, 30, 40...server.

Claims

1. performing a speech recognition process on the speech when the user reads the sentence aloud, and then determining whether the pronunciation of words included in the sentence is correct; extracting from the sentence mispronounced words determined to have the pronunciation incorrect from among the words included in the sentence as a result of the accuracy determination; The extracted misread words are changed to original words having the misread words as their original forms; outputting the original word obtained by changing the misread word; outputting a learning method list that lists learning methods that can be implemented for the original word; An electronic device having a control unit that executes a learning function using a learning method selected from the learning method list.

2. The control unit Accepting a selection of any one of the root words; The electronic device according to claim 1 , wherein a learning method list is output, which lists feasible learning methods from among a plurality of learning methods for the selected original word.

3. The control unit receiving text data of a text to be read aloud from another device; By comparing the sentence data with the results of speech recognition of the voice when the sentence is read aloud, the pronunciation of words included in the sentence is determined to be correct or incorrect; The electronic device according to claim 1 , wherein the misread word is transmitted to the other device.

4. The control unit causing an external electronic device to perform a speech recognition process including determining whether a word in the speech is mispronounced; The electronic device according to claim 1 , wherein the learning method list is output based on a result of determination by the external electronic device.

5. The control unit The electronic device according to claim 1 , wherein a learning function according to a learning method selected from the learning method list is executed on the misread words as a processing target.

6. The control unit 5. The electronic device according to claim 1, wherein a learning function is executed for one of a plurality of contents included in a learning method selected from the learning method list.

7. The control unit The electronic device according to claim 6 , wherein when the learning function is executed, a portion including the mispronounced word is displayed on a display device.

8. The control unit 8. The electronic device according to claim 7, wherein, when a word obtained by speech recognition of the speech of the sentence read aloud is a pre-registered word to be the target of speech recognition and the degree of match with the word obtained by the speech recognition is equal to or less than a predetermined reference value, the pre-registered word to be the target of speech recognition is determined to be the misread word.

9. The speech recognition process includes: The electronic device according to claim 2 or 4, further comprising a process for performing speech recognition for each of the speeches pronounced in a plurality of different languages.

10. a first electronic device having a first control unit; a second electronic device having a second control unit; Equipped with The first control unit performing a speech recognition process on the speech when the user reads the sentence aloud, and then determining whether the pronunciation of words included in the sentence is correct; extracting from the sentence mispronounced words determined to have the pronunciation incorrect from among the words included in the sentence as a result of the accuracy determination; The extracted misread words are changed to original words having the misread words as their original forms; outputting the original word obtained by changing the misread word; outputting a learning method list that lists learning methods that can be implemented for the original word; execute a learning function according to a learning method selected from the learning method list; transmitting word data indicating the misread word to the second electronic device; The second control unit is Displaying the text to be read aloud on a display device; Transmitting text data of the text to the first electronic device; receiving the word data indicating the misread word from the first electronic device; The learning support system displays the mispronounced words in a display format different from other words based on the word data.

11. A learning processing method in an electronic device having a control unit, The control unit performing a speech recognition process on the speech when the user reads the sentence aloud, and then determining whether the pronunciation of words included in the sentence is correct; extracting from the sentence mispronounced words determined to have the pronunciation incorrect from among the words included in the sentence as a result of the accuracy determination; The extracted misread words are changed to original words having the misread words as their original forms; outputting the original word obtained by changing the misread word; outputting a learning method list that lists learning methods that can be implemented for the original word; a learning processing method for executing a learning function according to a learning method selected from the learning method list;

12. Computer, performing a speech recognition process on the speech when the user reads the sentence aloud, and then determining whether the pronunciation of words included in the sentence is correct; extracting from the sentence mispronounced words determined to have the pronunciation incorrect from among the words included in the sentence as a result of the accuracy determination; The extracted misread words are changed to original words having the misread words as their original forms; outputting the original word obtained by changing the misread word; outputting a learning method list that lists learning methods that can be implemented for the original word; a program for causing the program to function to execute a learning function according to a learning method selected from the learning method list;

Citation Information

Patent Citations

  • Speech evaluation method and device, electronic equipment and storage medium

    CN109545244A

  • Device for supporting reading of sentence

    JP1992138564A

  • Natural language processor

    JP1995085062A

  • Review method via the internet, review information supplying server and review program

    JP2003058036A

  • Device and method of assisting language learning

    JP2004258231A