Language learning system, language learning method, and program
The language learning system addresses the limitations of traditional methods by generating a personalized wordbook for users, enhancing language skills and pronunciation through interactive image and audio-based learning.
Patent Information
- Application Number
- JP2025033985
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-03-04
- Publication Date
- 2025-09-05
- Estimated Expiration
- 2045-03-04
AI Technical Summary
Traditional language learning methods, relying on word-for-word translation and bilingual translations, are ineffective for acquiring language skills comparable to those of native speakers, particularly in languages with different structures, and pronunciation cannot be easily mastered through traditional means.
A language learning system that generates a personalized wordbook for users by displaying images and audio of example sentences, allowing users to input their voice imitations, convert to text, break down sentences into words, and register learned words, focusing on user-specific vocabulary acquisition.
Enables effective learning of words in a foreign language with a different structure by providing personalized practice and feedback, improving pronunciation skills and vocabulary retention.
Smart Images

Figure 0007734869000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a language learning system, a language learning method, and a program. [Background technology]
[0002] Conventionally, most vocabulary books used in learning languages such as English are configured to include a list of words according to the level of difficulty of learning. It is said that language ability, whether in one's native language or a foreign language, is proportional to the number of words that one has learned, which are the smallest units of language. For this reason, vocabulary books are used. Vocabulary books include a translation and explanation in the native language for each word to make it easier to understand and memorize the foreign language in one's native language (see, for example, Patent Document 1 and Patent Document 2). In addition, some electronic dictionaries are equipped with a vocabulary book function, allowing learners to learn words by repeatedly listening to the pronunciation of the words (see, for example, Patent Document 3). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 7-234874 [Patent Document 2] Japanese Patent Application Laid-Open No. 2002-244548 [Patent Document 3] Japanese Patent Application Laid-Open No. 2000-330998 Summary of the Invention [Problem to be solved by the invention]
[0004] However, the purpose of language learning is to acquire the ability to converse and exchange documents on an equal footing with native speakers. Traditional word-for-word translation and translation comprehension based on bilingual translations and explanations in one's own language have proven extremely difficult to acquire language skills comparable to those of native speakers. Despite the obvious difficulty of acquiring language skills through traditional translation comprehension, many people still attempt to learn a foreign language by expanding their vocabulary using traditional vocabulary books based on bilingual translations and explanations in one's own language. Furthermore, it takes a great deal of time and perseverance to achieve vocabulary expansion using traditional vocabulary books, resulting in many people giving up midway through their studies.
[0005] Different languages have different pronunciations. While meanings can be understood using a dictionary, pronunciation cannot be translated. Pronunciation can only be mastered by the language learner. Many people study abroad with the goal of mastering the pronunciation of a foreign language, but it is not something that everyone can easily do.
[0006] The present invention has been made in view of the above background, and aims to provide a language learning system, a language learning method, and a program that enable effective learning of words in a foreign language such as English, whose linguistic structure is significantly different from that of one's native language. [Means for solving the problem]
[0007] The language learning system according to the present disclosure is a language learning system including a management device for supporting a user's language learning by providing the user with a wordbook unique to the user, the wordbook being generated using only words the user has acquired, The storage unit of the management device At least teaching material data including image data relating to an image, image example sentence data which is text data of example sentences related to the image, and image audio data which is audio data of the example sentences are stored; The control unit of the management device an image display means for displaying an image having a difficulty level corresponding to the learning level of the user from the teaching material data on an input / output unit of an information terminal device used by the user; an image and audio output means for outputting audio of an example sentence related to the image displayed by the image display means; a user voice input means for inputting a voice uttered by the user in imitation of the voice of the example sentence output by the example voice output means; a text data conversion means for converting data relating to the user's voice inputted to the user voice input means into text data; and a wordbook generating means for breaking down the text data acquired by the text data converting means from sentence units to word units, and for generating a wordbook specific to the user by registering the broken down words.
[0008] A language learning method according to the present disclosure is a language learning method performed by a management device for supporting a user's language learning by providing the user with a wordbook unique to the user, the wordbook being generated using only words the user has learned, the method comprising: storing teaching material data including image data relating to an image, image example sentence data which is text data of example sentences related to the image, and image audio data which is audio data of the example sentences; a step of displaying an image having a difficulty level corresponding to the learning level of the user from the teaching material data on an input / output unit of an information terminal device used by the user; outputting a voice of an example sentence related to the image displayed by the image display means; a step of inputting a voice uttered by the user in imitation of the voice of the example sentence output by the teaching voice output means; converting data relating to the user's voice inputted to the user voice input means into text data; and a step of dividing the text data acquired by the text data conversion means from sentence units to word units, and registering the divided words to generate a word list specific to the user.
[0009] The program according to the present disclosure is installed on a computer of a management device, storing teaching material data including image data relating to an image, image example sentence data which is text data of example sentences related to the image, and image audio data which is audio data of the example sentences; a step of displaying an image having a difficulty level corresponding to the learning level of the user from the teaching material data on an input / output unit of an information terminal device used by the user; outputting a voice of an example sentence related to the image displayed by the image display means; a step of inputting a voice uttered by the user in imitation of the voice of the example sentence output by the teaching voice output means; converting data relating to the user's voice inputted to the user voice input means into text data; The text data obtained by the text data conversion means is broken down from sentence units to word units, and the broken down words are registered to generate a word list specific to the user. [Effects of the Invention]
[0010] According to the present invention, it is possible to provide a language learning system, a language learning method, and a program that enable effective learning of words in a foreign language such as English, whose language structure is significantly different from that of one's native language. [Brief explanation of the drawings]
[0011] [Figure 1] 1 is a diagram illustrating an example of the configuration of a language learning system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a management apparatus according to the present embodiment. [Figure 3] FIG. 4 is a diagram illustrating an example of data stored in a storage unit of the management device according to the present embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information terminal device according to the present embodiment. [Figure 5] 3 is a diagram showing an example of data stored in a storage unit of the information terminal device according to the embodiment; FIG. [Figure 6]10 is a flowchart illustrating an example of processing of the language learning system according to the present embodiment. [Figure 7] FIG. 2 is a diagram showing an example of a screen of the information terminal device according to the embodiment. [Figure 8] FIG. 2 is a diagram showing an example of a screen of the information terminal device according to the embodiment. [Figure 9] 10 is a flowchart illustrating an example of processing of the language learning system according to the present embodiment. [Figure 10] FIG. 2 is a diagram showing an example of a screen of the information terminal device according to the embodiment. [Figure 11] FIG. 2 is a diagram showing an example of a screen of the information terminal device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the embodiments described below do not unduly limit the content of the present disclosure described in the claims. Furthermore, not all of the components shown in the embodiments are necessarily essential components of the present disclosure.
[0013] (Language learning system configuration) 1 is a diagram showing an example of the configuration of a language learning system according to this embodiment. In the language learning system 1, for example, a plurality of information terminal devices 200 are communicably connected to a management device 100, which is a server, via a network N.
[0014] Network N consists of the Internet, an intranet, a blockchain network, a wireless LAN (Local Area Network), a WAN (Wide Area Network), BLE (Bluetooth Low Energy), etc. The network N may be considered to be outside the language learning system 1. In other words, the network N may not be included in the language learning system 1.
[0015] The management device 100 is, for example, a server that provides network services to the information terminal device 200 via the network N. Details of the hardware configuration and software configuration will be described later.
[0016] The information terminal device 200 is an information processing device such as a personal computer, a tablet terminal, a smartphone, a mobile phone, a PHS, or a PDA, which is owned by a user or the user's instructor. The information terminal device 200 operated by the user and the information terminal device 200 operated by the user's instructor may be different information terminal devices 200, but may also be a common information terminal device 200 that is handed over to the user or the user's instructor at the necessary timing.
[0017] In addition, the language learning system 1 may be connected via a network N to an external device (not shown), such as a server equipped with a function to provide learning materials, or an electronic dictionary equipped with a word search function and a communication function.
[0018] Fig. 2 is a diagram showing an example of the hardware configuration of a management device according to this embodiment. Fig. 3 is a diagram showing an example of data stored in a storage unit of the management device according to this embodiment. The management device 100 may be a general-purpose computer such as a personal computer, or may be logically realized by cloud computing. Note that the configuration shown in the figure is an example, and other configurations may also be used.
[0019] The management device 100 includes a communication unit 110, an input / output unit 120, a control unit 130, and a storage unit 140. These functional units are realized by executing a predetermined program for the management device 100.
[0020] The communication unit 110 is a communication interface for communicating with each information terminal device 200, and communication is performed according to a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).
[0021] The input / output unit 120 is configured with information input devices such as a keyboard, mouse, etc., and information output devices such as a display, etc. However, this does not apply when it is configured as a cloud server.
[0022] The control unit 130 controls the overall operation of the management device 100 and is configured with a CPU (Central Processing Unit) etc. The control unit 130 reads a control program stored in the storage unit 140 and controls the operation of the management device 100 in accordance with the control program.
[0023] The control unit 130 also has means for controlling various types of information, such as information transmission / reception means, information management means, and association processing means. The control unit 130 has an information transmission / reception means. The control unit 130 receives various types of information and requests from each information terminal device 200 and transmits the various types of information and requests to each information terminal device 200. The various types of information particularly include, but are not limited to, input information from each information terminal device 200 and information transmitted to each information terminal device 200. For example, the control unit 130 receives user identification information for identifying the user of each information terminal device 200 (e.g., a user account issued upon user registration), time information associated with each piece of information (e.g., time information (including date information as appropriate) when the various pieces of information were generated or stored), and linkage information sent from an external device that links as needed based on the operation of each information terminal device 200 (e.g., information about learning materials from an external server). The control unit 130 has an information management unit. The control unit 130 stores received information in the storage unit 140, and reads information from the storage unit 140 in response to a received request. The control unit 130 has an association processing means, and the control unit 140 associates (correlates) various types of information with each other.
[0024] The storage unit 140 stores programs for executing various control processes and functions in the control unit 130, input data, etc., and is configured of RAM (Random Access Memory), ROM (Read Only Memory), and the like. The storage unit 140 stores various types of information. Furthermore, the storage unit 140 temporarily stores information communicated with the information terminal device 200.
[0025] The programs stored in the storage unit 140 include various application programs. The application programs include a flashcard generation management program 141 that provides a flashcard generation process to the information terminal device 200 and causes the user to execute the flashcard generation process. The control unit 130 executes the flashcard generation process, which will be described later, using the flashcard generation management program 141. The application programs also include a flashcard learning management program 142 that provides a flashcard learning process to the information terminal device 200 and causes the user to execute flashcard learning. The control unit 130 executes the flashcard learning process, which will be described later, using the flashcard learning management program 142.
[0026] The data stored in the memory unit 140 includes teaching material data 143, vocabulary book generation word data 144, learning data 145, statistical analysis data 146, user management data 147, and vocabulary book data 148, which are related to the execution of the vocabulary book generation process and the vocabulary book learning process.
[0027] The learning material data 143 stores data related to learning materials to be provided to each information terminal device 200 in order for each information terminal device 200 to perform a flashcard generation process. The learning material data 143 includes image data 143a related to images, image example sentence data 143b which is text data of example sentences related to the images, and image audio data 144c which is audio data of the example sentences. The images in the image data 143a are, for example, illustrations, figures, characters, still images, moving images, animations, photographs, etc. The example sentences in the image example sentence data 143b are not in units of words but in units of minutes (sentences), and include sentences and idioms (idiomatic phrases, phrases, idiomatic expressions, etc.). The audio data in the image audio data 144c may be recorded human speech or artificial speech, as long as it is a speech that has pronunciation accuracy comparable to that of a native speaker or a native speaker.
[0028] The learning material data 143 can be obtained, for example, from a group of images retrieved from a website via the Internet or from a server (external device, not shown) equipped with a function for providing learning materials. Alternatively, the learning material data 143 may be obtained by, for example, performing OCR (Optical Character Recognition) processing or image capture processing using a commercially available application on commercially available books, magazines, newspapers, posters, etc. If an image is acquired but no example sentences or audio related to the image are acquired, for example, an external device such as an electronic dictionary with a dictionary search function and communication function may be used to search for words related to the image, and then example sentences or audio containing the searched words may be obtained from dictionary data of the electronic dictionary, and the example sentences or audio may be added as learning material data in association with the image data. Alternatively, the user's instructor may directly input example sentences or audio related to the image via the input / output unit 120 (220) or audio input unit 250 of the management device 100 or the information terminal device 200.
[0029] Furthermore, it is preferable that the data included in the teaching material data 143 be assigned a learning difficulty level for each image data 143a (for each code identifying each image, for example, an image identification code). The learning difficulty level is quantified according to the level, for example, from beginner to advanced. The assignment of the learning difficulty level may be determined, for example, from the difficulty level of the words constituting the example sentences in the image example sentence data 143b. Alternatively, the user's instructor may determine the learning difficulty level based on the example sentences or audio via the input / output unit 120 (220) of the management device 100 or the information terminal device 200, and assign the learning difficulty level to each image data 143a.
[0030] The flashcard generation word data 144 is data related to words acquired from a website or an external device (not shown) via the Internet in order to generate a flashcard specific to the user. Examples of external devices include an electronic dictionary with a communication function and a word search function, and a server that provides content related to language learning. The flashcard generation word data 144 includes word data related to a word, example sentence data containing the word, and audio data of the example sentence. The audio data of the example sentence may be a recorded voice of a person or an artificial voice, as long as it is a voice of a native speaker or a voice with pronunciation accuracy equivalent to that of a native speaker. If audio data is not available, the user's instructor or the like may directly input the audio of the example sentence through the audio input unit 250 of the information terminal device 200.
[0031] The learning data 145 is data related to the user's learning results in the flashcard creation process or the flashcard learning process. The learning data 145 is acquired from the information terminal device 200 after the flashcard creation process or the flashcard learning process is performed in the information terminal device 200. The learning data 145 includes at least data associating each learning material (learning material data 141) in the wordbook generation process performed in the information terminal device 200 with a score for each learning material input by a user operation, and data associating each word (word data) in the wordbook learning performed in the information processing device with a score for each word input by a user operation. The learning data 145 acquired from the information processing device is subjected to a statistical analysis process to generate statistical analysis data 146.
[0032] The statistical analysis data 146 is data indicating the results of statistical analysis processing of the learning data 145. The statistical analysis data 146 includes, for example, data on the total learning time of the user and data on the total number of words learned by the user.
[0033] The user management data 147 is data for managing users who use the wordbook generation process and wordbook learning process provided by the management device 100. For example, the user management data 147 is associated with user identification data (e.g., a user ID) previously set for each user, and records attribute data related to the user's attributes registered in advance when using the language learning system 1, and user characteristic data indicating the user's characteristics determined based on the user's input when the wordbook generation and wordbook learning are performed. The user management data 147 also includes data related to the user's learning level, which indicates the user's level of language proficiency based on, for example, the score at the time of performing the wordbook generation process and the time required to obtain a predetermined score at the time of performing the wordbook generation process. The learning level is quantified according to the level, for example, from beginner to advanced. The attribute data and characteristic data for each user included in the user management data 147 can be referenced to extract learning material data 143 appropriate for the user's learning level.
[0034] The flashcard data 148 is data in which word data, example sentence data, and audio data of words learned by the user in the flashcard generation performed on the information terminal device 200 are extracted from the flashcard generation word data 144. At the beginning of learning using the language learning system 1 of this embodiment, the number of words stored in the flashcard data 148 is 0, but as learning progresses, the number of words stored will accumulate and increase.
[0035] <Information terminal device> Next, the information terminal device 200 will be described. 4 is a diagram showing the hardware configuration of information terminal device 200. The main hardware configuration of information terminal device 200 includes, for example, a communication unit 210, an input / output unit 220, a control unit 230, a storage unit 240, an audio output unit 250, and an audio input unit 260. Note that a description of the same parts as those in management device 100 will be omitted. These functional units are realized by executing predetermined programs and applications for information terminal device 200. Note that the configuration shown in the figure is an example, and other configurations may also be used.
[0036] The information terminal device 200 may be, for example, an information processing device such as a personal computer, tablet terminal, smartphone, mobile phone, PHS, PDA, etc., and the input / output unit 220 is, for example, configured by an information input device (for example, a keyboard or mouse) and an information output device (for example, a display) if the information terminal device 200 is configured by a personal computer, and is, for example, configured by an information input / output device such as a touch panel if the information terminal device 200 is configured by a smartphone or tablet terminal.
[0037] The control unit 230 controls the overall operation of the terminal device 200, and is composed of a CPU (Central Processing Unit) and the like. The control unit 230 includes an information transmitting / receiving means for receiving various information and requests from the management device 100 and transmitting the generated various information and requests to the management device 100. The control unit 230 also includes a request generating means for generating various requests to be transmitted from the information terminal device 200.
[0038] The programs stored in the storage unit 240 include various application programs. The application programs include a flashcard generation program 241 that the information terminal device 200 uses to cause the user to generate a flashcard. The flashcard generation program 241 causes the control unit 230 to execute a flashcard generation process, which will be described later. The application programs also include a flashcard learning program 242 that the information terminal device 200 uses to cause the user to perform flashcard learning. The control unit 230 uses the flashcard learning program 242 to execute a flashcard learning process, which will be described later.
[0039] The data stored in the storage unit 240 includes teaching material data 243, learning data 244, statistical analysis data 245, user identification data 246, and flashcard data 247, which are related to the execution of the flashcard generation process and the flashcard learning process. The user identification data 246 is data for allowing the management device 100 to identify the user who uses the information terminal device 200, and includes, for example, a user ID and a password that are preset for each user.
[0040] The audio output unit 250 is configured from an audio output device such as a speaker, etc. The audio input unit 260 is configured from an audio input device such as a microphone, etc.
[0041] (Processing flow using a language learning system) The flow of the wordbook creation process and wordbook learning process using the language learning system 1 of this embodiment will be described below. First, the flow of the wordbook creation process will be described, and then the flow of the wordbook learning process will be described.
[0042] <Wordbook generation process> Figure 5 is a flowchart showing an example of processing by the language learning system 1 according to this embodiment. The flow of the wordbook generation processing executed by the language learning system 1 will be described with reference to the example in Figure 5. Note that the steps (including partial steps not assigned with reference numerals) can be executed in any order or in parallel as long as no contradiction occurs in the processing content.
[0043] When a user of the information terminal device 200 generates a flashcard provided by the management device 100, the user starts the flashcard generation program 241 to start the flashcard generation process.
[0044] The control unit 230 of the information terminal device 200 starts the flashcard generation process and requests access to the management device 100 via the communication unit 210 (FIG. 6, step S101). Specifically, the control unit 230 of the information terminal device 200 causes the user to input user identification data 246 (e.g., a user ID, etc.) through a user operation, and transmits the data to the management device 100. The control unit 230 of the information terminal device 200 also transmits information indicating that the flashcard generation process has been started in the information terminal device 200 to the management device 100 via the communication unit 210, together with the user identification data 246.
[0045] Upon receiving the access request, the control unit 130 of the management device 100 identifies the user based on the user identification data 246 sent from the information terminal device 200 via the communication unit 110, and launches the wordbook generation management program 141 based on information indicating that the wordbook generation process has started in the information terminal device 200 (Figure 6, step S102).
[0046] The control unit 130 of the management device 100 extracts the learning material data 143 to be provided to the information terminal device 200 used by the user, according to the user identified based on the user identification data 246 (FIG. 6, step S103). The extraction of the learning material data 143 may be performed, for example, by referring to the learning level in the user management data 147 based on the user identification data 246 received from the information terminal device 200, and searching for and extracting image data 143a to which a learning difficulty level corresponding to this learning level is assigned. Alternatively, the extraction may be performed by the user himself or the user's instructor searching for and extracting image data 143a corresponding to the user's learning level.
[0047] The control unit 130 of the management device 100 transmits the teaching material data 143, which will be used as teaching material for generating the wordbook, to the information processing device (FIG. 6, step S104). It is assumed that the control unit 130 of the management device 100 transmits the teaching material data 143 for a plurality of questions, for example, 5 to 20 questions, to the information processing device 100 all at once.
[0048] On the other hand, when the control unit 230 of the information terminal device 200 receives the teaching material data 143 from the management device 100, it stores it in the storage unit 240 of the information terminal device 200 (teaching material data 243), and starts generating a flashcard using the teaching material data 243.
[0049] The control unit 230 of the information terminal device 200 causes the input / output unit 220 to display an image as a question based on the image data 243a in the learning material data 243 for the first question (FIG. 6, step S105).
[0050] FIG. 7 is a diagram illustrating an example of a screen of an information terminal device according to this embodiment. The screen 300 shown in FIG. 7 includes an image display area 301 displaying the image to be used in the vocabulary book generation process; an example image text display area 302 displaying the text of the example image sentence, which can be displayed by the user or the user's instructor; a score display area 303 displaying the user's pronunciation score; a speech request display area 304 displaying images or the like to prompt the user to speak if the user does not input speech within a predetermined time; a new word display area 305 displaying a list of new words learned by the user; and a speech text display area 306 displaying the text of the user's speech, which can be displayed by the user or the user's instructor. Note that the language displayed on the screen 300 is only the foreign language being studied to prevent interference with the user's native language; the user's native language is not displayed at all. However, the user's instructor may allow the display of the native language.
[0051] When an image is displayed in the image display area 301, the user guesses an example sentence in a foreign language that is associated with the image. After a predetermined time has elapsed since the image was displayed, the control unit 230 of the information terminal device 200 outputs the example sentence to the user via the audio output unit 250 based on the image and audio data 243c (FIG. 6, step S106). In the example of FIG. 7, the audio output to the user is "Henry is a child hippo. He lives with his mom. They live happily." When the audio output ends, the control unit 230 of the information terminal device 200 starts measuring the time until the user inputs a voice.
[0052] When the audio of the example sentence is output, the text of the example sentence may be displayed in the image example sentence text display area 302. Whether or not to display the text of the example sentence can be selected by the user or the user's instructor. For example, the user can select whether or not to display the text of the example sentence by pressing an image example sentence text display button (not shown) displayed on the screen 300.
[0053] The control unit 230 of the information terminal device 200 waits for the user to input a voice (sometimes called an utterance) that imitates the voice of the example sentence. If the user's utterance is not detected within a predetermined time, the control unit 230 of the information terminal device 200 displays an image in the utterance request display area 304 to prompt the user to speak, and outputs a voice to prompt the user to speak. In the example shown in FIG. 10, an image of a child with his hands over his ears is displayed in the utterance request display area 304, and the voice "I can't hear you. Repeat again." is output. This prompts the user to speak, allowing for efficient learning.
[0054] When the user speaks in imitation of the voice of the example sentence, the control unit 230 of the information terminal device 200 inputs the user's voice through the voice input unit 260 (FIG. 6, step S107).
[0055] Next, the control unit 230 of the information terminal device 200 converts the data containing the user's voice input into text data (FIG. 6, step S108). When converting into text data, the text of the input voice may be displayed in the voice text display area 306. In the example of FIG. 7, the voice text display area 306 displays "Henry is a child hippo.", which is the user's voice as text data. Whether or not to display the voice as text can be selected by the user or the user's instructor. For example, the user selects whether or not to display the example sentence as text by pressing a voice text display button (not shown) displayed on the screen 300.
[0056] Furthermore, the control unit 230 of the information terminal device 200 breaks down the converted text data from sentence units (sentence units) into word units.
[0057] The control unit 230 of the information terminal device 200 acquires the text data and, based on the data containing the user's voice input, diagnoses the accuracy of the pronunciation, i.e., whether the user's pronunciation is close to that of a native speaker, and assigns a score according to the accuracy of the pronunciation (FIG. 6, step S109). The accuracy of the pronunciation is assessed comprehensively from the perspectives of, for example, whether the pronunciation is correct, whether the pronunciation is easy to hear and understand, and whether the user can respond without stuttering. The score is expressed as a number, for example, from 1 to 100, and is displayed in the score display area 303 when the user's voice input is accepted. In the example of FIG. 7, "Score 85 points" is displayed. This allows the user to check their own pronunciation score every time they speak to the learning material.
[0058] After the score is displayed, the control unit 230 of the information terminal device 200 determines whether the score is equal to or greater than a predetermined threshold (FIG. 6, step S110). The threshold can be set by the user or the user's instructor. However, the threshold is preferably a score value that indicates pronunciation close to that of a native speaker, such as 60.
[0059] If it is determined that the score is equal to or greater than the predetermined threshold (FIG. 6, step S110, Yes), the control unit 230 of the information terminal device 200 stores the learning data 244 for the learning material data 243 in the storage unit 240, and also displays the next learning material (image data 243a) via the input / output unit 220. The learning data 244 stores data related to words that were converted into text data and decomposed in step S108. In the case of a word that is stored for the first time in the learning data 244, i.e., a word that the user has learned for the first time (hereinafter also referred to as a new word), the control unit 230 of the information terminal device 200 displays the next learning material and also displays a list of new words on the screen (new word display area 305 shown in FIG. 7). This allows the user to check only new words at any time during learning, and by repeatedly viewing the words, the efficiency of language learning can be further improved.
[0060] The control unit 230 of the information terminal device 200 repeatedly executes the same process (FIG. 6, steps S105 to S110) unless a user operation indicating the end of learning (for example, pressing a learning end button (not shown) displayed by the input / output unit 220) is detected.
[0061] On the other hand, if it is determined that the score is less than the predetermined threshold (FIG. 6, step S110, No), the audio of the example sentence is output again to the user based on the image and audio data 243c, and the same process is repeated until it is determined that the score is equal to or greater than the predetermined threshold (FIG. 6, steps S106 to S110).
[0062] When a user operation indicating the end of learning is detected, or when processing of all teaching materials in the teaching material data 243 transmitted from the management device 100 is completed, the control unit 230 of the information terminal device 200 transmits learning data 244 for the teaching material data 243 to the management device 100 (FIG. 6, step S111).
[0063] On the other hand, when the control unit 130 of the management device 100 receives the learning data 244 from the information terminal device 200, the control unit 130 performs statistical analysis processing on the received learning data 145 to obtain statistical analysis data 146 (FIG. 6, step S112). The statistical analysis data 146 is stored in the storage unit in association with user management data 147.
[0064] Next, the control unit 130 of the management device 100 transmits the statistical analysis data 146 to the information terminal device 200 via the communication unit 110 (FIG. 6, step S113). The control unit 230 of the information terminal device 200 displays the received statistical analysis data 245 on the input / output unit 220 (FIG. 6, step S114).
[0065] Fig. 8 is a diagram showing an example of a screen of the information terminal device according to this embodiment. A screen 400 shown in Fig. 8 shows the results of statistical analysis in the wordbook generation process using a radar chart.
[0066] The radar chart in Figure 8 includes the following evaluation items: New Words Today (number of new words learned today), Total Words Learned (total number of words learned and learned), Used Words Today (number of words used today), Total Used Words (total number of words used), Study Time Today, min (study time in minutes today), Total Study Time (total study time), and Pronunciation Score (pronunciation score). The dashed line at the evaluation point 6 in the radar chart indicates the pass mark, while the solid line indicates the statistical analysis results based on the user's learning status. The pass mark can be set arbitrarily. This allows users to grasp their learning status at a glance and motivates them to study. Note that the language displayed on screen 400 is the foreign language being studied, and the user's native language is not displayed at all to prevent interference from the user's native language. However, the user's instructor may allow the native language to be displayed.
[0067] Furthermore, upon receiving learning data 244 from information terminal device 200, control unit 130 of management device 100 searches for and extracts words from flashcard generation word data 144 that match words in the data related to the decomposed words stored in learning data 145. The word data extracted from flashcard generation word data 144, example sentence data containing the words, and audio data of the example sentences are recorded as flashcard data 148 in association with user management data 147. This generates a user-specific flashcard made up of only words learned by the user (FIG. 6, step S115).
[0068] Next, a description will be given of a wordbook learning process using the language learning system 1 of this embodiment. The wordbook learning process will be described with reference to the flowchart shown in FIG.
[0069] <Wordbook learning process> The wordbook learning process allows the user to carry out language learning based on a user-specific wordbook (FIG. 6, step S115) that is generated by carrying out the above-mentioned wordbook generation process using only words that the user has learned. Note that when a process similar to the wordbook generation process shown in FIG. 6 is executed, the explanation may be omitted.
[0070] When a user of the information terminal device 200 performs flashcard learning provided by the management device 100, the user starts the flashcard learning program 242 to start the flashcard learning process.
[0071] The control unit 230 of the information terminal device 200 starts the flashcard learning process and requests access to the management device 100 via the communication unit 210 (FIG. 9, step S201). Specifically, the control unit 230 of the information terminal device 200 causes the user to input user identification data 246 through a user operation and transmits the data to the management device 100. The control unit 230 of the information terminal device 200 also transmits information indicating that the flashcard learning process has started in the information terminal device 200 to the management device 100 via the communication unit 210, together with the user identification data 246.
[0072] Upon receiving the access request, the control unit 130 of the management device 100 identifies the user based on the user identification data 246 sent from the information terminal device 200 via the communication unit 110 (Figure 9, step S202), and launches the vocabulary book learning process management program 142 based on information indicating that the vocabulary book learning process has started in the information terminal device 200.
[0073] The control unit 130 of the management device 100 transmits user-specific wordbook data 148 associated with user management data 147 based on the user identification data 246 .
[0074] When the control unit 230 of the information terminal device 200 receives the flashcard data 148 from the management device 100, it stores it in the storage unit 240 (flashcard data 247) and starts flashcard learning using the flashcard data 247.
[0075] First, the control unit 230 of the information terminal device 200 displays the flashcard based on the flashcard data 247 (FIG. 9, step S203).
[0076] FIG. 10 is a diagram showing an example of a screen of the information terminal device according to this embodiment. In the screen 500 shown in FIG. 10, words are listed in a format based on the characteristics of the language. Examples of formats based on the characteristics of the language include alphabetical order for English and alphabetical order for Japanese. This allows the user to efficiently search for words they want to learn. Note that the language displayed on the screen 500 is only the foreign language being studied to prevent interference with the user's native language; the user's native language is not displayed at all. However, the user's instructor may allow the display of the native language.
[0077] New words in the displayed vocabulary book are displayed in a new word highlighting manner so that they can be seen from learned words that the user has already studied. Examples of new word highlighting include decorations such as bolding, highlighting, and shading. In the example of new word highlighting 501 on screen 500 shown in FIG. 10, new words are shaded so that they can be seen from learned words 502. This allows the user to efficiently learn new words that have not yet been learned.
[0078] When the control unit 230 of the information terminal device 200 detects the selection of a word by a user operation, it causes the input / output unit 210 to display example sentence text based on the example sentence data in the wordbook data 247. In the example of Fig. 10, when the user selects the new word "find," the example sentence text "she finds a red thing." is displayed.
[0079] Furthermore, when the control unit 230 of the information terminal device 200 detects the selection of an example sentence text by a user operation, it outputs the example sentence to the user through the audio output unit 250 based on the audio data in the wordbook data 247 (FIG. 9, step S204).
[0080] The user can repeatedly output the example sentence audio and listen to correct native-level pronunciation by performing a user operation, such as pressing an audio repeat button (not shown) displayed on the input / output unit 220. In addition, the user can adjust the speed of the example sentence audio to a speed appropriate for the user's level by performing a user operation, such as operating an audio speed adjustment button (not shown) displayed on the input / output unit 220.
[0081] After the example sentence is audibly output, when the user speaks in imitation of the example sentence, the control unit 230 of the information terminal device 200 inputs the user's spoken voice via the voice input unit 260 (FIG. 9, step S205).
[0082] The control unit 230 of the information terminal device 200 diagnoses the accuracy of the pronunciation, that is, whether the user's pronunciation is close to that of a native speaker, based on the data containing the user's voice input, and assigns a score according to the degree of accuracy of the pronunciation (FIG. 9, step S206). The score is expressed as a number ranging from 1 to 100, for example, and is displayed on the input / output unit 210. This allows the user to check the score of their own pronunciation every time they speak a sample sentence displayed as text.
[0083] Next, the control unit 230 of the information terminal device 200 determines whether the score is equal to or greater than a predetermined threshold value (FIG. 9, step S207).
[0084] If the control unit 230 of the information terminal device 200 determines that the score is equal to or greater than a predetermined threshold (FIG. 9, step S207, Yes), it stores the learning data 244 for the vocabulary book data 247 in the storage unit 240. In the case of a new word, the control unit 230 of the information terminal device 200 erases the new word highlighting 501. This allows the user to efficiently learn subsequent unlearned new words. However, if the user or the user's instructor chooses not to erase the new word highlighting 501, the new word highlighting 501 can be left as is by an input operation of the user or the user's instructor. This allows the user to continue the new word highlighting 501 for new words that the user is unsure whether they have mastered, for example, thereby improving learning efficiency.
[0085] The control unit 230 of the information terminal device 200 repeatedly executes the same process (steps S203 to S207 in FIG. 9) unless a user operation indicating the end of learning is detected.
[0086] On the other hand, if it is determined that the score is less than the predetermined threshold (FIG. 9, step S207, No), a voice is again output to the user based on the voice data, and the same process is repeated until it is determined that the score is equal to or greater than the predetermined threshold (FIG. 9, steps S204 to S207).
[0087] When a user operation indicating the end of learning is detected, the control unit 230 of the information terminal device 200 transmits the learning data 244 for the wordbook data 247 received from the management device 100 to the management device 100 (FIG. 9, step S208).
[0088] On the other hand, when the control unit 130 of the management device 100 receives the learning data 247 from the information terminal device 200, the control unit 130 performs statistical analysis processing on the received learning data 145 to obtain statistical analysis data 146 (FIG. 9, step S209). The statistical analysis data 146 is stored in association with the user management data 147.
[0089] Next, the control unit 130 of the management device 100 transmits the statistical analysis data 146 to the information terminal device 200 via the communication unit 110 (FIG. 9, step S210). The control unit 230 of the information terminal device 200 displays the received statistical analysis data 245 on the input / output unit 220 (FIG. 9, step S211).
[0090] FIG. 11 is a diagram showing an example of a screen of the information terminal device according to this embodiment. The screen 600 shown in FIG. 11 uses a graph to show the results of statistical analysis in vocabulary book learning.
[0091] The graph in Figure 11 shows Today's New Words (number of new words learned today), Total Learned Words (total number of words learned and learned), Today's Used Words (number of words used today), Total Used Words (total number of words used), Today's Study Time (min) (today's study time (min)), Total Study Time (min) (total study time), and Pronunciation Score. The dashed line in each graph indicates the pass mark, and the solid line indicates the statistical analysis results based on the user's learning status. The pass mark can be set arbitrarily. This allows users to grasp their learning status at a glance and motivates them to study. To prevent interference from the user's native language, only the foreign language being studied is displayed on screen 600; the user's native language is not displayed at all. However, the user's instructor may allow the display of the user's native language.
[0092] When the control unit 130 of the management device 100 receives the learning data 244 from the information terminal device 200, the control unit 130 stores the learning data 145 in association with the user management data 147, and updates the vocabulary book data 148 based on the learning data 145 and stores it in the memory unit 140 (FIG. 9, step S212).
[0093] In the above description, English words are used as the target for learning, but other languages (such as Chinese) can also be used as the target.
[0094] (Variation) The above describes an example of the processing executed by the language learning system 1. However, the embodiment is not limited to this. Hereinafter, other examples of the processing executed by the language learning system 1 will be described.
[0095] <Variation 1> In step S102 of the flashcard generation process, the user is identified based on the user identification data 246, but the flashcard generation may be performed in accordance with a predetermined process in the management device 100 without identifying the user. Also, in addition to providing the learning material data 143 according to the user's learning level, it may also be possible to simply provide the user with learning material data 143 that the user has not used before.
[0096] <Variation 2> In steps S109 and S110 of the wordbook generation process and steps S206 and S207 of the wordbook learning process, the information terminal device 200 generates a score based on speech input data input by speech from the user and determines whether the score is equal to or greater than a predetermined threshold, but these processes may also be performed in the management device 100. In this case, the information terminal device 200 transmits the acquired speech input data to the management device 100. The management device 100 performs scoring on the speech input data transmitted from the information terminal device 200 and makes a determination, and then transmits data relating to the score and the determination result to the information terminal device 200 and displays it on the input / output unit 220. In this way, the main processes are performed in the management device 100, and the processing load on the information terminal device 200 can be reduced.
[0097] <Variation 3> If the user has a teacher, the teacher can view the user's learning status by operating the information terminal device 200 to display charts and graphs showing the user's learning status, such as those shown in FIGS. 8 and 11, on the input / output unit 220 of the information terminal device 200 operated by the teacher. Specifically, when the teacher accesses the information terminal device 200, the control unit 130 of the management device 100 transmits learning data 145 associated with the user management data 147 of the user to the information terminal device 200 operated by the teacher. This allows the teacher to grasp the user's learning progress based on the learning data 145 at any time. This allows the teacher to provide more effective instruction based on specific numerical data. As shown in FIGS. 8 and 11, the language learning system 1 of this embodiment can provide the teacher with numerical data that allows the teacher to specifically discuss the relationship between the number of words the user has learned and language ability.
[0098] If the user has an instructor, when the information terminal device 200 operated by the user transmits the learning data 244 to the management device 100 (steps S111 and S208), the control unit 130 of the management device 100 may notify the information terminal device 200 operated by the user's instructor that the learning data 244 has been transmitted from the information terminal device 200 operated by the user. This allows the user's instructor to quickly grasp the user's learning progress.
[0099] <Variation 4> While the statistical analysis results shown in FIGS. 8 and 11 show user target values in charts or graphs, the statistical analysis results for multiple users may be displayed instead of or in addition to the user target values. The statistical analysis results for multiple users can be obtained, for example, by aggregating and statistically analyzing the learning data 145 associated with the user management data 147 stored in the management device for multiple users. Examples of statistical analysis results for multiple users include the average number of new words learned today for multiple users, the average total number of new words and learned words for multiple users, the average number of used words used today for multiple users, the average total number of used words for multiple users, the average study time (minutes) for multiple users today, the average total study time for multiple users, and the average pronunciation score for multiple users. This allows users to objectively understand their own learning status in comparison with other users, thereby increasing their motivation to learn.
[0100] <Variation 5> In the display of the statistical analysis results in Figures 8 and 11, statistical analysis results regarding the number of words acquired per unit time and the time required to acquire each word may also be displayed. The number of words acquired per unit time is calculated by dividing the total number of words acquired by the user by the total time required to acquire each word. Similarly, the time required to acquire each word is calculated by dividing the total time required to acquire each word by the total number of words acquired by the user. This allows the user to understand their own learning efficiency in concrete numerical data. If the user has a teacher, the teacher can use this specific numerical data, which is unique to the user, as a guide for how to teach the user.
[0101] It should be noted that, among the processes described in the embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using a known method. The information including the processing procedures, specific names, various data and parameters shown in the above description and drawings can be changed as desired unless otherwise specified.
[0102] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.
[0103] Furthermore, the embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content.
[0104] Furthermore, the methods described in the embodiments, i.e., the methods such as the processes shown in the flowcharts, can be stored as a program that can be executed by a computer and distributed on a recording medium such as a memory card (a ROM card, a RAM card, etc.), a magnetic disk (a flexible disk, a hard disk, etc.), an optical disk (a CD-ROM, a DVD, etc.), a semiconductor memory, etc. Then, the computer reads the program recorded on the external recording medium, and the operation is controlled by this program, thereby realizing the same processes as the functions described in the embodiments.
[0105] In addition, the program data for realizing each technique can be transmitted over a network (Internet) in the form of program code, and the program data can be imported from a computer connected to this network to realize functions similar to those of the above-mentioned embodiments.
[0106] (effect) The language learning system, language learning method, and program described in the embodiments can be understood, for example, as follows.
[0107] A language learning system 1 according to a first aspect is a language learning system 1 including a management device 100 for supporting a user's language learning by providing the user with a wordbook unique to the user, the wordbook being generated using only words the user has learned, The storage unit 140 of the management device 100 At least teaching material data 143 including image data 143a relating to an image, image example sentence data 143b which is text data of example sentences relating to the image, and image audio data 143c which is audio data of the example sentences is stored; The control unit 130 of the management device 100 an image display means for displaying an image having a difficulty level corresponding to the learning level of the user from the learning material data 143 on the input / output unit 220 of the information terminal device 200 used by the user; an image and audio output means for outputting audio of an example sentence related to the image displayed by the image display means; a user voice input means for inputting a voice uttered by the user in imitation of the voice of the example sentence output by the example voice output means; a text data conversion means for converting data relating to the user's voice inputted to the user voice input means into text data; and a wordbook generating means for breaking down the text data acquired by the text data converting means from sentence units to word units, and for generating a wordbook specific to the user by registering the broken down words.
[0108] According to this aspect, a user can obtain a user-specific vocabulary book created using only the words the user has learned through language study. The user can grasp "what words" and "how many" they have learned, and can also comprehensively learn the pronunciation, meaning, spelling, etc. of the language they are studying. This allows the user to improve their language ability to the point where they can respond at a level equal to that of a native speaker.
[0109] In the language learning system 1 according to the second aspect, the control unit 130 of the management device 100 a user voice text selection and display means for enabling the user or the user's instructor to select whether or not to display the text data converted by the text data conversion means on the user's information terminal device 200; a user voice input requesting means for, if the user does not input a voice within a predetermined time, prompting the user to speak by displaying text and / or images on an input / output unit of the user's information terminal device; a score generating means for testing the accuracy of the pronunciation of the voice input by the user voice input means and generating a score according to the degree of accuracy of the pronunciation; and a determination means for determining whether the score generated by the score generation means is equal to or greater than a predetermined threshold value, Only when the determining means determines that the score is equal to or greater than a predetermined threshold value, the wordbook generating means registers the word in the wordbook.
[0110] According to this aspect, in order to register words, the user must acquire a pronunciation level comparable to that of a native speaker, and until they reach that pronunciation level, they will inevitably repeatedly listen to and imitate the audio of example sentences. This allows the user to acquire not only pronunciation but also language skills that allow them to understand a foreign language in the context of example sentences through this repetitive process.
[0111] In the language learning system 1 according to the third aspect, the storage unit 140 of the management device 100 further stores wordbook generation word data 144 including word data related to words, example sentence data related to example sentences including the words, and audio data related to the audio of the example sentences; the flashcard includes word data of the flashcard generation word data 144 that matches the word decomposed by the flashcard generation means, the example sentence data, and the audio data; The words registered in the vocabulary book have no words registered at the beginning of learning using the language learning system 1, but as learning progresses, the number of registered words increases and are displayed in a list format based on the characteristics of the language, and among the words registered in the vocabulary book, new words that are registered for the first time through learning using the language learning system 1 are highlighted so that they are visible as new word highlights 501 from already learned words, and when the user selects a new word from the vocabulary book, example sentences associated with the new word are displayed on the user's information terminal device 200, and when the user selects an example sentence, audio of the example sentence is output, and when the user speaks in imitation of the audio, the accuracy of the pronunciation is scored and then it is determined whether the score is above a predetermined threshold, and if the score is above the predetermined threshold, the new word highlight 501 of the new word is erased, but if the user or the user's instructor chooses not to erase the new word highlight 501, the new word highlight 501 of the new word is not erased.
[0112] According to this embodiment, new words in the created vocabulary book are highlighted, encouraging the user to repeatedly review and study the words, thereby promoting the user's understanding not only of pronunciation accuracy but also of context and spelling.
[0113] In the language learning system 1 according to the fourth aspect, the storage unit 140 of the management device 100 further stores learning data 145, which is data related to the learning results of the user who has studied using the language learning system 1; The control unit 130 of the management device 100 The system further includes a statistical analysis processing means for performing a statistical analysis process on the learning data 145 of the user to generate statistical analysis data 146, The input / output unit 220 of the user's information terminal device 200 is caused to display at least the number of new words and the total number of words, which is the sum of the new words and the learned words.
[0114] According to this aspect, the user can grasp his / her own learning situation at a glance using specific numerical data, which can increase the user's motivation to learn.
[0115] In the language learning system 1 of the fifth aspect, the control unit 130 of the management device 100 displays the statistical analysis data 245 of the user and the statistical analysis data 245 that is an aggregate of the learning data 244 of multiple other users on the input / output unit 220 of the user's information terminal device 200.
[0116] According to this aspect, the user can objectively understand his / her own learning situation in comparison with other users, thereby increasing the user's motivation to learn.
[0117] In the language learning system 1 of the sixth aspect, the control unit 130 of the management device 100 transmits the user's learning data 145 to the information terminal device 200 used by the user's instructor in response to a request from the user's instructor.
[0118] According to this aspect, if the user has a teacher, the teacher can grasp the numerical data relating to the specific learning situation specific to the user and use it as a guide for how to teach the user.
[0119] In the language learning system 1 according to the seventh aspect, the wordbook does not include languages other than those targeted for language learning by the user.
[0120] According to this aspect, the user can comprehensively learn the pronunciation, meaning, and spelling of the language being studied without the intervention of their native language, and can improve the user's language ability to the point where they can respond at an equal level to a native speaker.
[0121] A language learning method according to an eighth aspect is a language learning method performed by a management device 100 for supporting a user's language learning by providing the user with a wordbook unique to the user, the wordbook being generated using only words the user has learned, Storing teaching material data 143 including image data 143a relating to an image, image example sentence data 143b which is text data of example sentences relating to the image, and image audio data 143c which is audio data of the example sentences; a step of displaying an image having a difficulty level according to the learning level of the user from the learning material data 143 on the input / output unit 220 of the information terminal device 200 used by the user; outputting a voice of an example sentence related to the image displayed by the image display means; a step of inputting a voice uttered by the user in imitation of the voice of the example sentence output by the teaching voice output means; converting data relating to the user's voice inputted to the user voice input means into text data; and a step of dividing the text data acquired by the text data conversion means from sentence units to word units, and registering the divided words to generate a word list specific to the user.
[0122] A program according to a ninth aspect includes: Storing teaching material data 143 including image data 143a relating to an image, image example sentence data 143b which is text data of example sentences relating to the image, and image audio data 143c which is audio data of the example sentences; a step of displaying an image having a difficulty level according to the learning level of the user from the learning material data 143 on the input / output unit 220 of the information terminal device 200 used by the user; outputting a voice of an example sentence related to the image displayed by the image display means; a step of inputting a voice uttered by the user in imitation of the voice of the example sentence output by the teaching voice output means; converting data relating to the user's voice inputted to the user voice input means into text data; The text data obtained by the text data conversion means is broken down from sentence units to word units, and the broken down words are registered to generate a word list specific to the user.
[0123] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have been modified and improved in various ways based on the knowledge of those skilled in the art.
[0124] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, a control section can be read as control means or a control circuit.
[0125] Furthermore, unless the word "only" is used, such as "based only on XX," "depending only on XX," or "only in the case of XX," it is assumed that additional information may be taken into consideration in this specification. For example, the phrase "do b when a" does not necessarily mean "always do b when a" or "do b immediately after a" unless explicitly stated otherwise. Furthermore, the phrase "each a constituting A" does not necessarily mean that A is composed of multiple components, but includes the case where the component is singular.
[0126] Furthermore, the system configuration shown in FIG. 1 and the hardware configurations shown in FIGS. 2 and 4 are merely examples for achieving the object of the present invention, and are not particularly limited.
[0127] Furthermore, the block diagrams of the functional configuration examples shown in Figures 3 and 5 are merely examples and are not particularly limited. That is, it is sufficient that the management device 100 or the information terminal device 200 in Figures 3 and 5 is provided with a function that can achieve the above-mentioned effects as a whole, and the functional configuration used to realize this function is not particularly limited to the examples in Figures 3 and 5.
[0128] Furthermore, the screens shown in Figures 7, 8, 10 and 11 are merely examples. [Explanation of symbols]
[0129] 1. Language Learning System 100 Management device 200 Information terminal device N Network
Claims
1. A language learning system including a management device for supporting a user's language learning by providing a user-specific wordbook created using only words the user has learned, The storage unit of the management device At least teaching material data including image data relating to an image, image example sentence data which is text data of example sentences related to the image, and image audio data which is audio data of the example sentences are stored; The control unit of the management device an image display means for displaying an image having a difficulty level corresponding to the learning level of the user from the teaching material data on an input / output unit of an information terminal device used by the user; an image and audio output means for outputting audio of an example sentence related to the image displayed by the image display means; a user voice input means for inputting a voice uttered by the user in imitation of the voice of the example sentence output by the image and voice output means; a text data conversion means for converting data relating to the user's voice inputted to the user voice input means into text data; a wordbook generating means for dividing the text data acquired by the text data converting means from sentence units to word units and registering the divided words to generate a wordbook specific to the user, In the image and sound output means, the text of the example sentence is not displayed on the input / output unit of the information terminal device of the user, the vocabulary book generated by the vocabulary book generation means does not include languages other than those that the user is learning; Language learning system.
2. The control unit of the management device a user voice input requesting means for, if the user does not input a voice within a predetermined time, prompting the user to speak by displaying text and / or images on an input / output unit of the user's information terminal device; a score generating means for testing the accuracy of the pronunciation of the voice input by the user voice input means and generating a score according to the degree of accuracy of the pronunciation; and a determination means for determining whether the score generated by the score generation means is equal to or greater than a predetermined threshold value, 2. The language learning system according to claim 1, wherein said vocabulary book generating means registers said word in said vocabulary book only when said determining means determines that said score is equal to or greater than a predetermined threshold value.
3. the storage unit of the management device further stores wordbook generation word data including word data relating to a word, example sentence data relating to an example sentence including the word, and audio data relating to an audio of the example sentence; the wordbook includes the word data of the wordbook generation word data that matches the words decomposed by the wordbook generation means, the example sentence data, and the audio data, 3. The language learning system according to claim 2, wherein the words registered in the vocabulary book are empty at the beginning of learning using the language learning system, but the number of registered words increases as learning progresses and are displayed in a list format based on the characteristics of the language, and new words registered for the first time through learning using the language learning system are highlighted so that they are visible as new word highlights from words that have already been learned, and when the user selects a new word from the vocabulary book, example sentences associated with the new word are displayed on the user's information terminal device, and when the user selects an example sentence, audio of the example sentence is output, and when the user speaks in imitation of the audio, the accuracy of the pronunciation is scored and then it is determined whether the score is equal to or greater than a predetermined threshold, and if the score is equal to or greater than the predetermined threshold, the new word highlighting of the new word is removed, but if the user or the user's instructor chooses not to remove the new word highlighting, the new word highlighting of the new word is not removed.
4. the storage unit of the management device further stores learning data, which is data related to the learning results of the user who has studied using the language learning system; The control unit of the management device The method further comprises a statistical analysis processing means for performing a statistical analysis process on the learning data of the user to generate statistical analysis data, 4. The language learning system according to claim 3, wherein the input / output section of the user's information terminal device displays at least the number of new words and the total number of words including the new words and the learned words.
5. The language learning system according to claim 4, wherein the control unit of the management device causes the input / output unit of the user's information terminal device to display the user's statistical analysis data and statistical analysis data compiled from learning data of multiple other users.
6. 5. The language learning system according to claim 4, wherein the control unit of the management device transmits the user's learning data to an information terminal device used by the user's instructor in response to a request from the instructor.
7. 1. A language learning method performed by a management device for supporting a user's language learning by providing a user-specific wordbook created using only words the user has learned, comprising: storing teaching material data including image data relating to an image, image example sentence data which is text data of example sentences related to the image, and image audio data which is audio data of the example sentences; a step of displaying an image having a difficulty level corresponding to the learning level of the user from the teaching material data on an input / output unit of an information terminal device used by the user; a step of outputting a voice of an example sentence related to the image displayed by the step of displaying on the input / output unit; a step of inputting a voice uttered by the user in imitation of the voice of the example sentence output in the step of outputting the voice; converting data relating to the user's voice inputted in the step of inputting the voice into text data; a step of dividing the text data acquired by the step of converting the text data into text data from sentence units into word units, and registering the divided words to generate a word list specific to the user, In the step of outputting the speech, the text of the example sentence is not displayed on an input / output unit of the information terminal device of the user, the vocabulary book generated by the step of generating the vocabulary book does not include languages other than those that the user is learning; Language learning methods.
8. The computer of the management device storing teaching material data including image data relating to an image, image example sentence data which is text data of example sentences related to the image, and image audio data which is audio data of the example sentences; a step of displaying an image having a difficulty level corresponding to the user's learning level from the teaching material data on an input / output unit of an information terminal device used by the user; a step of outputting a voice of an example sentence related to the image displayed by the step of displaying on the input / output unit; a step of inputting a voice uttered by the user in imitation of the voice of the example sentence output in the step of outputting the voice; converting data relating to the user's voice inputted in the step of inputting the voice into text data; a step of dividing the text data acquired by the step of converting the text data into text data from sentence units into word units, and generating a word list specific to the user by registering the divided words, In the step of outputting the voice, the step is executed so that the text of the example sentence is not displayed on an input / output unit of the information terminal device of the user; executing the step of generating the vocabulary book so that the vocabulary book generated does not include languages other than those that the user is learning; program.
Citation Information
Patent Citations
Device and method for studying foreign language, and medium therefor
JP2001265211A
Language study system using communication network
JP2002023615A
Word learning training system
JP2018180299A
Electronic equipment, learning support system, learning processing method, and program
JP2023046232A
Pronunciation learning system able to be corrected by an expert
KR1020180019497A