Language learning system, language learning program and language learning method

Abstract

To provide a language learning system which enables easy learning of words even for a user who cannot read.SOLUTION: The language learning system comprises: an image display unit that displays a scene in which multiple objects related to each other are dispersed; a user voice receiving unit that receives a user voice uttered by the user when the user utters a name of an object contained in the scene; and a user voice determination unit that determines whether or not the user voice received by the voice receiving unit indicates the object contained in the scene.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to a language learning system, a language learning program, and a language learning method. [Background technology]

[0002] Patent document 1 describes a language learning system that displays an image (e.g., an image of an "apple") on a user terminal while outputting a model voice (e.g., "apple"), prompts the user to say "apple," and evaluates the accuracy of the pronunciation, thereby enabling the user to acquire accurate pronunciation.

[0003] However, such a language learning system only allows users to associate the pronunciation of "apple" with the image of an "apple," which makes it difficult for users to remember words. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2018 / 033979 Summary of the Invention [Problem to be solved by the invention]

[0005] The present invention has been made to solve the above-mentioned problems, and its main objective is to provide a language learning system that makes it easy to learn words, and in particular, a language learning system that makes it easy for users who cannot read, such as young children or foreigners, to learn words. [Means for solving the problem]

[0006] In other words, the language learning system of the present invention is a system comprising an image display unit that displays a scene in which multiple objects related to each other are scattered, a user voice receiving unit that receives user voice when the user speaks the name of an object included in the scene, and a voice determination unit that determines whether the user voice received by the user voice receiving unit indicates an object included in the scene.

[0007] With such a system, users can view a scene filled with multiple objects that are related to each other and learn the names of the objects contained within it by linking them not only to the objects themselves but also to other related objects and scenes, making it easier to remember words. Furthermore, since users can intuitively associate the multiple objects or scenes they see with the names of the objects, even users who cannot read, such as young children or foreigners, can easily remember words.

[0008] It is preferable that the scene imitates a single landscape through the combination and arrangement of multiple objects. This allows users to learn the name of an object by associating it with its combination and arrangement with other objects in a scene, in other words, by associating the name of the object with its relationship to other related objects and scenes, making it easier to remember words.

[0009] It is preferable that the image display unit displays a plurality of selectable scenes, and the sound determination unit determines the name of an object contained in a scene selected from the plurality of displayed scenes. This allows the scene to be selected for learning based on the appearance of the scene or the objects contained in the scene, so that even users who cannot read, such as foreigners or young children, can intuitively learn about scenes that interest them.

[0010] It is preferable that the objects included in the scene are displayed selectably, and the device further comprises a sound playback section which plays back a model sound corresponding to the name of an object when the object is selected. In this way, a user can simply select an object that catches their eye in the scene and hear a model voice indicating the name of that object, so even users who cannot read, such as foreigners or young children, can intuitively learn the name of the object. By imitating the model voice, children can associate the objects they see with their names, which is useful for language learning.

[0011] It is preferable that the device further comprises a determination result output section that outputs the determination result by the voice determination section as an image including symbols or as sound. In this way, the user can know from the symbols or sounds whether the name of the object he or she speaks out loud indicates that object, so even users who cannot read, such as foreigners or young children, can learn intuitively.

[0012] The learning support program of the present invention is a program that causes a computer to function as an image display unit that displays a scene in which multiple objects related to each other are scattered, a user voice receiving unit that receives user voice when the user speaks the name of an object included in the scene, and a voice determination unit that determines whether the user voice received by the user voice receiving unit indicates the object included in the scene. Such a program can achieve the same effects as the learning support system described above.

[0013] The learning support method of the present invention includes a scene display step of displaying a scene in which multiple objects related to each other are scattered throughout, a user voice reception step of receiving user voice when the user speaks the name of an object included in the scene, and a voice determination step of determining whether the user voice received by the user voice reception unit indicates the object included in the scene. According to such a method, it is possible to achieve the same effects as the above-mentioned learning support system. Effect of the Invention

[0014] According to the present invention configured in this manner, it is possible to provide users with a language learning system that makes it easy to learn words, particularly a language learning system that makes it easy for users who cannot read, such as young children or foreigners, to learn words. [Brief description of the drawings]

[0015] [Figure 1] 1 is a diagram showing the overall configuration of a learning support system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a diagram showing the device configuration of a user terminal and a learning support server according to the embodiment. [Diagram 3] FIG. 2 is a functional configuration diagram of the learning support system according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating a display screen according to the embodiment. [Diagram 5] FIG. 13 is a functional configuration diagram of a learning support system according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] An embodiment of a language learning system according to the present invention will be described with reference to the drawings.

[0017] As shown in FIG. 1, the language learning system of the present invention is a system that supports a user's language learning by displaying an image of a learning object (hereinafter also referred to as an object) on a user terminal 2, receiving user voice from the user terminal 2, and determining whether the user voice indicates the learning object. More specifically, for example, an image of a chair is displayed on the user terminal 2 while the user is prompted to speak, and it is determined whether or not the user can say "chair" in English.

[0018] <System configuration> As shown in Figure 1, this embodiment comprises a learning support server 1 and a user terminal 2 connected to the learning support server 1 via a communication network NT such as the Internet, and enables the functions of the learning support server 1 to be accessed and used from the user terminal 2.

[0019] Structurally, the learning support server 1 is a computer equipped with a CPU 101, a memory 102, a communication means 103, and the like, as shown in FIG.

[0020] The user terminal 2 is, for example, a computer called a notebook computer, and structurally, as shown in Fig. 2, integrally comprises a CPU 201, a memory 202, a communication means 203, an input / output interface 204, an input means 205 such as a keyboard, a mouse, a microphone, and the like, and an output means 206 such as a display and a speaker, and the like. Note that the user terminal 2 may be a so-called desktop computer in which the output means 206 and the input means 205 are separately provided, or a portable computer called a smartphone or a tablet.

[0021] In this embodiment, the learning support system 100, which is implemented by the learning support server 1 and the user terminal 2 operating in cooperation with each other via a communication network, functions as a data storage unit D, an image display unit 11, a user voice receiving unit 12, a voice determination unit 13, a voice playback unit 14, and a user operation receiving unit 15 as a whole, as shown in FIG. 3.

[0022] 3, the data storage unit D stores images and the like to be displayed on the user terminal 2, and has at least the functions of an image storage unit D1 that stores data (image data) of images to be displayed on the user terminal 2, a criterion storage unit D2 that stores criterion data for judging the user's voice, and a voice storage unit D3 that stores data of the voice (voice data) to be output to the user terminal 2. The data storage unit D in this embodiment is set in the memory of the learning assistance server 1.

[0023] The image storage unit D1 stores at least image data of the study object and image data for displaying the judgment result (judgment image data). In this embodiment, image data of the learning object (object) is stored in advance in the image storage unit D1, including image data representing a single object (object image data) and image data representing a scene in which multiple objects are scattered (scene image data).

[0024] The judgment criteria storage unit D2 stores judgment criteria data for comparison with the user's voice. The judgment criteria data is voice data of the name of the object represented in the object image data. The criteria data in this embodiment is stored in advance in the criteria storage unit D2 as a set of criteria data that includes multiple pieces of criteria data, such as a data set for when a man A (there may also be other men B, ..., woman a, woman b, etc.) speaks.

[0025] The voice storage unit D3 stores at least model voice data (model voice data) that serves as a model for how to say the name of the learning object, and voice data (determination voice data) for conveying the determination result to the user.

[0026] As shown in FIG. 3, the image display unit 11 controls images (e.g., images of study objects) to be displayed on the user terminal 2, acquires image data from the image storage unit D1, transmits the image data to the user terminal 2, and displays the image data on an output means 206 such as a display of the user terminal 2.

[0027] The user voice receiving unit 12 receives, from the user terminal 2, a voice signal converted from the user voice by the input means 205 (for example, a microphone) of the user terminal 2, as shown in FIG.

[0028] As shown in FIG. 3, the voice determination unit 13 compares the voice signal received by the user voice receiving unit 12 with the judgment criterion data acquired from the judgment criterion storage unit D2 to determine whether the user voice indicates an object to be learned.

[0029] As shown in FIG. 3, the audio playback unit 14 controls the audio (e.g., model audio) output from the user terminal 2, acquires audio data from the audio storehouse, transmits it to the user terminal 2, and outputs it from an output means 206 such as a speaker of the user terminal 2.

[0030] The user operation reception unit 15 receives an operation signal from an input means 205 (for example, a mouse or a keyboard) of the user terminal 2, as shown in FIG.

[0031] In this embodiment, the functions of the image display unit 11, the user voice reception unit 12, the voice determination unit 13, the voice reproduction unit 14, and the user operation reception unit 15 configured as above are fulfilled by the learning support server 1.

[0032] <System Operation> Next, the details of each of the above-mentioned components and the operation of this learning support system 100 will be described mainly with reference to the flowchart shown in FIG.

[0033] 4, when starting language learning, the user accesses the learning support server 1 using the user terminal 2. Specifically, the user uses a browser installed in the user terminal 2 to access a web page for using the learning system (step S0).

[0034] When the user performs a predetermined operation on the web page using the user terminal 2, the image display unit 11 acquires multiple scene image data from the image storage unit D1 and displays a scene selection screen as shown in Fig. 5a. On this scene selection screen, each scene is displayed so that it can be selected by the input means 205 of the user terminal 2 (step S1).

[0035] Next, when the user selects one scene on the scene selection screen, based on the selection, the image display unit 11 displays a scene display screen showing one scene as shown in FIG. 5b (step S2).

[0036] More specifically, when the user selects one scene on the scene selection screen using input means 205 such as a mouse, a scene selection signal indicating the selection is received by user operation reception unit 15. Based on the scene selection signal received by user operation reception unit 15, image display unit 11 identifies the scene selected by the user from the scene image data acquired in S1, and displays the scene on user terminal 2. Here, image display unit 11 may reacquire scene image data of the scene selected by the user.

[0037] On this scene display screen, a plurality of study objects (objects) included in the scene are displayed so as to be selectable by the input means 205 of the user terminal 2.

[0038] When the user selects one object on the scene display screen, based on the selection, the image display unit 11 displays an object display screen showing one object, as shown in FIG. 5c (step S3). Specifically, when the user selects one object on the scene display screen using input means 205 such as a mouse, an object selection signal indicating the selection is received by user operation receiving unit 15. Based on the object selection signal received by user operation receiving unit 15, image display unit 11 obtains object image data from image storage unit D1 and displays the selected object on user terminal 2.

[0039] When this mono display screen is displayed, the user can listen to the model sound of the selected mono (step S4). In this embodiment, when a user selects an image of an object on the object display screen, for example, with the mouse of the user terminal 2, the model sound of the object is played back. Specifically, based on a selection signal received by the user operation reception unit 15 at the time of the selection, the sound playback unit 14 acquires the model sound data of the object from the sound storage unit D3 and causes the user terminal 2 to output the model sound.

[0040] Step S4 of playing the model voice may be omitted. Also, the model voice may be automatically played back at the same time as the mono display screen is displayed, or after a certain time, based on a mono selection signal when mono is selected in step S3.

[0041] Furthermore, when the object display screen is displayed, if the user speaks the name of the object into, for example, the microphone of the user terminal 2, the user voice is received by the user voice receiving unit 12 as a voice signal (step S5).

[0042] The voice determination unit 13 compares the voice signal received by the user voice receiving unit 12 with the criterion data acquired from the criterion storage unit D2 to determine whether the user voice indicates the selected item (step S6).

[0043] If it is determined that the user voice indicates the selected item, the image display unit 11 causes the user terminal 2 to output a positive determination result, such as an image including a circle symbol (step S7). If it is not determined that the user voice indicates the selected item, a negative determination result, such as an image including an x ​​symbol, is output to the user terminal 2 (step S8).

[0044] Specifically, in steps S7 and S8 of this embodiment, the image display unit 11 acquires the determined image data from the image storage unit D1 based on the determination result of the voice determination unit 13, and causes the image to be displayed on the user terminal 2. The judgment image is an image including at least symbols such as ◯ and ×, or non-verbal expressions such as gestures indicating correctness or incorrectness. However, an image including linguistic expressions may also be used.

[0045] In steps S7 and S8, in addition to or instead of displaying the determination image, the audio replay unit 14 may acquire determination audio data from the audio storage unit D3 and output the audio to the user terminal 2. This determination audio may be a sound effect or a linguistic expression.

[0046] <About images that represent scenes> As described in the explanation of step S2, the language learning system according to the present invention causes the user terminal 2 to display an image representing a scene. The image representing this scene has been designed to make it easier to remember the names of the objects being studied, so we will explain this below.

[0047] The scene image of this embodiment is an image that represents a scene in which a number of objects are scattered, and is designed in such a way that the objects contained therein are related to one another. Here, "things" refers not only to objects with fixed shapes, but also to amorphous things such as liquids, the ground, the sky, mountains, etc. As long as they can be the subject of language learning, anything that can be named is called a learning object (thing).

[0048] Here, things that are related to each other refer to tools, devices, vehicles, buildings, etc. that have something in common in the environment in which they are used or installed. As a more specific example, tableware, food, tables, chairs, etc. have something in common in that they are used or installed in the dining environment. In addition, cars, roads, traffic lights, buildings, the sky, etc. have something in common in that they are used or installed in the environment that you see when you go out (such as an intersection). The objects that are related to each other may be, for example, a plurality of objects included in a specific group (classification), such as vehicles, animals, home appliances, and national flags.

[0049] More specifically, the scene of this embodiment is a scene that imitates a landscape by combining and arranging a plurality of objects as shown in Fig. 4b, where three or more objects that are related to each other are combined into a set, or a plurality of objects that are related to each other are arranged according to their relationships, so that the scene imitates a landscape.

[0050] Here, a single landscape is, for example, a landscape seen in daily life (dining table, school, workplace, etc.) or when going out (town, commercial facility, mountain, river, sea, etc.) The single landscape may also be a landscape seen from the sky by aerial photography, a landscape seen from the cross section of a building, a landscape under the sea, or other landscape that is difficult to see in real life.

[0051] <Effects of this embodiment> With the learning support system 100 of this embodiment configured as described above, a user can view a scene in which multiple objects related to each other are scattered, and learn the names of the objects contained therein while linking them not only to the objects themselves but also to other related objects and scenes, making it easier for the user to remember words. Furthermore, since users can intuitively associate the multiple objects or scenes they see with the names of the objects, even users who cannot read, such as young children or foreigners, can easily remember words.

[0052] Moreover, the scene in this embodiment imitates a single landscape by combining and arranging a plurality of objects. This allows users to learn the names of objects by linking them to their combination and arrangement with other objects in a scene; in other words, by linking the names of objects to their relationships with other related objects and scenes, making words easier to remember.

[0053] In this embodiment, the image display unit 11 displays a plurality of selectable scenes, and the voice determination unit 13 determines the name of an object included in a scene selected from the plurality of displayed scenes. This allows a scene to be selected for learning based on the appearance of the scene or the objects contained in the scene, so that even users who cannot read, such as foreigners or young children, can intuitively learn about scenes that interest them.

[0054] In addition, the image display unit 11 of the present embodiment displays objects included in a scene in a selectable manner. When an object included in the scene is selected, the sound reproducing unit 14 reproduces a model sound corresponding to the name of the object. This allows the user to hear a model voice indicating the name of an object simply by selecting the object that catches their eye in the scene, so that even users who cannot read, such as foreigners or young children, can intuitively know the name of the object. By imitating the model voice, children can associate the objects they see with their names, which is useful for language learning.

[0055] Moreover, the determination result display unit of this embodiment outputs the determination result by the voice determination unit 13 as an image including a symbol. This allows the user to know by symbols or sounds whether the name of an object he or she speaks out loud indicates that object, so that even a user who cannot read, such as a foreigner or an infant, can learn intuitively.

[0056] <Modification> In the above embodiment, the scene selection screen is displayed in step S1, but this step S1 may be omitted. The number of scenes available for learning may be one.

[0057] In the above embodiment, the user voice is judged with one object displayed on the screen in step S3 (step S6), but the user voice may be judged with the scene displayed on the scene display screen without switching to an object display screen with one object displayed in step 3. In this case, it is preferable to visually highlight the selected object in the scene so that it can be identified.

[0058] In the above embodiment, in step S3, a judgment is made on the user's voice for the selected object, but it is also possible to determine whether the voice uttered by the user indicates any object included in the scene without making a selection in step S3. At this time, if there is an object in the scene that is indicated by the voice uttered by the user, it is advisable to visually emphasize and display that object.

[0059] In the above embodiment, the voice determination unit 13 determines whether or not the user voice indicates a learning object. However, the voice determination unit 13 may have a function of determining what the received user voice indicates when the user voice does not indicate a learning object.

[0060] The image displayed on the user terminal 2 by the image display unit 11 may be a two-dimensional still image, may display a three-dimensional space, or may be a moving image.

[0061] In this embodiment, mono image data and scene image data are each stored in the image storage unit D1, but mono image data may be combined to create scene image data, or mono image data may be extracted from scene image data.

[0062] In the above embodiment, the voice determination unit 13 performs a determination by comparing the user voice with the determination criteria data (voice data). However, the voice determination unit 13 may perform a determination of the user voice using a voice recognition algorithm obtained, for example, by machine learning. Specifically, the user's voice may be converted into text (character string) by a voice discrimination algorithm, and the voice determination unit 13 may determine whether or not the converted text indicates an object to be studied. In this case, the criterion data is text data.

[0063] In the above embodiment, the learning support server 1 is responsible for the functions of the data storage unit D, image display unit 11, user voice reception unit 12, voice determination unit 13, voice reproduction unit 14, and user operation reception unit 15, but this is not limited to the above. Some or all of these functions may be provided in the user terminal 2, or more specifically, the function of one functional unit may be distributed among multiple terminals and the learning support server 1. Conversely, all of these may be consolidated into one computer, such as the user terminal 2. [Explanation of symbols]

[0064] 100 Learning Support System 1. Learning support server 2. User terminal D: Data storage unit D1: Image storage section D2...Judgment criteria storage section D3: Audio storage unit 11 Image display section 12 User voice reception section 13. Voice determination section 14 Audio playback section 15 User operation reception section 205... Input means 206... Output means

Claims

1. an image display unit that displays a scene in which a plurality of objects that are related to each other are scattered; a user voice receiving unit that receives a user voice when the user utters the name of an object included in the scene; a voice determination unit that determines whether the user voice received by the user voice receiving unit indicates the object included in the scene; A language learning system comprising:

2. The language learning system according to claim 1 , wherein the scene imitates a single landscape through a combination and arrangement of the plurality of objects.

3. the image display unit displays a plurality of the scenes in a selectable manner; The language learning system according to claim 1 , wherein the voice determination unit makes the determination on a name of an object included in a scene selected from the plurality of displayed scenes.

4. The object included in the scene is displayed selectably, The language learning system according to claim 1 , further comprising a voice playback unit that plays back a model voice corresponding to a name of the object when the object is selected.

5. 2. The language learning system according to claim 1, further comprising a determination result output unit that outputs the determination result by said voice determination unit as an image including a symbol or as a sound.

6. an image display unit that displays a scene in which a plurality of objects that are related to each other are scattered; a user voice receiving unit that receives a user voice when the user utters the name of an object included in the scene; A language learning program that causes a computer to function as a voice determination unit that determines whether the user voice received by the user voice receiving unit indicates the object included in the scene.

7. A scene display step of displaying a scene in which a plurality of objects related to each other are scattered; a user voice receiving step of receiving a user voice uttered by a user when the user utters the name of an object included in the scene; a voice determination step of determining whether or not the user voice received by the user voice receiving unit indicates the object included in the scene; A language learning method that provides:

Images