Display method and program

Abstract

The present invention provides a user interface with which a user can more easily understand the result of evaluating an answer. A method for displaying the result of evaluating a user answer sentence on a display device, the method comprising performing any one of: first display control for performing display of a first image that indicates a correct answer and indicates a first evaluation in a first case where it is determined, in accordance with input of a user answer, that the user answer sentence matches a model answer sentence; second display control for performing identification display for identifying a portion of the user answer sentence that is different from the model answer sentence, and display of a second image that indicates a correct answer and indicates a second evaluation lower than the first evaluation, in a second case where it is evaluated that the user answer sentence does not match the model answer sentence but is the correct answer; and third display control for performing identification display and display of a third image that indicates an incorrect answer in a third case where it is evaluated that the user answer sentence including the portion that is different from the model answer sentence is not correct.

Description

Display method and program

[0001] The present invention relates to a method and a program for displaying on a display device an evaluation result of a user's translated answer to a question.

[0002] In recent years, software applications have been developed to train English learners to instantly translate Japanese text into English. By repeatedly performing this training, learners can increase the speed at which they can recall English knowledge and efficiently improve their speaking ability.

[0003] Patent Literature 1 discloses a method for evaluating a student's answers to language questions using artificial intelligence, although the method is not a training question for translating Japanese sentences into English. The specific disclosure is as follows: The artificial intelligence determines the degree of similarity between the meaning of the student's answer and the meaning of multiple model answers. After the student answers, the student's answer is judged by operating the "Judge" button. If the answer is judged to be the most appropriate, all three stars are displayed in a bright manner. Next, if the answer is judged to be appropriate, two stars are displayed in a bright manner. If the answer is judged to be somewhat appropriate, one star is displayed in a bright manner. If the answer is judged to be inappropriate, none of the stars are displayed in a bright manner. If the degree of similarity between the meaning of the student's answer and the meaning of the model answer is 80%, all three stars are displayed in a bright manner.

[0004] Patent No. 7067751

[0005] In the method described in Patent Document 1, when the student's answer does not match the model answer, the difference between the student's answer and the model answer is not displayed, making it impossible to recognize the difference between the model answer. Also, the same three stars are displayed in a brighter manner in both cases where the student's answer and the model answer are a perfect match and where the degree of similarity between the meaning of the student's answer and the meaning of the model answer is 80%, making it impossible to recognize the difference between the two cases.

[0006] Because there are many English expressions, it is difficult to prepare in advance all model answers that a user of an application for translating Japanese texts can give when translating Japanese texts into English. Therefore, the user's answer is compared to a limited number of model answers. However, when the user's answer does not match the model answer but is similar, the issue becomes how to evaluate the user's answer and what kind of evaluation result to output and display.

[0007] Therefore, an object of the present invention is to provide a user interface that allows the user to more easily understand the evaluation results of the answers.

[0008] A method according to one aspect of the present invention for solving the above-described problems is a method for displaying on a display device an evaluation result obtained by an information processing device evaluating an answer sentence that a user has translated into another language for a question sentence to be translated, the method comprising: a first display control for causing the display device to perform the following in a first case in which the information processing device determines that the user's answer sentence matches a model answer sentence corresponding to the question sentence, in response to input of the user's answer for the question sentence; displaying a first image indicating a correct answer and indicating a first evaluation; and a second display control for causing the display device to perform the following in a second case in which the information processing device determines that the user's answer sentence does not match the model answer sentence and evaluates that the user's answer sentence, which includes a portion different from the model answer sentence, as being correct. The display device performs either a second display control that causes the display device to display an identification display that shows different parts of the user's answer sentence and the model answer sentence in a different manner from the same parts of the user's answer sentence and the model answer sentence when displaying the answer sentence, and a second image that indicates the correct answer and a second rating that is lower than the first rating; or a third display control that causes the display device to display the identification display and a third image that indicates an incorrect answer in a third case in which the information processing device evaluates the user's answer sentence, which includes a part that is different from the model answer sentence, as being incorrect, and the first image that is displayed on the display device in the first case is not displayed on the display device in the second case regardless of the user's answer sentence.

[0009] According to the present invention, it is possible to provide a user interface that allows the user to more easily understand the evaluation results of the answers.

[0010] FIG. 1 is a diagram showing the configuration of an information processing system. FIG. 2 is a diagram showing the configuration of an information processing terminal. FIG. 3 is a diagram showing a flowchart of a method for displaying an evaluation result of a user's answer on a display unit. FIG. 4 is a diagram showing a flowchart of a method for evaluating a user's answer. FIG. 5 is a diagram showing the relationship of sending and receiving information between information processing devices. FIG. 6 is a diagram showing a GUI of Example 1. FIG. 7 is a diagram showing a GUI of Example 1. FIG. 8 is a diagram showing a GUI of Example 2. FIG. 9 is a diagram showing a GUI of Example 2.

[0011] The present invention will be described by listing the contents of the embodiments. For example, the present invention has the following configuration.

[0012] [Item 1] A method for displaying on a display device an evaluation result obtained by an information processing device evaluating an answer sentence translated into another language by a user for a problem sentence to be translated, the method comprising: a first display control that, in response to input of the user's answer to the problem sentence, causes the display device to display a first image indicating a correct answer and indicating a first evaluation in a first case in which the information processing device determines that the user's answer sentence matches a model answer sentence corresponding to the problem sentence; and a second display control that, in a second case in which the information processing device determines that the user's answer sentence does not match the model answer sentence and evaluates that the user's answer sentence, which includes a portion different from the model answer sentence, is correct, causes the display device to display an identification display that shows the different portion of the user's answer sentence and the model answer sentence in a different manner from the same portion of the user's answer sentence and the model answer sentence, and a second image that indicates the correct answer and indicates a second evaluation that is lower than the first evaluation, when the information processing device determines that the user's answer sentence does not match the model answer sentence and evaluates that the user's answer sentence, which includes a portion different from the model answer sentence, is correct, when displaying the user's answer sentence and the model answer sentence. a third display control that causes the display device to display the distinguishing display and a third image indicating an incorrect answer in a third case in which the information processing device evaluates the user's answer sentence, which includes a portion different from the model answer sentence, as incorrect; and a third display control that causes the display device to display the distinguishing display and a third image indicating an incorrect answer in a third case in which the information processing device evaluates the user's answer sentence as incorrect, the first image that is displayed on the display device in the first case being not displayed on the display device regardless of the user's answer sentence in the second case. [Item 2] The method of Item 1, in which the distinguishing display is performed so that words in the user's answer sentence that are not in the model answer sentence can be distinguished from words that are present in the model answer sentence. [Item 3] The method of Item 1 or 2, in which, when it is determined that the user's answer sentence does not match the model answer sentence, the information processing device outputs an evaluation result of the user's answer sentence based on information on the question sentence and information on the meaning of the user's answer sentence. [Item 4] The method of Item 3, in which the evaluation result is output based on information on the meaning of the user's answer sentence output by artificial intelligence. [Item 5] A program for causing a computer to execute the method according to any one of items 1 to 4.

[0013] 1 shows a configuration diagram of an information processing system according to this embodiment. The system includes an information processing terminal (information processing device) 1, an evaluation server (information processing device) 2, and an AI server (information processing device) 3. These are connected via a network 4.

[0014] Software and application programs for learning training are installed on the information processing terminal 1, which presents the user with sentences expressed in a predetermined language as questions and allows the user to view the questions and translate them into other languages. The programs are installed by downloading them from a server connected to the information processing terminal 1 via a network 4. The information processing terminal 1 obtains information on the answers translated by the user and transmits the information to the evaluation server 2 via the network 4.

[0015] The evaluation server 2 is an information processing device (evaluation device) that performs information processing to evaluate an answer sentence that a user has translated into another language for a problem sentence to be translated. The evaluation server 2 receives information on the answer translated by the user and evaluates the user's answer sentence based on that information. The AI ​​server 3 is a server equipped with artificial intelligence (AI). When the user's answer sentence should be evaluated by machine learning such as artificial intelligence (AI), the evaluation server 2 transmits information on the user's answer sentence to the AI ​​server 3 via the network 4.

[0016] The AI ​​server 3 inputs information about the user's answer sentence into a machine learning model such as a trained large-scale language model, outputs information indicating the meaning of the user's answer sentence and information about other expressions of the user's answer sentence, and sends it to the evaluation server 2 via the network 4.

[0017] The assessment server 2 receives the information output by the AI ​​server 3 and evaluates the user's answer sentence based on that information. The assessment server 2 transmits the evaluation results of the user's answer sentence to the information processing terminal 1 via the network 4. The information processing terminal 1 performs display control to display the evaluation results of the user's answer sentence on a display device based on the evaluation results received from the assessment server 2.

[0018] Next, we will explain the configuration of the information processing terminal 1. The information processing terminal 1 has a computer that can be installed in a device such as a general-purpose computer, a personal computer, a smartphone, a tablet, etc. The information processing terminal 1 can acquire information about the user's answers using installed software or applications (programs) and perform display control to display the evaluation results of the user's answer sentences on a display device.

[0019] 2 shows a configuration diagram of the information processing terminal 1. The information processing terminal 1 has a processing unit 11, a memory 12, a storage 13, a communication unit 14, an input unit 15, and a display unit 16. These are electrically connected to each other via a bus 17.

[0020] The processing unit 11 is an arithmetic unit that controls the overall operation of the information processing terminal 1, controls the transmission and reception of data between the various units, and performs information processing necessary for program execution and authentication processing. The processing unit 11 includes an arithmetic processing unit such as a processor such as a CPU, GPU, or FPGA, and is stored in the storage 13, executes programs deployed in the memory 12, and performs various information processing operations described below.

[0021] The memory 12 (storage unit) includes a main memory configured with a volatile storage device such as a DRAM, and an auxiliary memory configured with a non-volatile storage device such as a flash memory or an HDD. The memory 12 is used as a work area for the processing unit 11, and also stores the BIOS executed when the information processing terminal 1 is started up, various setting information, and the like.

[0022] The storage 13 (storage medium) stores various programs such as applications and programs. A database that stores data used for each process is constructed in the storage 13.

[0023] The communication unit 14 connects the information processing terminal 1 to the network 4. The communication unit 14 communicates with external devices directly or via a network access point, for example, by a wired LAN, a wireless LAN, Wi-Fi (Wireless Fidelity, registered trademark), infrared communication, Bluetooth (registered trademark), short-range or contactless communication, etc. The input unit 15 is an information input device, for example, a keyboard, a mouse, a touch panel, etc.

[0024] The display unit (display device) 16 includes a display that displays information obtained by calculations performed by the processing unit 11 or information received from the outside by the communication unit 14. The display unit 16 provides a graphical user interface (GUI) that displays various information on its screen. The display unit 16 is not limited to being provided integrally with the information processing terminal 1, but may also be a display (display device) that is provided separately from the information processing terminal 1 and connected to the information processing terminal 1.

[0025] The bus 17 is commonly connected to the above components and transmits, for example, address signals, data signals and various control signals.

[0026] Next, the configuration of the assessment server 2 will be described. The assessment server 2 has a processing unit, a memory (storage unit), a storage (storage medium), and a communication unit. These are electrically connected to each other via a bus. The processing unit is an arithmetic device that controls the operation of the assessment server 2 as a whole, controls the transmission and reception of data between each unit, and performs information processing necessary for program execution and authentication processing. The processing unit includes an arithmetic processing device such as a processor such as a CPU, GPU, or FPGA, and is stored in the storage, executes programs deployed in the memory, and performs various information processing described below.

[0027] The storage of the assessment server 2 stores various programs such as applications and programs. A database storing data used for each process is constructed in this storage. The communication unit of the assessment server 2 connects the assessment server 2 to the network 4. This communication unit receives information sent from the information processing terminal 1 or the AI ​​server 3 via the network 4. The received information is stored in memory and used for information processing performed by the processing unit or stored in storage.

[0028] Next, the configuration of the AI ​​server 3 will be described. The AI ​​server 3 has a processing unit, a memory (storage unit), a storage (storage medium), and a communication unit. These are electrically connected to each other via a bus. The processing unit is an arithmetic device that controls the operation of the AI ​​server 3 as a whole, controls the transmission and reception of data between each unit, and performs information processing necessary for program execution and authentication processing. The processing unit includes an arithmetic processing device such as a processor such as a CPU, GPU, or FPGA, and is stored in storage, executes programs deployed in memory, and performs various information processing described below.

[0029] The storage of the AI ​​server 3 stores various programs such as applications and programs. A database storing data used for each process is constructed in this storage. Machine learning models such as trained large-scale language models are stored in the storage or memory. The communication unit connects the AI ​​server 3 to the network 4. This communication unit receives information transmitted from the information processing terminal 1 or the evaluation server 2 via the network 4. The received information is stored in the memory and used for information processing performed by the processing unit, or stored in the storage.

[0030] Next, a method for displaying on a display device, using the above information processing system, the evaluation results of the evaluation server 2 for the answer sentence that the user has translated into another language for the question sentence to be translated, will be described.

[0031] The information processing terminal 1 executes a method of displaying on a display device an evaluation result obtained by the evaluation server 2 of an answer sentence that a user has translated into another language for a question sentence to be translated. Specifically, the information processing terminal 1 performs one of the following three display controls on the display device in response to an input of an answer by the user for one question sentence. The display control includes a first display control that causes the display device to display a first image indicating the correct answer and indicating a first rating in a first case in which the evaluation server 2 determines that the user's answer sentence matches the model answer sentence corresponding to the question sentence; a second display control that causes the display device to display an identification display that shows the different parts of the user's answer sentence and the model answer sentence in a manner different from the same parts of the user's answer sentence and the model answer sentence when displaying the user's answer sentence and the model answer sentence, and a second image that indicates the correct answer and a second rating that is lower than the first rating in a third case in which the evaluation server 2 determines that the user's answer sentence, including the different part from the model answer sentence, is not correct; and a third display control that causes the display device to display an identification display and a third image that indicates an incorrect answer in a third case in which the evaluation server 2 determines that the user's answer sentence does not match the model answer sentence and evaluates the user's answer sentence, including the different part from the model answer sentence, to be correct. The first image displayed on the display device in the first case is not displayed on the display device in the second case, regardless of the user's answer sentence.

[0032] The information processing system as a whole employs an evaluation method in which an answer sentence translated into another language by a user is evaluated for a question sentence to be translated. Specifically, the method includes the steps of: displaying a question on a display screen of a terminal used by the user; transmitting information on an answer to the question entered by the user using the terminal and the information on the question to an information processing device; acquiring information on the question and information on the user's answer to the question by the information processing device; determining whether the user's answer matches a model answer corresponding to the question; if the information processing device determines that the user's answer matches the model answer, the information processing device transmits first information indicating that the user's answer matches the model answer to the terminal; if the terminal acquires the first information, displaying the user's answer and the model answer, and a first image indicating the highest rating among three images indicating the evaluation results on the screen of the terminal; if the information processing device determines that the user's answer does not match the model answer, the information processing device evaluates the user's answer including a portion different from the model answer. and a second display step of, if the information processing device evaluates the user's answer statement to be correct as a result of the evaluation, causing the terminal to display second information indicating that the user's answer statement does not match the model answer statement but is still correct; if the terminal acquires the second information, causing the terminal to display an identification display allowing the user to identify the different parts of the user's answer statement and the model answer statement in the display of the user's answer statement and the model answer statement on the screen of the terminal, and displaying a second image indicating the second evaluation of the three images indicating the evaluation result (indicating that the user's answer statement does not match the model answer statement but is still correct); and a third display step of, if the information processing device evaluates the user's answer statement to be incorrect as a result of the evaluation, causing the terminal to display an identification display and a third image indicating the lowest evaluation of the three images indicating the evaluation result (indicating that the user's answer statement is incorrect).

[0033] A specific method for displaying the evaluation results of a user's answer on a display device will now be described. Figure 3 shows a flowchart of this method. Figure 5 shows the relationship between the sending and receiving of information between each information processing device. The information processing described below is performed by executing programs installed in the terminal 1, evaluation server 2, and AI server 3.

[0034] The predetermined language in which the problem sentences to be translated may be any language, such as Japanese, English, Chinese, Korean, German, or French, but in this embodiment, Japanese will be used. The other translation language may be any language other than the predetermined language mentioned above, but in this embodiment, English will be used. Below, we will explain a method, device, and program for a user who is learning English to translate problem sentences to be translated, which are written in Japanese, into English sentences.

[0035] The information processing terminal 1 (hereinafter referred to as terminal 1) launches an English learning application (software) in response to input operations from the user. After launching, the display unit 16 displays icon images representing groups of questions, for example, by level. The user selects the desired question to study by clicking or tapping on one of the images displayed on the display unit 16. The processing unit 11 acquires information about the question selected by the user, for example, by a signal from the mouse of the input unit 15 or the touch panel of the display unit 16.

[0036] The processing unit 11 acquires information on the question selected by the user from the question sentence database stored in the storage 13, stores it in the memory 12, and displays the question sentence included in the acquired question information on the display screen of the display unit 16 (S1). The question sentence database may be stored in the assessment server 2. In that case, the assessment server 2 may transmit the information on the question sentence to the terminal 1 in response to a request from the terminal 1.

[0037] The user views the Japanese question text to be translated, displayed on the display unit 16, considers an appropriate English translation, and answers the question by inputting the translated English sentence into the terminal 1. The user may input the answer into the terminal 1 by speaking using a microphone, or by inputting text via the touch panel or keyboard of the display unit 16. If the user inputs the answer orally, a process is performed to convert the input audio information into text information. This conversion process may be performed by the processing unit 11, or may be performed by an evaluation server 2 or other server (external information processing device) other than the terminal 1 after acquiring the audio information from the terminal 1. If an information processing device other than the terminal 1 performs the conversion process, the converted text information is sent to the terminal 1. In this way, the processing unit 11 acquires information about the English composition, which is the English sentence translated by the user, as the user's answer text (S2). The terminal 1 transmits information about the user's answer to the evaluation server 2 and requests the evaluation server 2 for an evaluation result of the user's answer.

[0038] The evaluation server 2 acquires information on the question selected by the user and information on the user's answer to that question via the network 4 (S3). The information on the question selected by the user is acquired by receiving it from the terminal 1. The information on the user's answer to the question may be acquired as text information acquired by the terminal 1 as described above, or may be acquired by receiving audio information from the terminal 1 and converting it into text information.

[0039] The storage of the assessment server 2 stores a model answer database. The model answer is an answer that is set as the optimal answer for the corresponding question and is prepared in advance. The processing unit of the assessment server 2 acquires information on the model answer corresponding to the question acquired from the terminal 1 from the model answer base stored in the storage (S4). The model answer database may register one or more model answer sentences as model answers for one question, but this embodiment will explain an example in which one model answer sentence is registered for one question sentence.

[0040] Next, the assessment server 2 determines, via its processing unit, whether the user's answer matches the model answer (S5). Based on the information about the user's answer obtained from the terminal 1, the processing unit of the assessment server 2 compares the user's answer translated into English with the model answer corresponding to the question answered by the user. In this comparison, for example, the processing unit determines whether the English words contained in the model answer are identical to the English words contained in the user's answer, starting from the beginning. If the English words are exactly the same from the beginning to the end of the English sentence, the processing unit determines that the user's answer matches the model answer. If different English words exist from the beginning to the end of the English sentence, or if the same English words exist but in a different order, the processing unit determines that the user's answer does not match the model answer. As described above, the processing unit of the assessment server 2 determines whether the user's answer matches the model answer and transmits information about the determination result to the terminal 1.

[0041] If the processing unit of the evaluation server 2 determines that the user's answer does not match the model answer, it evaluates whether the user's answer is correct (S6). In this evaluation, it evaluates whether the meaning of the user's answer matches the intent, gist, or meaning of the question.

[0042] For example, the evaluation server 2 sends a question to the AI ​​server 3 asking about the meaning of the user's answer, which is input into a large-scale language model, which is the artificial intelligence of the AI ​​server 3, and the model outputs information about the meaning of the user's answer and sends it to the evaluation server 2, whereby the evaluation server 2 obtains information about the meaning of the user's answer. The information about the meaning of the user's answer output by the large-scale language model of the AI ​​server 3 can be output in any language, but can be information expressed in Japanese, for example.

[0043] The processing unit of the evaluation server 2 then determines whether the acquired information on the meaning of the user's answer contains information on the question. For example, it determines whether the Japanese sentence expressing the meaning of the user's answer contains a word from the Japanese question. If it is determined that the Japanese sentence expressing the meaning of the user's answer contains a word from the Japanese question, the user's answer matches the intention, gist, or meaning of the question, and the user's answer can be evaluated as correct. If it is determined that the Japanese sentence expressing the meaning of the user's answer does not contain a word from the Japanese question, the user's answer does not match the intention, gist, or meaning of the question, and the user's answer can be evaluated as incorrect. Furthermore, the evaluation server 2 may send a question to the AI ​​server 3 asking about the meaning of the question, obtain information on the meaning of the question, and compare the meaning of the question with the meaning of the user's answer.

[0044] Another example of evaluating a user's answer is translating the user's English answer into Japanese. In this method, information about the user's answer is sent from the evaluation server 2 to a translation server, which then translates the English user's answer into Japanese. Information about the translated Japanese is then sent to the evaluation server 2, which evaluates whether the meaning of the translated Japanese user's answer matches the intent, gist, or meaning of the question. For example, it determines whether the Japanese user's answer contains a word from the Japanese question. If it is determined that the Japanese user's answer contains a word from the Japanese question, the user's answer matches the intent, gist, or meaning of the question, and therefore the user's answer can be evaluated as correct. If it is determined that the Japanese user's answer does not contain a word from the Japanese question, the user's answer does not match the intent, gist, or meaning of the question, and therefore the user's answer can be evaluated as incorrect.

[0045] Another example of evaluating a user's answer is to refer to a thesaurus database for any mismatch between the English words in the user's answer and the model answer. This method uses the thesaurus database to determine whether the mismatched English words in the user's answer and the model answer are similar. If they are similar, the meaning of the user's answer can be evaluated as matching the meaning of the question, and the user's answer can be evaluated as correct. If they are not similar, the user's answer can be evaluated as incorrect.

[0046] Using the above method, the processing unit of the assessment server 2 evaluates whether the user's answer is correct or not, and transmits the information of the evaluation result to the terminal 1 (S7). The terminal 1 obtains from the assessment server 2 the determination result of whether the user's answer matches the model answer, and the evaluation result of the user's answer when the user's answer does not match the model answer.

[0047] FIG. 4 shows a flowchart of the method for processing ratings by the ratings server 2 in steps S5 to S7.

[0048] In a first case where the evaluation server 2 determines in S11 that the user's answer matches the model answer corresponding to the question, the evaluation server 2 transmits first information indicating that the user's answer matches the model answer to the terminal 1, and terminates the process (S12). In the first case, the terminal 1 acquires the first information indicating that the user's answer matches the model answer, and displays on the display screen an indication that the user's answer matches the model answer (S9). Specifically, the terminal 1 displays a first image, which indicates the correct answer and represents the highest rating (first rating), on the GUI of the display. The first image may be an image of ◎, which is the highest rating among the symbols ◎, ○, and ×, or a text image such as "perfect" or "perfect match."

[0049] In this way, in the first case, the terminal 1 performs a first display control to cause the display unit to display a first image indicating the correct answer and the first evaluation. The user can recognize that their answer is correct by looking at the screen of the display unit.

[0050] In the first case, the terminal 1 can also display the model answer to the question and the user's answer on the GUI of the display unit. This makes it possible to confirm that the user's answer completely matches the model answer. The user's answer and the model answer can also be displayed simultaneously on the same screen. It is not necessary to display both the user's answer and the model answer, and it is possible to display only one of them.

[0051] In a second case where the evaluation server 2 determines in S11 that the user's answer does not match the model answer sentence and evaluates in S13 that the user's answer sentence, which includes a portion different from the model answer sentence, is correct, the evaluation server 2 transmits second information indicating that the user's answer sentence does not match the model answer sentence but is correct to the terminal 1, and ends the processing (S14). The terminal 1 acquires the second information in the second case and displays on the screen of the display unit an indication that the user's answer sentence does not match the model answer sentence but is correct (S9).

[0052] Specifically, the model answer to the question and the user's answer are displayed on the GUI of the display unit. Also, a second image, which is an image indicating the correct answer and indicates a rating (second rating) lower than the first rating, is displayed on the GUI of the display unit. The second image may be an image of the symbol ○, which indicates a medium rating out of the symbols ◎○×, or a text image such as "This expression is OK" or "It feels good." The second image may also be the symbol △.

[0053] Furthermore, in the second case, the terminal 1 displays the user's answer sentence and the model answer sentence on the screen of the display unit (S8). In the second case, when displaying the user's answer sentence and the model answer sentence, the terminal 1 performs a distinguishing display to indicate the different portions of the user's answer sentence and the model answer sentence in a manner different from the same portions of the user's answer sentence and the model answer sentence. Examples of different displaying manners include using different colors, changing the thickness of the characters, or underlining. Furthermore, for example, a distinguishing display such as a different color can be performed to distinguish words in the user's answer sentence that are not in the model answer sentence from words that are present in the model answer sentence. This distinguishing display allows the user to easily visually confirm the differences between the user's answer sentence and the model answer. The terminal 1 can also perform the distinguishing display regardless of whether the user's answer is in the second case or the evaluated user's answer sentence.

[0054] The second image may be a model answer along with a text image indicating that there are alternative ways to express the model answer, or a model answer along with a text image pointing out deficiencies in the user's answer.

[0055] In this way, in the second case, when the terminal 1 displays the user's answer sentence and the model answer sentence, it performs second display control that causes the display unit to perform the following: an identification display that shows different parts of the user's answer sentence and the model answer sentence in a manner different from the same parts of the user's answer sentence and the model answer sentence; and a display of a second image that indicates the correct answer and a second rating that is lower than the first rating.

[0056] In the second case, the assessment server 2 does not display on the display the first image that would be displayed on the display in the first case in which the user's answer matches the model answer. Furthermore, regardless of the user's answer that the assessment server 2 determines to correspond to the second case after receiving various user answers, the assessment server 2 does not display on the display the first image that would be displayed on the display in the first case. In other words, the first image that would be displayed on the display in the first case is not displayed on the display in the second case, regardless of the user's answer. This can also be expressed as not performing display control to display the first image on the screen of the terminal 1, regardless of the user's answer. Furthermore, in the second case, the assessment server 2 may perform display control to not display on the display the first image that would be displayed on the display in the first case. The display control on the display of the terminal 1 performed in the second display control may not include display control to display the second image without identifying it. It is also possible that the first image displayed when it is determined that the user's answer matches the model answer and the second image displayed when the user's answer is evaluated as correct will never be the same regardless of the user's answer.

[0057] By doing so, the user can distinguish and recognize whether the user's answer matches the model answer or whether it does not match but is still within the range that can be considered correct.

[0058] Furthermore, in the first case, the first display control may not display the second image that is displayed in the second case when the user's answer is either in the second display control. Also, in the first case, the evaluation server 2 may perform display control not to display the second image that is displayed in the second case on the display. In the first case, by displaying the user's answer and the model answer on the screen, the user can visually confirm that the user's answer and the model answer match, so even if there is confusion between the first image and the second image displayed in the first case, the impact is relatively small.

[0059] In the first case where the user's answer sentence and the model answer sentence match, and the second case where the user's answer sentence and the model answer sentence do not match but are evaluated as correct, if one or more common images are used as images showing the evaluation result of the user's answer sentence, confusion will arise between cases where the user's answer sentence and the model answer sentence match and cases where they do not match, making it difficult to easily confirm whether they match or not.

[0060] Since there are many possible English expressions, users may enter a variety of answers. Therefore, if there are only one or two model answers for a question, marking all answers that do not match the model answer as incorrect can reduce users' satisfaction. This is even more so if a process is set up to allow users to retry incorrect questions.

[0061] Therefore, if the user's answer does not match the model answer but is similar to the model answer or matches the meaning, intent, or gist of the original question, it can be output and displayed as the correct answer, thereby improving the user's sense of satisfaction.Furthermore, by displaying the differences between the model answer and the user's answer so that they can visually recognize them, the user can learn the differences and acquire different ways of expressing themselves from the user's answer, thereby improving the effectiveness of their learning.

[0062] In a third case, when the evaluation server 2 determines in S11 that the user's answer does not match the model answer sentence, and evaluates in S14 that the user's answer, which includes a portion different from the model answer sentence, is not correct, that is, is incorrect, it sends third information indicating that the user's answer does not match the model answer sentence and is incorrect to the terminal 1, and ends the processing (S15). The terminal 1 acquires the third information in the third case, and displays on the screen of the display unit an indication that the user's answer does not match the model answer sentence and is incorrect (S9).

[0063] Specifically, a third image, which indicates an incorrect answer and is the lowest evaluation (third evaluation), is displayed on the GUI of the display unit. The third image may be an image of the lowest evaluation symbol × out of the symbols ◎○× or a letter image of "incorrect answer."

[0064] In the third case, the evaluation server 2 also displays the user's answer sentence and the model answer sentence on the GUI of the display unit screen. When displaying the user's answer sentence and the model answer sentence, a distinguishing display can be used to indicate the different parts of the user's answer sentence and the model answer sentence in a manner different from the same parts of the user's answer sentence and the model answer sentence. Examples of different displays include different colors, different font thickness, and underlining. This distinguishing display allows the user to easily visually confirm the differences between the user's answer sentence and the model answer sentence.

[0065] In this way, in the third case, the terminal 1 performs a third display control that causes the display unit to display the above-mentioned identification display and a third image indicating an incorrect answer. By visually displaying the difference between the model answer and the user's answer, the user can learn the difference and acquire a different way of expressing the answer from the user's, thereby improving learning effectiveness. Furthermore, when the terminal 1 determines that the user's answer does not match the model answer (cases 2 and 3), it can also not display the first image on the display device, regardless of the user's answer.

[0066] Furthermore, in the above display control, it is preferable to simultaneously display the user's answer sentence and the model answer sentence. It is preferable to divide the screen of the display unit into an area for displaying the image of the user's answer sentence and an area for displaying the image of the model answer sentence, arranging them one above the other and displaying them simultaneously on the same screen. Furthermore, when displaying the image of the user's answer sentence and the image of the model answer sentence, displaying them on the same screen without user operation such as tapping or clicking reduces the user's effort and improves visibility and operability.

[0067] As described above, the terminal 1 transmits information about the user's answer to the assessment server 2 in response to the user's input of an answer to a question, and requests the assessment server 2 for the result of the judgment or evaluation of the user's answer. The terminal 1 obtains the result of the judgment or evaluation of the user's answer from the assessment server 2, and performs one of the first display control, second display control, or third display control described above in accordance with the result of the judgment or evaluation. This makes it possible to provide a user interface that allows the user to more easily understand the result of the evaluation of the answer. Furthermore, it is possible to increase the user's sense of satisfaction with the result of the evaluation of the user's answer.

[0068] After completing an answer to one question and checking the evaluation results on the display screen, the user selects the next question to solve. The question can be selected by clicking or tapping a button on the GUI of terminal 1. The user uses terminal 1 to write an English composition for the next question, and the information processing system evaluates the user's answer for the next question in the same manner as described above. After checking the evaluation results of the answer, the user can select and answer the next question. In this way, the user learns by solving multiple questions one after another, and terminal 1 can evaluate the user's multiple answers and display the evaluation results on the display unit.

[0069] The terminal 1 evaluates the user's multiple answer sentences for a group of multiple question sentences at a predetermined level, displays each individual evaluation result on the display unit, and may then compile all evaluation results and display them as a summary on the display unit. The terminal 1 displays a selection button on the display unit for relearning questions that the user got wrong, and, upon the user's selection, displays the questions that the user got wrong again on the display unit to prompt the user to answer them. When relearning the questions that the user got wrong, the terminal 1 presents questions that the user evaluated as incorrect, excluding questions that the user evaluated as correct as in the first and second cases above.

[0070] In other words, when the user answers a plurality of questions, the terminal 1 sets the question for which the first image is displayed in relation to the user's answer and the question for which the second image is displayed in relation to the user's answer as the question for which the user answered correctly, and when the user re-answers a question for which the user answered incorrectly, the terminal 1 displays the question for which the third image is displayed in relation to the user's answer on the display device.

[0071] <Example 1> A specific example of a GUI displayed on the display unit of terminal 1 will be described. Diagrams of the GUI of Example 1 are shown in Figures 6, 7, and 8. Figure 6 shows a screen display in a first case where the user's answer matches the model answer, Figure 7 shows a screen display in a second case where the user's answer does not match the model answer but is evaluated as correct, and Figure 8 shows a screen display in a third case where the user's answer does not match the model answer and is evaluated as incorrect.

[0072] On the display screen M of the display unit shown in FIG. 6 , a question sentence is displayed in Japanese in area M1. In the example of FIG. 6 , the question sentence is, "What time do you plan to arrive?" The user sees the question sentence and speaks in English to terminal 1 to translate the question sentence into English. Terminal 1 acquires audio information of the user's speech and transmits the audio information to the assessment server 2. The assessment server 2 converts the user's speech information into English text information and transmits the English text information to terminal 1. Terminal 1 displays the English sentence spoken by the user in area M3. In the example of FIG. 6 , the user's speech is, "What time are you going to arrive?" In addition, terminal 1 acquires a model answer sentence for the question sentence from the assessment server 2 and displays the model answer sentence in area M2. In the example of Fig. 6, the model answer sentence is "What time are you going to arrive?" In the example of Fig. 6, the user's answer sentence and the model answer sentence are displayed simultaneously, adjacent to each other above and below on the same screen.

[0073] The assessment server 2 determines whether the user's answer matches the model answer. In the example of FIG. 6 , the user's answer matches the model answer. The assessment server 2 transmits first information indicating that the user's answer matches the model answer to the terminal 1. In response to receiving the first information, the terminal 1 displays on the screen a first image indicating the correct answer and indicating a first evaluation (the highest evaluation) indicating that the user's answer matches the model answer. The first image is displayed in region M4. In the example of FIG. 6 , region M4 is shown in green. As the first image, the terminal 1 displays an image showing the symbol ◎ in region M5 within region M4, and displays a text image saying "Perfect!! Amazing!" in region M6 within region M4. The terminal 1 displays an icon image "Next" for selecting the next question in region M4.

[0074] FIG. 7 shows an example in which the user's answer sentence is different from the example in FIG. 6 , but the question sentence and model answer sentence are the same as those in FIG. 6 . The terminal 1 displays the English sentence spoken by the user in area M3. In the example in FIG. 7 , the user's utterance is, "When will you arrive?" The terminal 1 also obtains a model answer sentence for the question sentence from the assessment server 2 and displays the model answer sentence in area M2. The assessment server 2 determines whether the user's answer sentence matches the model answer sentence. In the example in FIG. 7 , the user's answer sentence does not match the model answer sentence. Therefore, the assessment server 2 evaluates whether the user's answer sentence is correct, as described in the above embodiment. The example in FIG. 7 shows a case in which the user's answer sentence is evaluated as correct. The assessment server 2 transmits second information to the terminal 1 indicating that the user's answer sentence does not match the model answer sentence, but that the user's answer sentence is correct. In response to receiving the second information, terminal 1 displays on the screen a second image indicating the correct answer and indicating a second rating that is lower than the highest first rating. The second image is displayed in area M4. In the example of FIG. 7 , area M4 is shown in green. Terminal 1 displays, as the second image, an image showing the symbol ○ in area M5 within area M4, and a text image saying "Correct! This expression is OK!" in area M6 within area M4.

[0075] In the example of Figure 7, the user's answer sentence and the model answer sentence do not match, so when the user's answer sentence and the model answer sentence are displayed, the different part of the user's answer sentence and the model answer sentence, i.e., "When will" in the user's answer sentence, is displayed in a different manner from the same part of the user's answer sentence and the model answer sentence. In the example of Figure 7, "When will" is displayed in gray, making it visually distinguishable from the other words displayed in black.

[0076] In Example 1, the image showing the symbol ◎ and the text image saying "Perfect!! Amazing!", which are the first images shown in the example of Figure 6, are not displayed, as in the screen of the example of Figure 7. In other words, these first images displayed on the screen in the first case described above are not displayed on the display unit regardless of the user's answer sentence in the second case. Furthermore, in the first case, in the first display control, it is also possible not to display on the display unit the second image that is displayed in the second case when the user's answer sentence is either one of the two.

[0077] FIG. 8 shows an example in which the user's answer sentence is different from the examples in FIGS. 6 and 7 , but the question sentence and model answer sentence are the same as those in FIGS. 6 and 7 . The terminal 1 displays the English sentence spoken by the user in area M3. In the example in FIG. 8 , the user's utterance is, "When do you arrive?" The terminal 1 also obtains a model answer sentence for the question sentence from the assessment server 2 and displays the model answer sentence in area M2. The assessment server 2 determines whether the user's answer sentence matches the model answer sentence. In the example in FIG. 8 , the user's answer sentence does not match the model answer sentence. Therefore, the assessment server 2 evaluates whether the user's answer sentence is correct, as described in the above embodiment. The example in FIG. 8 shows a case in which the user's answer sentence is evaluated as incorrect. The assessment server 2 transmits third information to the terminal 1, indicating that the user's answer sentence does not match the model answer sentence and that the user's answer sentence is incorrect. In response to receiving the third information, terminal 1 displays on the screen a third image indicating an incorrect answer and the lowest third evaluation. The third image is displayed in area M4. In the example of FIG. 8, area M4 is shown in red. As the third image, terminal 1 displays an image showing an x ​​symbol in area M5 within area M4, and displays a text image saying "incorrect" in area M6 within area M4. In the example of FIG. 8, as in the example of FIG. 7, terminal 1 also performs an identification display to identify the difference between the user's answer sentence and the model answer sentence. In the example of FIG. 8, "When do" is displayed in gray, making it visually distinguishable from the other words displayed in black.

[0078] 9, 10, and 11 show GUI diagrams of Example 2. Fig. 9 shows a screen display in a first case where the user's answer matches the model answer, Fig. 10 shows a screen display in a second case where the user's answer does not match the model answer but is evaluated as correct, and Fig. 11 shows a screen display in a third case where the user's answer does not match the model answer and is evaluated as incorrect.

[0079] On the display screen N of the display unit shown in FIG. 9 , an assignment is displayed in area N1, and a question sentence in Japanese is displayed in area N2. In the example of FIG. 9 , the question sentence is, "Is that your phone?" The user looks at the question sentence and speaks in English to terminal 1 to translate the question sentence into English. Terminal 1 acquires audio information of the user's speech and transmits the audio information to the assessment server 2. The assessment server 2 converts the user's speech information into English text information and transmits the English text information to terminal 1. Terminal 1 displays the English sentence spoken by the user in area N3. In the example of FIG. 9 , the user's speech is, "Is that your phone?" The assessment server 2 determines whether the user's answer sentence matches the model answer sentence. In the example of FIG. 9 , the model answer sentence is, "Is that your phone?", and this is an example in which it is determined that the user's answer sentence matches the model answer sentence. The assessment server 2 transmits first information to the terminal 1, indicating that the user's answer sentence matches the model answer sentence. In response to receiving the first information, the terminal 1 displays on the screen a first image, which is an image indicating the correct answer and indicates a first assessment (the highest assessment) indicating that the user's answer sentence matches the model answer sentence. The first image is displayed in area N4. In the example of FIG. 9 , area N4 is shown in green. The terminal 1 displays, as the first image, an image indicating a check mark in area N5 within the range of area N4, and displays a text image saying "Perfect" in area N4. The terminal 1 also displays an icon image "Next" for selecting the next question in area N4.

[0080] The terminal 1 also obtains model answers for the questions from the evaluation server 2. An area N6 within the area N4 displays icon images that the user can select, and when the user selects one, another screen N' is displayed, and the model answer is displayed in an area N7 of that screen N'. The model answer is also displayed in the area N7, along with the question.

[0081] FIG. 10 shows an example in which the user's answer sentence is different from the example in FIG. 9 , but the question sentence and model answer sentence are the same as those in FIG. 9 . The terminal 1 displays an English sentence spoken by the user in area N3. In the example in FIG. 10 , the user's utterance is "Is that your telephone." The assessment server 2 determines whether the user's answer sentence matches the model answer sentence. In the example in FIG. 10 , the user's answer sentence does not match the model answer sentence. Therefore, the assessment server 2 evaluates whether the user's answer sentence is correct, as described in the above embodiment. The example in FIG. 10 shows a case in which the user's answer sentence is evaluated as correct. The assessment server 2 transmits second information to the terminal 1, indicating that the user's answer sentence is correct even though the user's answer sentence does not match the model answer sentence. In response to receiving the second information, the terminal 1 displays on the screen a second image indicating the correct answer, which indicates a second rating lower than the highest first rating. The second image is displayed in area N4. In the example of FIG. 10 , area N4 is shown in green. As the second image, terminal 1 displays an image showing a check mark in area N5 within the range of area N4, and displays a text image saying "Good job!" in area N4. Furthermore, when the user selects the icon image in area N6, terminal 1 displays another screen N' and displays the model answer sentence in area N7 of screen N'. In the example of FIG. 10 , since the user's answer sentence and the model answer sentence do not match, when the user's answer sentence and the model answer sentence are displayed, the different part of the user's answer sentence and the model answer sentence, i.e., the word "phone" in the model answer, is displayed in a different manner from the same part of the user's answer sentence and the model answer sentence. In the example of FIG. 10 , the word "phone" is underlined, making it visually distinguishable from other words.

[0082] In Example 2, the character image "Perfect," which is the first image shown in the example of Figure 9, is not displayed, as in the screen of the example of Figure 10. In other words, the first image displayed on the screen in the first case described above is not displayed on the display unit regardless of the user's answer sentence in the second case. Furthermore, in the first case, in the first display control, it is also possible not to display on the display unit the second image that is displayed in the second case when the user's answer sentence is either one of the answers.

[0083] FIG. 11 shows an example in which the user's answer sentence is different from the examples in FIGS. 9 and 10, but the question sentence and model answer sentence are the same as those in FIGS. 9 and 10. The terminal 1 displays an English sentence spoken by the user in area N3. In the example in FIG. 11, the user's utterance is "Is this your phone." The assessment server 2 determines whether the user's answer sentence matches the model answer sentence. In the example in FIG. 11, the user's answer sentence does not match the model answer sentence. Therefore, the assessment server 2 evaluates whether the user's answer sentence is correct, as described in the above embodiment. The example in FIG. 11 shows a case in which the user's answer sentence is evaluated as incorrect. The assessment server 2 transmits third information indicating that the user's answer sentence is incorrect to the terminal 1. In response to receiving the third information, the terminal 1 displays on the screen a third image indicating an incorrect answer, which is the lowest third evaluation. The third image is displayed in area N4. In the example of FIG. 11 , area N4 is indicated in red. Terminal 1 displays an image of a symbol x in area N5 within the range of area N4 as the third image, and displays a text image of "incorrect" in area N4. Terminal 1 also displays a model answer sentence in area N4. In the example of FIG. 11 , since the user's answer sentence and the model answer sentence do not match, when displaying the user's answer sentence and the model answer sentence, the different part of the user's answer sentence and the model answer sentence, i.e., the word "that" in the model answer, is displayed in a different manner from the same part of the user's answer sentence and the model answer sentence. In the example of FIG. 11 , the word "that" is underlined and displayed in bold, making it visually distinguishable from other words. Furthermore, when the user selects the icon image in area N6, terminal 1 can also display the model answer sentence in area N7 of another screen N'.

[0084] Although preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. Furthermore, not all of the components shown in the embodiments are necessarily essential components of the present disclosure. Furthermore, features shown in each embodiment can also be applied to other embodiments as long as they are not mutually inconsistent.

[0085] The display control of the display unit described above can be performed by the terminal 1 on which the program is installed, or by transmitting and receiving information to and from other information processing devices via a network or cable. Furthermore, various information processes other than display control, such as cloud services and distributed computers, can also be performed by one or more information processing devices on which the program is installed. Furthermore, the evaluation server 2 may be equipped with the functions of an AI server.

[0086] The terminal 1 can also measure the time from when the question sentence is displayed on the display unit until the user finishes speaking the answer. The terminal 1 may also display the evaluation result of the user's answer sentence on the display unit, as well as the measured time.

[0087] For example, if an image showing a user's answer as correct or incorrect is displayed, there is a possibility that some users will think that the evaluation result is incorrect. Therefore, the terminal 1 may display the evaluation result of the user's answer on the display unit, as well as a selection button for changing the evaluation result. In response to the user selecting the selection button, the terminal 1 transmits information indicating that the evaluation result of the user's answer has been changed to the evaluation server 2, and the evaluation server 2 can store the information in memory or storage. The evaluation server 2 can also modify the model answer sentence stored in the model answer database based on the changed information.

Claims

1. A method for displaying on a display device an evaluation result obtained by an information processing device evaluating an answer sentence that a user has translated into another language for a problem sentence to be translated, comprising: a first display control that, in response to an input of the user's answer to the problem sentence, causes the display device to display a first image indicating a correct answer and indicating a first evaluation of the answer sentence in a first case in which the information processing device determines that the user's answer sentence matches a model answer sentence corresponding to the problem sentence; and a second display control that, in a second case in which the information processing device determines that the user's answer sentence does not match the model answer sentence and evaluates that the user's answer sentence, which includes a portion different from the model answer sentence, is correct, causes the display device to display an identification display that shows the different portion of the user's answer sentence and the model answer sentence in a manner different from the same portion of the user's answer sentence and the model answer sentence when displaying the user's answer sentence and the model answer sentence, and a second image that indicates the correct answer and is different from the first image and indicates a second evaluation of the answer sentence. a third display control that causes the display device to display the identification display and a third image indicating an incorrect answer in a third case in which the information processing device evaluates that the user's answer sentence, which includes a part different from the model answer sentence, is incorrect; wherein the first image that is displayed on the display device in the first case is not displayed on the display device in the second case regardless of the user's answer sentence; and wherein the color of the display area of ​​the first image and the color of the display area of ​​the second image are the same.

2. The method of claim 1, wherein the distinguishing display includes a display in which, in the display of the user's answer sentence and the model answer sentence, the portions of the user's answer sentence and the model answer sentence that are the same are shown in the same manner, and the portions of the user's answer sentence and the model answer sentence that are different are shown in different manners.

3. The method of claim 1, characterized in that when it is determined that the user's answer sentence does not match the model answer sentence, the information processing device outputs an evaluation result of the user's answer sentence by comparing information on the question sentence with information on the meaning of the user's answer sentence.

4. The method according to claim 3, wherein the evaluation result is output based on information about the meaning of the user's answer sentence output by artificial intelligence.

5. The method of claim 3, wherein the information on the meaning of the user's answer includes information obtained by translating the user's answer into the language of the question, and the evaluation result is output by comparing the information on the question with the information obtained by translating the user's answer into the language of the question.

6. The method of claim 1, wherein each of the first image, the second image, and the third image includes a symbol or character, and the two images include a symbol or character that is different from the symbol or character of the first image.

7. The method of claim 1, wherein the second image includes the word "correct." 8. The method of claim 1, wherein the distinguishing display includes a display in which the user's answer sentence and the model answer sentence are displayed in different colors in the parts where they differ, or a display in which the user's answer sentence and the model answer sentence are underlined in the parts where they differ.

9. A program for causing a computer to execute the method according to any one of claims 1 to 8.

Images