Memorization support program using video works, memorization support method using video works, and memorization support system using video works

The memory support program uses video works with translated subtitles to facilitate word memorization by associating words with images and contexts, improving retention of foreign language vocabulary.

JP2024163404AInactive Publication Date: 2024-11-22伴野 啓介

Patent Information

Application Number
JP2023078946
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2024-11-22
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Conventional methods fail to effectively help users memorize foreign language words by associating them with easily remembered images, leading to difficulty in retaining learned vocabulary.

Method used

A memory support program that uses video works with subtitles translated into the user's language, allowing users to select and associate words with corresponding images, subtitles, and video scenes, generating a personalized dictionary for easier memorization.

Benefits of technology

Enhances word memorization by providing a visual and contextual association, making it easier for users to retain foreign language vocabulary.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024163404000001_ABST
    Figure 2024163404000001_ABST
Patent Text Reader

Abstract

To provide a memorization support system, a method, and a program capable of helping a user effectively memorize words the user wants to memorize.SOLUTION: A memorization support system using video works includes an acquisition unit, an extraction unit, and a generation unit. When a video work a user has viewed is accompanied by a caption generated by translating voice uttered in a language associated with the user's attribute into a predetermined language, the acquisition unit acquires caption information on the video work and viewing information on the user concerning the view work. The extraction unit extracts a leaning word, which is estimated to appear in the caption of the video work during the user's viewing on the basis of the viewing information on the user, and a predetermined caption containing the learning word on the basis of the user's likes and dislikes against a character which is an utterer of the predetermined caption. The generation unit adds the learning word, which is extracted according to an extraction procedure, to a first area associated with the video work, adds the predetermined caption, which is extracted according to the extraction procedure, to a second area associated with the video work, and thus generates a dictionary associated with the video work.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a memory assistance program using a video work, a memory assistance method using a video work, and a memory assistance device using a video work. [Background technology]

[0002] When learning a foreign language, memorizing vocabulary is one of the most important aspects of learning. However, because foreign languages ​​have developed in cultures different from the user's own, memorizing vocabulary is often difficult. While commercially available dictionaries contain word meanings and example sentences, these dictionaries do not allow users to accurately master the usage of words, and so even if users memorize words, they often forget them over time.

[0003] 2. Description of the Related Art Conventionally, there is known a technique for making a word easier to understand by making sentences using the word easily accessible. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-221414 Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional techniques have not been able to effectively help users memorize words they want to remember. For example, conventional techniques have not been able to help users memorize words by associating them with images that are easy for users to recall, making it difficult for users to effectively memorize words they want to memorize.

[0006] The present invention has been made in view of the above, and has as its object to make it easier for a user to effectively memorize words that the user wants to memorize. [Means for solving the problem]

[0007] The memory assistance program using a video work of the present application is characterized in that, when a video work viewed by a user is a video work with subtitles in which audio spoken in a language corresponding to the user's attributes is translated into a predetermined language, the program causes a computer to execute the following steps: an acquisition step of acquiring subtitle information for the video work and the user's viewing information for the video work; an extraction step of extracting learning words that are estimated to have appeared in the subtitles of the video work while the user was watching based on the user's viewing information and predetermined subtitles containing the learning words, based on the user's preferences for characters who are speakers of the predetermined subtitles; and a generation step of generating a dictionary corresponding to the video work by adding the learning words extracted by the extraction step to a first area corresponding to the video work and adding the predetermined subtitles extracted by the extraction step to a second area corresponding to the video work. [Effects of the Invention]

[0008] According to one aspect of the embodiment, it is possible to provide an effect that it is possible to facilitate effective memorization of words that a user wants to memorize. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of a memory assistance device according to an embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a dictionary information storage unit according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a dictionary according to the embodiment. [Figure 5] FIG. 5 is a diagram showing an example of word selection according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a dictionary according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a subtitle information storage unit according to the embodiment. [Figure 8]FIG. 8 is a diagram illustrating an example of a user interface according to the embodiment. [Figure 9] FIG. 9 is a flowchart showing the procedure of information processing by the information processing system according to the embodiment. [Figure 10] FIG. 10 is a flowchart showing the procedure of information processing by the information processing system according to the embodiment. [Figure 11] FIG. 11 is a flowchart showing the procedure of information processing by the information processing system according to the embodiment. [Figure 12] FIG. 12 is an explanatory diagram for explaining information processing according to the first modification. [Figure 13] FIG. 13 is a diagram illustrating an example of the configuration of an information processing system according to the second embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of the configuration of a memory assistance device according to the second embodiment. [Figure 15] FIG. 15 is a diagram illustrating an example of a subtitle information storage unit according to the second embodiment. [Figure 16] FIG. 16 is a diagram illustrating an example of a commercially available dictionary information storage unit according to the second embodiment. [Figure 17] FIG. 17 is a flowchart showing the procedure of information processing by the information processing system according to the second embodiment. [Figure 18] FIG. 18 is a diagram illustrating an example of the configuration of an information processing system according to the third embodiment. [Figure 19] FIG. 19 is a diagram illustrating an example of a video / movie image storage unit according to the third embodiment. [Figure 20] FIG. 20 is a diagram illustrating an example of the configuration of a memory assistance device according to the third embodiment. [Figure 21] FIG. 21 is a flowchart showing the procedure of information processing by the information processing system according to the third embodiment. [Figure 22] FIG. 22 is a flowchart showing the procedure of information processing by the information processing system according to the third embodiment. [Figure 23] FIG. 23 is a diagram illustrating an example of the configuration of an information processing system according to the fourth embodiment. [Figure 24]FIG. 24 is a diagram illustrating an example of the configuration of an information processing system according to the fourth embodiment. [Figure 25] FIG. 25 is a diagram illustrating an example of the configuration of a memory assistance device according to the fourth embodiment. [Figure 26] FIG. 26 is a flowchart showing the procedure of information processing by the information processing system according to the fourth embodiment. [Figure 27] FIG. 27 is a flowchart showing the procedure of information processing by the information processing system according to the fourth embodiment. [Figure 28] FIG. 28 is a diagram illustrating an example of the configuration of an information processing system according to the fifth embodiment. [Figure 29] FIG. 29 is a diagram illustrating an example of the configuration of a memory assistance device according to the fifth embodiment. [Figure 30] FIG. 30 is a diagram illustrating an example of the speech statistics information storage unit according to the fifth embodiment. [Figure 31] FIG. 31 is a flowchart showing the procedure of information processing by the information processing system according to the fifth embodiment. [Figure 32] FIG. 32 is a flowchart showing the procedure of information processing by the information processing system according to the fifth embodiment. [Figure 33] FIG. 33 is a flowchart showing the procedure of information processing by the information processing system according to the fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Below, the memory support program using a video work, the memory support method using a video work, and the memory support device using a video work according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the memory support program using a video work, the memory support method using a video work, and the memory support device using a video work according to the present application are not limited to these embodiments. Furthermore, the same components in the following embodiments will be given the same reference numerals, and duplicate explanations will be omitted.

[0011] The present disclosure will be described in the following order. 1. Embodiment 1 Introduction 1.2. Information Processing System Configuration 1.3.Configuration of memory support device 1.4. Information processing flow 1.5. Variations 1.6.Effects 2. Embodiment 2 2.1. Introduction 2.2. Information Processing System Configuration 2.3.Configuration of memory support device 2.4. Information processing flow 2.5. Variations 2.6.Effects 3. Embodiment 3 Introduction 3.2. Information Processing System Configuration 3.3.Configuration of memory support device 3.4. Information processing flow 3.5. Variations Effects 4. Embodiment 4 Introduction 4.2. Information Processing System Configuration 4.3.Configuration of memory support device 4.4. Information processing flow 4.5. Variations Effects 5. Embodiment 5 5.1. Introduction 5.2. Information Processing System Configuration 5.3.Configuration of memory support device 5.4. Information Processing Flow 5.5. Variations Effects 6. Other Modifications 7.Other

[0012] <<1. Embodiment 1>> <1.1. Introduction> When learning a foreign language, memorizing vocabulary is one of the most important aspects of learning. However, because foreign languages ​​have developed in cultures different from the user's own, memorizing vocabulary is often difficult. While commercially available dictionaries contain word meanings and example sentences, these dictionaries do not allow users to accurately master the usage of words, and so even if users memorize words, they often forget them over time.

[0013] Furthermore, in commercially available dictionaries, the more difficult the dictionary, the more difficult the words used to explain word meanings and in example sentences. For example, words that are unfamiliar even in the user's own language may be used. However, if a language from a different culture is explained using words that are unfamiliar even in the user's own language, the user may not be able to understand it. Even if the user is able to understand it, the words they have memorized through such an understanding are often forgotten over time.

[0014] Furthermore, learning a foreign language through videos produced in that culture is a widely used method for learning a foreign language. However, the sensibilities of the speakers in such videos may differ from the user's own, making such videos difficult to understand in the first place, not just due to language issues. For example, even a user who has lived in a foreign culture for many years may not be able to understand the emotional cues in a video produced in that culture. For example, they may not be able to fully enjoy a comedy because they do not understand what makes a person laugh. In this way, users who were not born and raised in that culture may not be able to deeply understand a video produced in that culture, regardless of their level of understanding of the language of that culture.

[0015] The present invention has been made in view of the above, and has as its object to make it easier for users to effectively memorize words that they wish to memorize.

[0016] <1.2. Information Processing System Configuration> An information processing system 1 shown in Fig. 1 will be described. As shown in Fig. 1, the information processing system 1 includes a terminal device 10 and a memory assistance device 100. The terminal device 10 and the memory assistance device 100 are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other via wired or wireless communication. Fig. 1 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment.

[0017] The terminal device 10 is an information processing device used by a user who is learning a foreign language. The terminal device 10 may be any device that can implement the processes in the embodiment. The terminal device 10 may also be a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, a PDA, or other device.

[0018] The terminal device 10 is, for example, a smart device such as a smartphone or a tablet, and is a portable terminal device that can communicate with any server device via a wireless communication network such as 4G to 6G (Generations), LTE (Long Term Evolution), etc. The terminal device 10 may have a screen such as a liquid crystal display with a touch panel function, and may accept various operations on displayed data such as content, such as tapping, sliding, scrolling, etc., performed by a user with a finger or a stylus.

[0019] The memory assistance device 100 is an information processing device designed to facilitate effective memorization of words that a user wishes to memorize. The memory assistance device 100 may be any device that can implement the processes described in the embodiments. For example, the memory assistance device 100 may be implemented by a server device, a cloud system, or the like.

[0020] Although FIG. 1 shows a case where the terminal device 10 and the memory assistance device 100 are separate devices, the terminal device 10 and the memory assistance device 100 may be integrated.

[0021] In the following embodiments, the video is a video primarily targeted at viewers who were born and raised in the same culture as the user. That is, the video is produced in the user's culture. This allows the user to watch the video in a language that is easiest for them to understand. The video also includes subtitles translated into the language the user is learning. This allows subtitles that translate the audio in the video to be displayed. Note that the subtitles may be embedded in the video, or may be added each time the video is played. In addition, the following embodiments will be described using an example in which English subtitles are displayed, but the language the user is learning may be any language and is not particularly limited.

[0022] In the following embodiments, the video is an animation, or so-called anime. For example, the video is an anime consisting of multiple episodes, each of which has a predetermined length (e.g., a predetermined length that can be broadcast in a 30-minute television broadcast slot). If the anime has multiple television seasons (e.g., if it is divided into multiple quarters and broadcast in each season), the video may be a video of a specific season, in which multiple episodes of a specific season are compiled into a single video, or a video of an entire season, in which all multiple episodes of each season are compiled into a single video. The video may be, for example, one that is being broadcast in real time or one that was broadcast in the past. It may also be one that is uploaded to a predetermined website or that can be viewed using a predetermined application (app), and the viewing mode, such as the location where the user views the video, is not particularly limited. The video is not limited to anime, but may also be a simulation game (e.g., a dating simulation game) in which the objective is to achieve a predetermined event. In such games, the game progresses without the user having to perform any operations (for example, characters' conversations progress, images change and scenes transition), so such games are also considered to be animation works. The video images may also be e-book manga (e-comics) that can be viewed together with audio content recorded from a manga being read aloud. E-comics with such audio content are also considered to be animation works. Note that when e-comics with audio content are considered to be animation works, the lines contained in speech bubbles (or all of the lines contained in the frames) correspond to subtitles.

[0023] <1.3. Configuration of memory support device> Next, the configuration of the memory assistance device 100 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the memory assistance device 100 according to the embodiment. As shown in Fig. 2, the memory assistance device 100 has a communication unit 110, a memory unit 120, and a control unit 130. Note that the memory assistance device 100 may also have an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the memory assistance device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.

[0024] (Communication unit 110) The communication unit 110 is realized by, for example, a network interface card (NIC) etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the terminal device 10 etc. via the network N.

[0025] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 2 , the storage unit 120 has a dictionary information storage unit 121 and a subtitle information storage unit 122.

[0026] The dictionary information storage unit 121 stores information about a dictionary created by a user. Here, FIG. 3 shows an example of the dictionary information storage unit 121 according to the embodiment. FIG. 3 is a diagram showing an example of the dictionary information storage unit 121 according to the embodiment. As shown in FIG. 3, the dictionary information storage unit 121 has items such as "user ID," "video," and "dictionary."

[0027] "User ID" indicates identification information for identifying a user. "Video" indicates the video for which the user created a dictionary. For example, it is the title of the video. "Dictionary" indicates information related to the dictionary corresponding to the video. In the example shown in Figure 3, conceptual information such as "Dictionary #1" and "Dictionary #2" is stored in "Dictionary," but in reality, information such as words and subtitles added by the user to the dictionary is stored for each video.

[0028] That is, Figure 3 shows an example in which the videos for which a user identified by user ID "U1" generated a dictionary are "XXXYY1", "XXXYY2", ..., "XXXYYN", and the information related to the dictionary corresponding to the videos is "Dictionary #1", "Dictionary #2", ..., "Dictionary #N". For example, this shows that words and subtitles included in "Dictionary #1" have been added to the dictionary generated by user U1 using the video "XXXYY1".

[0029] (Adding words and subtitles to the dictionary) Hereinafter, details of the dictionary according to the embodiment will be described with reference to FIG. 4. FIG. 4 is a diagram illustrating an example of the dictionary according to the embodiment. The dictionary D1 is a dictionary generated when a user U1 selects words that appear in the subtitles while watching a video titled "XXXYY1." The area R1 is a predetermined area (corresponding to the first area) for adding the selected words. The first area is set for each video. Therefore, the area R1 is a predetermined area set for the video "XXXYY1." A word is added to the area R1 each time the user selects a word that appears in the subtitles while watching the video "XXXYY1." For example, when a user is watching the video "XXXYY1," a subtitle "This is a town of cobblestone streets" is displayed. If the user selects the word "cobblestone" from the subtitles while the subtitle "This is a town of cobblestone streets" is displayed, the word "cobblestone" is added to the area R1. The user may select a word while the video is being played back, or may select the word after pausing the video. Here, the selection of a word according to the embodiment will be described with reference to FIG.

[0030] FIG. 5 is a diagram illustrating an example of word selection according to the embodiment. Screen G1 is a display screen of the terminal device 10. The video of "XXXYY1" being viewed by a user is being played on screen G1, and the subtitle "This is a town of cobblestone streets" is displayed. While the subtitle "This is a town of cobblestone streets" is displayed, the user operates screen G1 to display a display window W1 on the screen, thereby selecting a word included in the display window W1. For example, a conventional image analysis processing technique may be used to identify words included in the display window W1, and the identified word is selected. Display window W1 is displayed, for example, by a user swiping their finger from position P1 to position P2 on the screen. In this example, "cobblestone," a word that is partly included in display window W1, is selected. The selected word "cobblestone" may be emphasized, for example, by enlarging the font only while the subtitle "This is a town of cobblestone streets" is displayed. Display frame W1 may be reset when "cobblestone" is selected, or when the subtitle "This is a town of cobblestone streets" disappears, or when the subtitle is displayed outside the subtitle due to a user error and no word is identified, or when multiple words are identified. When display frame W1 is reset, it disappears from the screen, allowing other display frames to be displayed on the screen. Note that, although an example has been described in which a word is selected by displaying a display frame on the screen, word selection in the embodiment may be performed by any method and is not particularly limited.

[0031] Returning to the description of FIG. 4, the addition of words to the first region according to the embodiment will now be described. For example, in the video of "XXXYY1" that a user is watching, if the subtitle "I will jump across red flagstones" is a subtitle that appears after the subtitle "This is a town of cobblestone streets," the subtitle "I will jump across red flagstones" will be displayed on the screen that the user is watching, and if the user selects the word "flagstones" from the subtitle "I will jump across red flagstones" while the subtitle "I will jump across red flagstones" is displayed, the word "flagstones" will be added to region R1 so that it is ordered after "cobblestone" within region R1. For example, if a user rewinds to display the subtitle "I will jump across red flagstones" and selects the word "flagstones," and then rewinds again to display the subtitle "This is a town of cobblestone streets" and selects the word "cobblestone," the word "cobblestone" will be added to region R1 so that the word "flagstones" appears last. In this way, regardless of the order in which the user displays the subtitles or selects the words, the order of the words added to the first region may be determined based on a subtitle display order predetermined for each video, or the order of the words added to the first region may be rearranged. Note that, if the selected word is a conjugated form of a base form (e.g., a singular form), such as when the user selects the word "flagstones" from the subtitle "I will jump across red flagstones," the selected word may be added to the first region as is, or the base form of the selected word may be added to the first region. In this case, the word "flagstones" may be added to the first region as "flagstone."

[0032] Also, if the video "XXXYY1" is a video consisting of multiple episodes and the subtitle "I will jump across red flagstones" is a subtitle that appears in a later episode than the subtitle "This is a town of cobblestone streets," then when the word "flagstones" is selected while the subtitle "I will jump across red flagstones" is displayed, the word "flagstones" is added to region R1 so that it appears after "cobblestone" in region R1. For example, if the subtitle "I will jump across red flagstones" is displayed while watching episode 2 of the video "XXXYY1" and the word "flagstones" is selected, the word "flagstones" is added to region R1 so that it appears after the word "cobblestone," which was selected from the subtitle "This is a town of cobblestone streets" that appeared while watching episode 1 of the video "XXXYY1." Therefore, for example, even if a user first watches episode 2 and selects the word "flagstones" from the subtitle "I will jump across red flagstones," and then watches episode 1 and selects the word "cobblestone" from the subtitle "This is a town of cobblestone streets," the word "cobblestone" will be added to region R1 so that the word "flagstones" appears later. In this way, the order of the words added to region R1 may be determined based on the order of the story in the video, or the order of the words added to region R1 may be rearranged.

[0033] Furthermore, area R2 is a predetermined area (corresponding to the second area) for adding subtitles displayed when a word is selected. The second area is set for each video corresponding to the first area. Therefore, area R2 is a predetermined area set for the video "XXXYY1." While a user is watching the video "XXXYY1," subtitles containing the word displayed on the screen at the time of selection are added to area R2 each time the user selects a word that appears in the subtitles. For example, while a user is watching the video "XXXYY1," the subtitle "This is a town of cobblestone streets" is displayed. By selecting the word "cobblestone" from the subtitles "This is a town of cobblestone streets" while the subtitles "This is a town of cobblestone streets" are displayed, the subtitle "This is a town of cobblestone streets" is added to area R2. Specifically, the subtitles are added to a predetermined area in area R2 that corresponds to the order of the word "cobblestone." Note that adding subtitles to the second region may be performed in response to adding words to the first region, or may be performed simultaneously with adding words to the first region. For example, in response to the order of the word "cobblestone" added to region R1, a subtitle "This is a town of cobblestone streets" may be added to a predetermined region in region R2 corresponding to the order of the word "cobblestone." Furthermore, for example, the word "cobblestone" may be added to a predetermined region in region R1 corresponding to the order of the word "cobblestone," and at the same time, a subtitle "This is a town of cobblestone streets" may be added to a predetermined region in region R2 corresponding to the order of the word "cobblestone."

[0034] However, in some cases, subtitles are displayed in multiple parts, such as when an utterance is long and the subtitle corresponding to the entire utterance does not fit on the screen. In such cases, a subtitle corresponding to the part of the utterance displayed on the screen when the word is selected is added. For example, if "This is" and "a town of cobblestone streets" are displayed separately in the video, selecting the word "cobblestone" from the subtitles for "a town of cobblestone streets" displayed on the screen will add the subtitle for "a town of cobblestone streets" to region R2. Note that subtitles are not limited to subtitles corresponding to parts of the utterance, and subtitles corresponding to the entire utterance, including the subtitles displayed on the screen when the word is selected, may be added. For example, if "This is" and "a town of cobblestone streets" are displayed separately in the video, selecting the word "cobblestone" from the subtitles for "a town of cobblestone streets" displayed on the screen may add the subtitle "This is a town of cobblestone streets" corresponding to the entire utterance. Note that when subtitles other than the subtitles displayed on the screen when a word was selected are combined and added to the subtitles displayed on the screen when a word was selected, the combined subtitles may be the subtitles immediately before the subtitles displayed on the screen when the word was selected, or the subtitles immediately after the subtitles displayed on the screen when the word was selected. In this way, the combined subtitles are not limited to the subtitles that have been displayed up until the video that the user has viewed, but may also be subtitles that will be displayed on the video that is to be viewed.

[0035] Furthermore, the subtitles displayed on the screen when a word is selected may consist of multiple sentences. For example, the subtitles displayed on the screen when the word "cobblestone" is selected may include at least part of a sentence including the word "cobblestone" as well as another sentence, such as "This is a town of cobblestone streets. This is." In such a case, the entire subtitles displayed on the screen when the word is selected may be added to region R2, or only a portion of the subtitles displayed on the screen when the word is selected that includes the selected word in the sentence may be added to region R2. For example, the entire subtitles displayed on the screen when the word is selected, "This is a town of cobblestone streets. This is," may be added to region R2, or only the subtitles displayed on the screen when the word is selected that includes the selected word in the sentence, "This is a town of cobblestone streets." may be added to region R2.

[0036] In addition, multiple subtitles may be displayed simultaneously in different positions on the screen, such as when characters speak simultaneously in a video. In such cases, only one subtitle containing the selected word may be added to region R2, or multiple subtitles that were displayed on the screen when the word was selected may be added to region R2.

[0037] In addition, there are cases where the subtitles displayed when a word is selected contain only a few words with a distinctive meaning other than the selected word. For example, when the word "cobblestone" is selected, the subtitles displayed on the screen may read "This is a cobblestone," which means that there are no words with a distinctive meaning other than "cobblestone." For example, "This" is a pronoun used in place of a noun, "is" is a verb that expresses the state of the subject, and "a" is an article that indicates the characteristics of a noun. Therefore, "This," "is," and "a" alone do not have a distinctive meaning. In such cases, a subtitle that combines the subtitles displayed on the screen before and after the word selection with the subtitles displayed on the screen before and after the word selection may be added to region R2. Alternatively, using conventional natural language processing technology, a subtitle that includes the selected word and is in line with the content of the speech when both subtitles were displayed may be generated based on the subtitles displayed on the screen before and after the word selection, and the generated subtitle may be added to region R2. For example, a subtitle such as "This is a cobblestone street" that combines multiple subtitles into one sentence may be generated based on the subtitle "This is a cobblestone" displayed on the screen when the word "cobblestone" is selected and the subtitle "This is a street" that is displayed after the subtitle "This is a cobblestone," and the subtitle "This is a cobblestone street" may then be added to region R2. Note that if the "This" in "This is a cobblestone" and the "This" in "This is a street" refer to different objects, using "This is a cobblestone street" would not be in line with the content of the speech when both subtitles are displayed. For this reason, a subtitle such as "This is a cobblestone street" may be generated if at least a portion of the video displayed on the screen when the word "cobblestone" is selected is included in the video displaying the subtitle "This is a street."

[0038] (Adding words, subtitles, and video images to the dictionary) Hereinafter, the dictionary according to the embodiment will be further described in detail with reference to FIG. 6. FIG. 6 is a diagram showing an example of a dictionary according to the embodiment. Dictionary D2 is a dictionary created by user U1 selecting words that appear in subtitles while watching a video titled "XXXYY1." Dictionary D2 is a dictionary in which video images displayed on the screen when words are selected are added to dictionary D1 shown in FIG. 4. Therefore, explanations similar to those for dictionary D1 will be omitted where appropriate.

[0039] Area R3 is a predetermined area (corresponding to the third area) for adding a video image displayed when a word is selected. Note that the third area is set for each video corresponding to the first area. Therefore, area R3 is a predetermined area set for the video of "XXXYY1." While a user is watching the video of "XXXYY1," a video image displayed on the screen at the time of selection is added to area R3 each time the user selects a word that appears in the subtitles. Note that a video image including the subtitles displayed when the word is selected may be added, or a video image excluding the subtitles displayed when the word is selected may be added. For example, if the subtitles and the video are stored separately and the subtitles are added when the video is played, the video image excluding the subtitles may be added by obtaining the video image excluding the subtitles displayed when the word was selected from an external information processing device or the like that provides the video to the user, or the video image including the subtitles may be added by taking a screenshot or the like of the screen displayed when the word was selected. Furthermore, for example, if subtitles are embedded in a video, the video without the subtitles may be added by acquiring the video without the subtitles displayed when the word was selected from an external information processing device or the like that stores the original video, or the video including the subtitles may be added by taking a screenshot of the screen displayed when the word was selected. In region R3, the video without the subtitles is added.

[0040] While a user is watching the video "XXXYY1," the subtitle "This is a town of cobblestone streets" is displayed. When the user selects the word "cobblestone" from the subtitle "This is a town of cobblestone streets" while the subtitle "This is a town of cobblestone streets" is displayed, the video image IM11 displayed on the screen when the word was selected is added to region R3. For example, the subtitle "This is a town of cobblestone streets" is added to region R2, and the video image IM11 displayed when the word "cobblestone" was selected is added to region R3. Specifically, the video images are added to a predetermined region in region R3 that corresponds to the order of the word "cobblestone." The video images may be added to the third region in response to the addition of the word to the first region, or may be added simultaneously with the addition of the word to the first region. For example, in accordance with the order in which the word "cobblestone" was added to region R1, the video image displayed when the word "cobblestone" was selected may be added to a predetermined region in region R3 corresponding to the order in which the word "cobblestone" was added. Furthermore, for example, the word "cobblestone" may be added to a predetermined region in region R1 corresponding to the order in which the word "cobblestone" was added, and the video image displayed when the word "cobblestone" was selected may be added to a predetermined region in region R3 corresponding to the order in which the word "cobblestone" was added.

[0041] Furthermore, if a user is watching a video of "XXXYY1" and a subtitle "This is a town of cobblestone streets" is displayed, and the user selects the word "cobblestone" from the subtitle "This is a town of cobblestone streets," an impressive video image from the scene in the video image displayed on the screen at the time of word selection may be added to region R3. For example, the start of the scene in the video image displayed on the screen at the time of word selection may be estimated from the subtitle displayed on the screen at the time of word selection and the subtitle displayed before the subtitle displayed on the screen at the time of word selection, and a distinctive video image may be added as an impressive video image from among the video images included in the range up to the estimated start of the scene. Note that, if information about the video scene can be acquired from an external information processing device, the information about the video scene may be acquired from the external information processing device, and the start of the scene or the entire range of the scene in the video image displayed on the screen at the time of word selection may be estimated based on the acquired information about the video scene. Then, a distinctive video image may be added from among the video images included in the range up to the estimated start of the scene or the entire range of the scene. For example, a video image including characteristic information different from other video images included in the range up to the start of the estimated scene or the range of the entire scene may be added. Furthermore, for example, a video image including at least one of the main characters of the video may be added. The main character of the video may be, for example, a character estimated to be the main character based on the characteristics of a character included in a video image included in the range up to the start of the estimated scene or the range of the entire scene, a character estimated to be the main character based on information about the subtitles of the video, or a character estimated to be the main character by acquiring information about the video from an external information processing device or the like. In this way, the method for estimating the main character of the video does not need to be particularly limited.Furthermore, since video images that are impressive to a user are often video images that include a character that matches the user's preferences, by acquiring user preference information from an external information processing device or the like (for example, appearance characteristics of the user's favorite character, such as body type, face shape, hairstyle, and hair color; characteristics of the costume worn by the user's favorite character; characteristics of the user's favorite character's speaking style; characteristics set for the user's favorite character, such as height, gender, age, personality, hobbies, special skills, and special abilities; and characteristics of other characters and costumes designed by the designer of the user's favorite character), a video image that includes at least the main character of the video video that best matches the user's preferences may be added based on the acquired user preference information. Furthermore, the most distinctive video image may be added from among the video images included in the range up to the start of the estimated scene or the range of the entire scene. For example, a video image in which the character that best matches the user's preferences is displayed largest on the screen may be added. Furthermore, when a user is watching the video "XXYY1", the subtitle "This is a town of cobblestone streets" is displayed, and by selecting the word "cobblestone" from the subtitle "This is a town of cobblestone streets" while the subtitle "This is a town of cobblestone streets" is displayed, the video image displayed on the screen when the word was selected may be added to area R3 along with an impressive video image from the scene in the video image displayed on the screen when the word was selected.

[0042] The subtitle information storage unit 122 stores information related to subtitles displayed in video moving images. FIG. 7 shows an example of the subtitle information storage unit 122 according to the embodiment. FIG. 7 is a diagram showing an example of the subtitle information storage unit 122 according to the embodiment. As shown in FIG. 7, the subtitle information storage unit 122 has items such as "video moving image ID" and "subtitles."

[0043] "Video ID" indicates identification information for identifying a video. "Subtitle" indicates the subtitles displayed in the video. In the example shown in FIG. 7, conceptual information such as "Subtitle #1" and "Subtitle #2" is stored in "Subtitle," but in reality, word information that makes up the subtitles (text information included in the subtitles) is stored for each subtitle.

[0044] That is, FIG. 7 shows an example in which the subtitles displayed in the video identified by the video ID "M1" are "subtitle #1", "subtitle #2", . . . "subtitle #N".

[0045] (control unit 130) The control unit 130 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or MPU (Micro Processing Unit) using RAM as a work area to execute various programs stored in a storage device inside the memory assistance device 100. The control unit 130 is also realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0046] 2, the control unit 130 has an acquisition unit 131, an extraction unit 132, a generation unit 133, an update unit 134, a display unit 135, and a proposal unit 136, and realizes or executes the information processing functions described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 2, and may be any other configuration that performs the information processing described below.

[0047] (Acquisition part 131) The acquisition unit 131 acquires various pieces of information from an external information processing device. For example, the acquisition unit 131 acquires various pieces of information from another information processing device such as the terminal device 10. The acquisition unit 131 also acquires various pieces of information from the storage unit 120. The acquisition unit 131 also stores the acquired various pieces of information in the storage unit 120.

[0048] The acquisition unit 131 acquires operation information when a user performs an operation on the screen while watching a video. For example, the acquisition unit 131 acquires information about a display frame that is displayed on the screen while the user is watching a video (for example, coordinate information indicating the position and size of the display frame on the screen). For example, the acquisition unit 131 acquires information about a display frame that is displayed by the user swiping with a finger.

[0049] The acquisition unit 131 acquires information about the video that the user is watching. For example, when the user selects a word by performing an operation on the screen while watching the video, the acquisition unit 131 acquires information about the video that the user is watching. For example, the acquisition unit 131 acquires information about the subtitles of the video that the user is watching. For example, when the user selects the word "cobblestone" from the displayed subtitles while watching the video "XXXYY1", the acquisition unit 131 may acquire information about the subtitles that were displayed on the screen when the word "cobblestone" was selected, or may acquire information about all the subtitles included in the video "XXXYY1". Furthermore, the acquisition unit 131 may determine whether the video currently being viewed by the user is a video primarily targeted at viewers who were born and raised in the same culture as the user (i.e., a video including audio spoken in the user's language), and perform a subtitle information acquisition process if it determines that the video is primarily targeted at viewers who were born and raised in the same culture as the user, and terminate the information processing without performing the subtitle information acquisition process if it determines that the video is not primarily targeted at viewers who were born and raised in the same culture as the user. Furthermore, the acquisition unit 131 may determine whether the video currently being viewed by the user is a video including subtitles translated into the user's language being studied, and perform a subtitle information acquisition process if it determines that the video is not a video including subtitles translated into the user's language being studied, and terminate the information processing without performing the subtitle information acquisition process if it determines that the video is not a video including subtitles translated into the user's language being studied.

[0050] (Extraction part 132) The extraction unit 132 extracts the word selected by the user and the subtitles displayed when the word was selected, based on the information acquired by the acquisition unit 131. For example, the extraction unit 132 extracts the word selected by the user from the subtitles displayed when the display frame is displayed, based on information about the display frame displayed on the screen and information about the subtitles displayed when the display frame is displayed. For example, the extraction unit 132 extracts a word that includes at least a part of the characters in the display frame as the word selected by the user. Also, for example, the extraction unit 132 extracts the subtitles displayed when the user selected the word. Specifically, the extraction unit 132 extracts the subtitles from which the word was extracted. For example, if a display frame displayed by a user's operation on the screen while the subtitle "This is a town of cobblestone streets" is displayed is most overlapped with the word "cobblestone," the extraction unit 132 extracts the word "cobblestone" and the subtitle "This is a town of cobblestone streets." In this case, the extraction unit 132 may extract from the subtitle information storage unit 122 the subtitles displayed when the user selected the word. For example, the extraction unit 132 may extract the subtitles displayed when the user selected the word by identifying subtitles including the word selected by the user from among the subtitles stored in the subtitle information storage unit 122 and corresponding to the video the user is watching. Furthermore, for example, the extraction unit 132 may extract the subtitles displayed when the user selected the word by comparing the timing of the user's word selection with the timing of subtitles being displayed in the video the user is watching. For example, if the user selected the word 1 minute and 2 seconds after the start of the video and the subtitle "subtitle #1" is displayed for 5 seconds 1 minute after the start of the video, the extraction unit 132 may estimate that the subtitle "subtitle #1" was the subtitle displayed when the user selected the word and extract the subtitle "subtitle #1" as the subtitle displayed when the user selected the word. Furthermore, the extraction unit 132 may extract the video image displayed when the user selected the word. For example, the extraction unit 132 may extract the captured video image by taking a screenshot or the like of the screen when the user selects a word.Furthermore, for example, the extraction unit 132 may acquire a video image displayed when the user selects a word from an external information processing device or the like. Furthermore, the extraction unit 132 may determine whether the video currently being viewed by the user is primarily targeted at viewers who were born and raised in the same culture as the user, and perform the extraction process if it determines that the video is primarily targeted at viewers who were born and raised in the same culture as the user. Alternatively, the extraction unit 132 may terminate the information processing without performing the extraction process if it determines that the video is not primarily targeted at viewers who were born and raised in the same culture as the user. Furthermore, the extraction unit 132 may determine whether the video currently being viewed by the user is primarily targeted at viewers who were born and raised in the same culture as the user, and perform the extraction process if it determines that the video is not primarily targeted at viewers who were born and raised in the same culture as the user. Alternatively, the extraction unit 132 may terminate the information processing without performing the extraction process if it determines that the video is not primarily targeted at viewers who were born and raised in the same culture as the user.

[0051] The extraction unit 132 may extract an impressive video image from among the scenes of the video image displayed when the user selected a word. For example, the extraction unit 132 estimates the start of a scene of the video image displayed on the screen when the user selected the word from subtitles displayed on the screen when the user selected the word and subtitles displayed before the subtitles displayed on the screen when the user selected the word. Then, the extraction unit 132 extracts an impressive video image from among the video images included in the range up to the start of the estimated scene. Also, for example, the extraction unit 132 may acquire information about a video scene from an external information processing device or the like, and estimate the start of a scene or the entire range of the scene based on the acquired information about the video scene. Then, the extraction unit 132 may extract an impressive video image from among the video images included in the range up to the start of the estimated scene or the entire range of the scene.

[0052] The extraction unit 132 may extract video images that include feature information different from other video images from among video images included in the range up to the start of the estimated scene or the entire range of the scene. Furthermore, the extraction unit 132 may extract video images that include at least one of the main characters of the video. For example, the extraction unit 132 may estimate a character that best matches the user's preferences from among the main characters of the video based on the user's preference information, and extract video images that include at least the estimated character in the video. For example, the extraction unit 132 may extract a video image in which the estimated character appears largest on the screen.

[0053] (Generation unit 133) The generation unit 133 adds the words extracted by the extraction unit 132 to a first area corresponding to the video being viewed by the user, and adds the subtitles extracted by the extraction unit 132 to a second area corresponding to the video being viewed by the user, thereby generating a dictionary that compiles words selected by the user for each video. In the example of Figure 4, the generation unit 133 generates dictionary D1 by adding the word "cobblestone" to the first area corresponding to the video "XXXYY1", and adding the subtitles "This is a town of cobblestone streets" to a predetermined area corresponding to the order of the word "cobblestone" in the second area corresponding to the video "XXXYY1". Furthermore, the generation unit 133 may generate a dictionary of words selected by the user for each video by adding the words extracted by the extraction unit 132 to a first region corresponding to the video currently being viewed by the user, the subtitles extracted by the extraction unit 132 to a second region corresponding to the video currently being viewed by the user, and the video images extracted by the extraction unit 132 to a third region corresponding to the video currently being viewed by the user. In the example of Figure 6, the generation unit 133 generates dictionary D2 by adding the word "cobblestone" to the first region corresponding to the video "XXXYY1", adding the subtitle "This is a town of cobblestone streets" to a predetermined region corresponding to the order of the word "cobblestone" in the second region corresponding to the video "XXXYY1", and adding video image IM11 to a predetermined region corresponding to the order of the word "cobblestone" in the third region corresponding to the video "XXXYY1".

[0054] (Updated part 134) The update unit 134, when adding words to the first area, updates the dictionary generated by the generation unit 133 by determining the order of words to be added to the first area based on the display order of subtitles predetermined for each video. Furthermore, the update unit 134 may update the dictionary generated by the generation unit 133 by rearranging the order of words added to the first area based on the display order of subtitles predetermined for each video. For example, the update unit 134 updates the dictionary when adding words to the first area so that the earlier the display order of subtitles to be added to the second area, the higher the word to be added to the first area will be displayed. Furthermore, for example, the update unit 134 updates the dictionary when adding words to the first area so that the earlier the episode in which the subtitles to be added to the second area appear, the higher the word to be added to the first area will be displayed.

[0055] (Display section 135) The display unit 135 displays the video images displayed when the user selected a word in an order corresponding to the order of the words updated by the update unit 134. For example, when the display unit 135 receives a video selection from a user, it acquires the video images added to the third area of ​​the dictionary generated corresponding to the selected video, and combines the acquired video images to generate an animation such as a slideshow, thereby displaying the video images displayed when the user selected a word. For example, in the video "XXXYY1," the subtitle "This is a town of cobblestone streets" is displayed before the subtitle "I will jump across red flagstones." Therefore, when the display unit 135 receives a selection of the video "XXXYY1" from a user, it generates an animation such as a slideshow so that the video image displayed when the word "cobblestone" was selected is displayed before the video image displayed when the word "flagstones" was selected. FIG. 8 illustrates an example of a user interface according to an embodiment.

[0056] Screen G2 is a display screen of terminal device 10. Screen G2 displays items L1 to LN, each representing a video or video for which user U1 has created a dictionary. For example, item L1 is an item representing a video or video of "XXXYY1," item L2 is an item representing a video or video of "XXXYY2," and item LN is an item representing a video or video of "XXXYYN." Screen G2 displays as many items as the number of videos for which user U1 has created a dictionary. For example, when display unit 135 receives an operation (e.g., a tap or a click) from user U1 to select item L1 on the screen, display unit 135 generates an animation that displays the video images in an order corresponding to the order of the words in area R1 using the video images added to area R3 of dictionary D2 generated corresponding to the video or video of "XXXYY1," and displays a screen for displaying the generated animation, thereby displaying the video images added to area R3. Furthermore, when the display unit 135 receives an operation from the user U1 to select item L2 on the screen, the display unit 135 generates an animation using the video images added to the third area of ​​the dictionary generated corresponding to the video of "XXXYY2" in an order corresponding to the order of words in the first area of ​​the dictionary generated corresponding to the video of "XXXYY2," and displays a screen for displaying the generated animation, thereby displaying the video images added to the third area of ​​the dictionary generated corresponding to the video of "XXXYY2." Note that the screen G2 is an example, and the manner in which the selection of video images is accepted is not particularly limited. For example, the user interface is not limited to a screen like the screen G2 in which the user selects a video image by selecting an item from a screen that lists the video images for which the dictionary was generated by the user, and the display unit 135 may accept the selection of video images using a user interface having items for displaying the video images in an animation for each dictionary generated by the user. For example, the display unit 135 may accept the selection of a video of "XXYY1" by manipulating the title of the work "XXYY1" (dictionary title) included in the dictionary D2, and may also accept the selection of a video of "XXYY2" by manipulating the title of the work "XXYY2" included in the dictionary generated in correspondence with the video of "XXYY2".

[0057] The display unit 135 may generate a video image in which the word added to the first area is superimposed on the video image added to the third area (for example, a video image excluding subtitles displayed when the word was selected), and combine the generated video images to generate an animation for displaying the video image. For example, when the display unit 135 receives a selection of a video image from a user, the display unit 135 extracts from the dictionary the words added to the first area of ​​the dictionary generated corresponding to the selected video image and the video images added to the third area, superimposes the corresponding words on each of the extracted video images to generate a video image on which the words are superimposed, and combines the generated video images to generate an animation for displaying the video image. Then, the display unit 135 displays an animation of the video image added to the third area, in which the word added to the first area when the video image was added to the third area is superimposed on the video image added to the third area. Using the example of FIG. 6, the display unit 135 generates an animation by combining a video image IM1 with the word "quintessentially" superimposed, a video image IM2 with the word "ventriloquism" superimposed, a video image IM11 with the word "cobblestone" superimposed, a video image IM3 with the word "battle-scarred" superimposed, and a video image IM4 with the word "flagstones" superimposed, starting with "quintessentially" and ending with "ventriloquism." An animation is displayed in the order of "quintessentially" on video image IM1, "cobblestone" on video image IM2, "battle-scarred" on video image IM11, "battle-scarred" on video image IM3, and "flagstones" on video image IM4.Furthermore, if the video image added to the third area is an impressive video image from a scene in the video image displayed when the word in the first area was selected, the display unit 135 may display an animated video image in which the word added to the first area is superimposed on the impressive video image from a scene in the video image displayed when the word in the first area was selected. Furthermore, if the terminal device 10 is a foldable smartphone (foldable smartphone) with a foldable display, the display unit 135 may display an animated video image added to the third area on one display screen separated by a fold (hinge), and may display an animated version of the word added to the first area on the other display screen corresponding to the animation of the video image.

[0058] The display unit 135 may generate a video image in which the subtitles added to the second area are superimposed on the video image added to the third area (for example, the video image excluding the subtitles displayed when the word was selected), and combine the generated video images to generate an animation for displaying the video image. For example, when the display unit 135 receives a selection of a video image from a user, the display unit 135 extracts from the dictionary the subtitles added to the second area of ​​the dictionary generated corresponding to the selected video image and the video image added to the third area, and generates a video image on which subtitles are superimposed by superimposing corresponding subtitles on each of the extracted video images, and combines the generated video images to generate an animation for displaying the video image. Then, the display unit 135 displays the video image in which the subtitles added to the second area when the video image was added to the third area are superimposed on the video image added to the third area as an animation.Using the example of FIG. 6, the display unit 135 displays a video image IM1 with a subtitle "quintessentially" superimposed on it, a video image IM2 with a subtitle "ventriloquism" superimposed on it, a video image IM11 with a subtitle "This is a town of cobblestone streets" superimposed on it, a video image IM3 with a subtitle "battle-scarred" superimposed on it, and a video image IM4 with a subtitle "I will jump across red" superimposed on it. An animation is generated by combining video images with the subtitle "quintessentially..." superimposed on it, and then displaying, in the order starting with "quintessentially," "ventriloquism," "cobblestone," "battle-scarred," and "flagstones," a video image with the subtitle "...quintessentially..." superimposed on video image IM1, a video image with the subtitle "...ventriloquism..." superimposed on video image IM2, a video image with the subtitle "This is a town of cobblestone streets" superimposed on video image IM11, a video image with the subtitle "...battle-scarred..." superimposed on video image IM3, and a video image with the subtitle "I will jump across red flagstones" superimposed on video image IM4 in the animation. Furthermore, if the video image added to the third area is an impressive video image from a scene in the video image displayed when the word in the first area was selected, the display unit 135 may display an animated video image in which the subtitles added to the second area are superimposed on the impressive video image from a scene in the video image displayed when the word in the first area was selected.Furthermore, when the terminal device 10 has a foldable display like a foldable smartphone, the display unit 135 may display an animated video image added to the third area on one of the display screens separated by the fold, and may display an animated subtitle added to the second area on the other display screen corresponding to the animation of the video image.

[0059] (Proposal Department 136) The suggestion unit 136 transmits information for suggesting, as candidates for generating a new dictionary, one or more video images that include, in subtitles, one or more words added to the first region of the dictionary selected in response to a predetermined user operation (e.g., an operation of selecting a dictionary, an operation of opening a dictionary, or an operation of adding a word to a dictionary). For example, when dictionary D1 (or dictionary D2) generated corresponding to the video image "XXXYY1" is selected, the suggestion unit 136 suggests a video image that includes, in subtitles, one or more words added to the region R1. For example, when the subtitles of the video image "XXXYY10" include the word "cobblestone" added to the region R1, the suggestion unit 136 suggests the video image "XXXYY10" as a candidate. Furthermore, the suggestion unit 136 may preferentially suggest video images that include, in subtitles, a greater number of words added to the first region. For example, in a case where a video "XXXXXYY11" whose subtitles include only the word "cobblestone" added to region R1, and a video "XXXXXYY12" whose subtitles include multiple words, "cobblestone" and "flagstones" added to region R1, are available as candidates, the suggestion unit 136 preferentially suggests the video "XXXXXYY12" over the video "XXXXXYY11". Furthermore, when the same word added to region 1 appears in multiple subtitles of the video, the suggestion unit 136 may determine the priority of the candidates based on the number of words appearing in the subtitles, counting the number of times the same word appears in multiple subtitles. Furthermore, when the same word added to region 1 appears in multiple subtitles of the video, the suggestion unit 136 may determine the priority of the candidates based on the number of types of words appearing in the subtitles, not counting the number of times the same word appears in multiple subtitles.

[0060] The suggestion unit 136 may transmit information for suggesting, as candidates for generating a new dictionary, one or more video clips whose subtitles include one or more words added to the first region of the dictionary selected in response to a predetermined user operation and whose characteristics are similar to those of the video clip corresponding to the selected dictionary. For example, when the dictionary D1 (or dictionary D2) generated for the video clip "XXXYY1" is selected, the suggestion unit 136 suggests a video clip whose subtitles include one or more words added to the region R1 and whose characteristics are similar to those of the video clip "XXXYY1". For example, the suggestion unit 136 suggests a video clip whose main character has characteristics similar to those of one of the main characters in the video clip "XXXYY1", based on the characteristics of the main character in the video clip "XXXYY1". The suggestion unit 136 may estimate the characteristics of the main character of the video clip based on information about the subtitles of the video clip, or may estimate the characteristics by acquiring information about the video clip from an external information processing device or the like. For example, the suggestion unit 136 may estimate the characteristics of the main character of the selected video of "XXYY1" based on information related to the subtitles of the video of "XXYY1", or may estimate the characteristics by acquiring information related to the video of "XXYY1" from an external information processing device, etc. Furthermore, for example, the suggestion unit 136 may estimate the characteristics of the main character of the selected video of "XXYY1" based on the video image added to region R3.

[0061] The suggestion unit 136 may transmit information for suggesting, as candidates for generating a new dictionary, one or more videos whose subtitles include one or more words added to the first region of the dictionary selected in response to a predetermined operation by the user and whose characteristics are similar to those of videos corresponding to other dictionaries other than the selected dictionary. For example, when the dictionary D1 (or dictionary D2) generated for the video "XXXYY1" is selected, the suggestion unit 136 suggests videos whose subtitles include one or more words added to the region R1 and whose characteristics are similar to those of the other videos "XXXYY2" to "XXXYYN" for which the user U1 generated dictionaries. For example, the suggestion unit 136 suggests videos whose main characters include a character whose characteristics are similar to those of one of the main characters of the video "XXXYY2" based on the characteristics of the main character of the video "XXXYY2." Furthermore, for example, the suggestion unit 136 may suggest video videos including a main character whose characteristics are similar to the characteristics of one of the main characters of the video videos "XXXYY2" and "XXXYY3" based on the characteristics of the main character of the video video "XXXYY2" and the characteristics of the main character of the video video "XXXYY3." Furthermore, for example, the suggestion unit 136 may suggest video videos including a main character whose characteristics are in line with the preferences of user U1 by estimating preference information of the character of user U1 based on the characteristics of the main character of the video videos "XXXYY2" to "XXXYYN."

[0062] <1.4. Information processing flow> Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described with reference to Fig. 9 to Fig. 11. Fig. 9 to Fig. 11 are flowcharts showing the procedure of information processing by the information processing system 1 according to the embodiment.

[0063] As shown in FIG. 9, when a user selects a word from displayed subtitles while watching a video, the memory assistance device 100 extracts the word selected by the user and the subtitles that were displayed when the user selected the word (step S101).

[0064] The memory assistance device 100 adds the extracted words to a first area of ​​a dictionary generated corresponding to the video video being viewed by the user, so that the earlier the extracted subtitles are displayed, the higher they will be ranked among the subtitles displayed in the video video being viewed by the user, and updates the dictionary by adding the extracted subtitles to a second area of ​​the dictionary generated corresponding to the video video being viewed by the user (step S102).

[0065] As shown in FIG. 10, when the memory assistance device 100 receives a video selection from a user, it acquires a video image added to the third area of ​​the dictionary generated in accordance with the video selected by the user (step S201).

[0066] The memory assistance device 100 generates an animation by combining the acquired video images, thereby displaying the video images added to the third area of ​​the dictionary generated in accordance with the video motion picture selected by the user as an animation (step S202).

[0067] As shown in FIG. 11, the memory assistance device 100 acquires information about words added to the first area of ​​the dictionary selected in response to a predetermined operation by the user (step S301).

[0068] Based on the information about the acquired words, the memory assistance device 100 transmits information for proposing one or more video videos that include in their subtitles one or more of the words added to the first area of ​​the selected dictionary as candidates for generating a new dictionary (step S302).

[0069] <1.5. Modifications> The information processing system 1 according to the embodiment described above may be implemented in various different forms other than the above embodiment, so other embodiments of the information processing system 1 will be described below.

[0070] (Variation 1: Update the dictionary by specifying a word in the first area) In the above embodiment, when a user selects a word from displayed subtitles while watching a video, the extraction unit 132 extracts the subtitles displayed at the time of word selection along with the word selected by the user. Here, after the user watches a video, the extraction unit 132 may extract subtitles including the specified word from subtitles predetermined for each video by specifying (for example, by inputting or selecting) the word displayed while the user was watching the video in a first area included in a dictionary corresponding to the video watched by the user. For example, the extraction unit 132 may extract the subtitle "This is a town of cobblestone streets" containing the word "cobblestone" from the subtitles predetermined for the video "XXYY1" by having the user memorize the word "cobblestone" (or the user makes a note of the word "cobblestone") while watching the video "XXYY1" and then, after watching the video "XXYY1", specifying the word "cobblestone" in area R1 of dictionary D1 (or dictionary D2) corresponding to the video "XXYY1".

[0071] FIG. 12 is an explanatory diagram for explaining information processing according to Modification 1. Dictionary D3 is a dictionary corresponding to dictionary D1 shown in FIG. 4. Therefore, explanations similar to those for dictionary D1 will be omitted as appropriate. The update unit 134 updates dictionary D3 by adding the subtitle "This is a town of cobblestone streets" to region R12 of region R2, corresponding to region R11 in region R1 where the word "cobblestone" is specified. Then, the update unit 134 updates dictionary D3 by adding the subtitle "This is a town of cobblestone streets" to a predetermined region in region R2 corresponding to the order of the word "cobblestone" in region R1, which is determined based on the display order of subtitles displayed in the video video "XXXXYY1". For example, based on the display order of subtitles displayed in the video video of "XXYY1", if the subtitle "This is a town of cobblestone streets" added to area R12 corresponding to the word "cobblestone" specified in area R11 is displayed earlier than the subtitle "...marksmanship..." already added to area R2 corresponding to the word "marksmanship" already added to area R1, the update unit 134 updates dictionary D3 by swapping the order of the word "cobblestone" and the order of the word "marksmanship" in area R1 and the order of the subtitle "This is a town of cobblestone streets" and the subtitle "...marksmanship..." in area R2. In this way, the update unit 134 updates the dictionary D3 based on the relationship between the display order of the subtitles "This is a town of cobblestone streets" added to area R12 in response to the word "cobblestone" specified in area R11, and the subtitles already added to area R2 in response to each word already added to area R1.At this time, the update unit 134 may update the dictionary D3 by repeating the process of changing the order of each word already added to the region R1 (or each subtitle already added to the region R2), or may update the dictionary D3 by determining the order of the word "cobblestone" in the region R1 and the order of the subtitle "This is a town of cobblestone streets" in the region R2. Also, in the first modification, the region R2 may be a predetermined region that is set so that, when a word is specified in a predetermined region of the region R1, the subtitle corresponding to the specified word is added to a predetermined region of the region R2 according to the order of the specified word.

[0072] (Variation 2: Automatically generate a dictionary of the videos watched by the user using a commercially available dictionary) In the above embodiment, when a user selects a word from displayed subtitles while watching a video, the extraction unit 132 extracts the subtitles displayed at the time of word selection along with the selected word. Furthermore, in Modification 1, the extraction unit 132 extracts subtitles containing the specified word from subtitles predefined for each video by specifying a word displayed while the user is watching the video in a first area included in a dictionary corresponding to the video viewed by the user. Here, if a word (hereinafter referred to as "learning word") included in a commercially available dictionary predefined by the user (e.g., a dictionary for qualification exams, textbooks) appears in the predefined subtitles for the video selected by the user, the extraction unit 132 may extract subtitles displaying a target learning word for each learning word along with the learning word that appears. For example, the extraction unit 132 extracts subtitles displaying the target learning word for each learning word from subtitles predefined for the video selected by the user. If the user specifies multiple commercially available dictionaries, the extraction unit 132 may extract training words included in at least one of the specified multiple commercially available dictionaries. Furthermore, the extraction unit 132 may extract training words and subtitles if the training words are words included in subtitles corresponding to the speech of a character that matches the user's preferences. Furthermore, if the training words are not words included in subtitles corresponding to the speech of a character that matches the user's preferences (in other words, if the training words are words included in subtitles corresponding to the speech of a character that does not match the user's preferences), the extraction unit 132 may not extract training words and subtitles. Then, the generation unit 133 automatically generates a dictionary corresponding to the video watched by the user by adding the target training words to a first area corresponding to the video selected by the user when the user watches the video, and adding subtitles displaying the target training words to a second area corresponding to the video selected by the user when the user watches the video.Furthermore, when a word not included in a commercially available dictionary designated by the user appears in predetermined subtitles for a video selected by a user after the user watches the video, the extraction unit 132 may extract subtitles in which the word not included in the commercially available dictionary designated by the user is displayed together with the word not included in the commercially available dictionary designated by the user. For example, when a user designates multiple commercially available dictionaries and words not included in the multiple commercially available dictionaries appear in the subtitles, the extraction unit 132 may extract the words and the subtitles.

[0073] (Variation 3: Creating a dictionary in which synonyms of words added to the first area are added to the fourth area (Part 1)) In the above embodiment, the generation unit 133 adds the words extracted by the extraction unit 132 to a first area corresponding to the video currently being viewed by the user, and adds the subtitles extracted by the extraction unit 132 to a second area corresponding to the video currently being viewed by the user, thereby generating a dictionary that compiles words selected by the user for each video (see FIG. 4). Also, in the above embodiment, the generation unit 133 adds the words extracted by the extraction unit 132 to a first area corresponding to the video currently being viewed by the user, adds the subtitles extracted by the extraction unit 132 to a second area corresponding to the video currently being viewed by the user, and adds the video images extracted by the extraction unit 132 to a third area corresponding to the video currently being viewed by the user, thereby generating a dictionary that compiles words selected by the user for each video (see FIG. 6). Here, if a synonym of the word extracted by the extraction unit 132 appears in a commercially available dictionary designated in advance by the user, the generation unit 133 may add the synonym of the word extracted by the extraction unit 132 to a predetermined area (hereinafter referred to as the "fourth area" as appropriate) corresponding to the video being viewed by the user, thereby generating a dictionary that compiles words selected by the user for each video. Here, the fourth area is a predetermined area for adding synonyms of the word added to the first area. Note that the fourth area is set for each video corresponding to the first area. The synonym of the word added to the first area is added to the fourth area only if the synonym of the word added to the first area appears in a commercially available dictionary designated in advance. Specifically, the synonym is added to a predetermined area of ​​the fourth area corresponding to the order in which the word was added to the first area. Furthermore, if the synonym of the word added to the first area does not appear in the commercially available dictionary designated in advance, the predetermined area of ​​the fourth area corresponding to the order in which the word was added to the first area is left blank.

[0074] The generation unit 133 adds the words extracted by the extraction unit 132 to a first area corresponding to the video currently being watched by the user, adds the subtitles extracted by the extraction unit 132 to a second area corresponding to the video currently being watched by the user, and adds synonyms of the words extracted by the extraction unit 132 to a fourth area corresponding to the video currently being watched by the user, thereby generating a dictionary that compiles words selected by the user for each video. The generation unit 133 may also generate a dictionary that compiles words selected by the user for each video by adding the words extracted by the extraction unit 132 to the first area corresponding to the video currently being watched by the user, adds the subtitles extracted by the extraction unit 132 to the second area corresponding to the video currently being watched by the user, adds the video images extracted by the extraction unit 132 to a third area corresponding to the video currently being watched by the user, and adds synonyms of the words extracted by the extraction unit 132 to a fourth area corresponding to the video currently being watched by the user. The synonyms added to the fourth area are not limited to words that are highly related to the words added to the first area. For example, when the word “quintessential” is extracted by the extraction unit 132 and the words “typical” and “ultimate” that are highly related to the word “quintessential” are included in a pre-specified commercially available dictionary, the generation unit 133 may generate a dictionary by adding the word “quintessential” to the first area and adding the words “typical” and “ultimate” to the fourth area. Alternatively, when the words “classic” and “ideal” that are somewhat highly related to the word “quintessential” are included in a pre-specified commercially available dictionary, the generation unit 133 may generate a dictionary by adding the word “quintessential” to the first area and adding the words “classic” and “ideal” to the fourth area. Note that when all of the words “typical,” “ultimate,” “classic,” and “ideal” are included in a pre-specified commercially available dictionary, the generation unit 133 may select any word to be added to the fourth area as a synonym of “quintessential.” Furthermore, the degree of association between the synonyms added to the fourth area and the words added to the first area may be adjusted by the user as appropriate.For example, if the user sets the synonyms to be added to the fourth area to "only highly related words," the generation unit 133 may select the words to be added to the fourth area by selecting "typical" and "ultimate" from among the words "typical," "ultimate," "classic," and "ideal" as candidates for synonyms to be added to the fourth area; if the user sets the synonyms to be added to the fourth area to "including slightly related words," the generation unit 133 may select all of the words "typical," "ultimate," "classic," and "ideal" as candidates for synonyms to be added to the fourth area.

[0075] (Variation 4: Creating a dictionary by adding synonyms of words added to the first area to the fourth area (Part 2)) In the third modification, the generation unit 133 generates a dictionary of words selected by the user for each video by adding a synonym of the word extracted by the extraction unit 132 to a fourth area corresponding to the video being watched by the user if the synonym of the word extracted by the extraction unit 132 appears in a commercially available dictionary designated by the user in advance. The fourth area is also added with a synonym of the word added to the first area only if the synonym of the word added to the first area appears in a commercially available dictionary designated in advance, and is left blank if the synonym of the word added to the first area does not appear in the commercially available dictionary designated in advance. However, the case where a synonym is added to the fourth area is not limited to the case where the synonym of the word extracted by the extraction unit 132 appears in a commercially available dictionary designated in advance by the user. The generation unit 133 may obtain synonyms of the words extracted by the extraction unit 132 from an external information processing device or the like that manages a predetermined site (for example, Non-Patent Document 1 below) that provides a service that allows searching for synonyms (for example, a service that, when a search is performed by specifying a word, provides search results such as information on words that are semantically related to the specified word (for example, words that are similar or inclusive to the specified word)).

[0076] [Non-Patent Document 1] Dictionary.com, LLC “Thesaurus.com”, [online], [Searched on February 22, 2020], Internet<https: / / www.thesaurus.com>

[0077] The generation unit 133 may send information about the word extracted by the extraction unit 132 to such an external information processing device, etc., and the external information processing device, etc. that receives the information about the word may search for synonyms using its own database and send the search results of the synonyms to the memory assistance device 100, thereby adding synonyms of the word extracted by the extraction unit 132 to the fourth area based on the search results acquired from the external information processing device, etc. For example, if the word extracted by the extraction unit 132 is "quintessential," the generation unit 133 may add to the fourth area synonyms of the word "quintessential" selected from the words acquired as a search result for synonyms of the word "quintessential." For example, if the generation unit 133 obtains, as a search result for synonyms of the word “quintessential,” the words “typical” and “ultimate,” which are highly related to the word “quintessential,” and the words “classic” and “ideal,” which are somewhat highly related to the word “quintessential,” the generation unit 133 may select a word to be added to the fourth area from among the words “typical,” “ultimate,” “classic,” and “ideal,” and add the selected word to the fourth area as a synonym of the word “quintessential.” In this case, if any word satisfying a predetermined condition is found among the words obtained as a search result for synonyms of the word “quintessential,” the generation unit 133 may select a word to be added to the fourth area from among the words satisfying the predetermined condition. Various conditions for selecting a word that may be a candidate to be added to the fourth area from among the words obtained as a search result for synonyms of the word extracted by the extraction unit 132 will be described below.

[0078] The generation unit 133 determines whether or not any of the words obtained as a search result for synonyms of the words extracted by the extraction unit 132 already appears in a dictionary for the user generated in response to the video the user is watching (for example, a word already included in the first or fourth area of ​​the dictionary), and if it determines that any of the words already appear in the dictionary for the user generated in response to the video the user is watching, the generation unit 133 may preferentially select the already appearing word as the word to be added to the fourth area. In this case, for example, if there are multiple words that have already appeared, the generation unit 133 determines whether or not there is a word among the multiple words that have already appeared, the word being spoken by the character who is the speaker of the subtitles of the word extracted by the extraction unit 132 and the character being spoken by the character who is the speaker of the subtitles added to the second area, and if it is determined that there is a word being spoken by the character who is the speaker of the subtitles of the word extracted by the extraction unit 132 and the character being spoken by the character who is the speaker of the subtitles added to the second area, it may select such a word (a word being spoken by the same character) as a word to be added to the fourth area with priority (note that if it is determined that there is no such word, the generation unit 133 may decide to use another process to select a word to be added to the fourth area with priority). Furthermore, for example, when there are a plurality of words that have already appeared, the generation unit 133 determines whether or not there is a word among the plurality of words that have already appeared that has similar characteristics to the characteristics of the character who is the speaker of the subtitles of the words extracted by the extraction unit 132 (which may include characteristics of the clothing worn by the character) and the characteristics of the character who is the speaker of the subtitles added to the second area, and if it is determined that there is a word that has similar characteristics to the characteristics of the character who is the speaker of the subtitles of the words extracted by the extraction unit 132 and the characteristics of the character who is the speaker of the subtitles added to the second area, it may select such a word (a word spoken by a character with characteristics similar to the characteristics of the character who is the speaker) as a word to be added to the fourth area with priority (note that, if it is determined that there is no such word, the generation unit 133 may decide to use another process to select a word to be added to the fourth area with priority).Furthermore, for example, if there are multiple words that have already appeared, the generation unit 133 may determine whether or not there is a word selected from subtitles corresponding to the speech of the main character of the video that the user is watching among the multiple words that have already appeared, and if it determines that there is a word selected from subtitles corresponding to the speech of the main character of the video that the user is watching, it may select such a word (a word whose speaker is the main character of the video that the user is watching) as a word to be preferentially added to the fourth area (note that if it determines that there is no such word, the generation unit 133 may decide to use another process to select a word to be preferentially added to the fourth area). Furthermore, for example, if there are multiple words that have already appeared, the generation unit 133 may determine whether or not there is a word selected from subtitles corresponding to the speech of a character with characteristics that are presumed to be characteristics of a character that are in line with the user's preferences among the multiple words that have already appeared, and if it is determined that there is a word selected from subtitles corresponding to the speech of a character with characteristics that are presumed to be characteristics of a character that are in line with the user's preferences, it may select such a word (a word in which the character who is speaking is a character with characteristics that are in line with the user's preferences) as a word to be preferentially added to the fourth area (note that if it is determined that there is no such word, the generation unit 133 may decide to use another process to select a word to be preferentially added to the fourth area).

[0079] The generation unit 133 may determine whether or not any of the words acquired as a search result for synonyms of the words extracted by the extraction unit 132 already appears in a dictionary for the user generated for the video currently being viewed by the user, and if it is determined that there is no word already appearing in the dictionary for the user generated for the video currently being viewed by the user, it may further determine whether or not there is any word already appearing in another dictionary generated for the user. If it is determined that there is a word already appearing in another dictionary generated for the user, the generation unit 133 may preferentially select the already appearing word as a word to be added to the fourth area. In this case, for example, if there are multiple words that have already appeared in the other dictionary, the generation unit 133 determines whether or not there is a word among the multiple words that have already appeared that has similar characteristics to the characteristics of the character who is the speaker of the subtitles for the word extracted by the extraction unit 132 (which may include characteristics of the clothing worn by the character) and the characteristics of the character who is the speaker of the subtitles added to the second area of ​​the other dictionary, and if it is determined that there is a word that has similar characteristics to the characteristics of the character who is the speaker of the subtitles for the word extracted by the extraction unit 132 and the characteristics of the character who is the speaker of the subtitles added to the second area of ​​the other dictionary, it may select such a word as a word to be preferentially added to the fourth area (note that if it is determined that there is no such word, the generation unit 133 may decide to use another process to select a word to be preferentially added to the fourth area).Furthermore, for example, when there are multiple words that have already appeared in another dictionary, the generation unit 133 determines whether or not there is a word among the multiple words that have already appeared that has similar characteristics to the characteristics of the video in which a character who is the speaker of the subtitles of the word extracted by the extraction unit 132 appears (i.e., the video being watched by the user) and the characteristics of the video in which a character who is the speaker of the subtitles added to the second area of ​​the other dictionary appears (i.e., the video corresponding to the other dictionary).If it is determined that there is a word in which the characteristics of the video in which a character who is the speaker of the subtitles of the word extracted by the extraction unit 132 appears and the characteristics of the video in which a character who is the speaker of the subtitles added to the second area of ​​the other dictionary appears, the generation unit 133 may select such a word (a word spoken by a character who appears in a video with characteristics similar to the characteristics of the video in which the character who is the speaker appears) as a word to be preferentially added to the fourth area (note that, if it is determined that there is no such word, the generation unit 133 may decide to select a word to be preferentially added to the fourth area using another process). Also, for example, if there are multiple words that have already appeared in another dictionary, the generation unit 133 may determine whether or not there is a word selected from subtitles corresponding to the speech of the main character of the video corresponding to the other dictionary among the multiple words that have already appeared, and if it determines that there is a word selected from subtitles corresponding to the speech of the main character of the video corresponding to the other dictionary, it may select such a word (a word whose speaker is the main character of the video corresponding to the other dictionary) as a word to be preferentially added to the fourth area (note that if it determines that there is no such word, the generation unit 133 may decide to use another process to select a word to be preferentially added to the fourth area).Furthermore, for example, when there are multiple words that have already appeared in another dictionary, the generation unit 133 may determine whether or not there is a word selected from subtitles corresponding to the speech of a character with characteristics that are presumed to be in line with the user's preferences among the multiple words that have already appeared, and if it is determined that there is a word selected from subtitles corresponding to the speech of a character with characteristics that are presumed to be in line with the user's preferences, it may select such a word as a word to be preferentially added to the fourth area (note that, if it is determined that there is no such word, the generation unit 133 may decide to use another process to select a word to be preferentially added to the fourth area). Also, for example, if there are multiple words that already appear in another dictionary, the generation unit 133 may determine whether or not there is a word selected from the subtitles of a video with characteristics that are estimated to be characteristics of a video that matches the user's preferences among the multiple words that already appear, and if it determines that there is a word selected from the subtitles of a video with characteristics that are estimated to be characteristics of a video that matches the user's preferences, it may select such a word (a word in which the character speaking is a character that appears in a video with characteristics that match the user's preferences) as a word to be preferentially added to the fourth area (note that if the generation unit 133 determines that there is no such word, it may decide to select a word to be preferentially added to the fourth area using another process).

[0080] The generation unit 133 determines whether or not any of the words obtained as a search result for synonyms of the word extracted by the extraction unit 132 already appears in a dictionary for the user generated in accordance with the video the user is watching. If it determines that there is no word that already appears in the dictionary for the user generated in accordance with the video the user is watching, the generation unit 133 may further determine whether or not there is any word that already appears in other dictionaries generated for the user. If it determines that there is no word that already appears in other dictionaries generated for the user, the generation unit 133 may decide to preferentially select words to be added to the fourth area using dictionaries generated for other users (for example, other users who generated dictionaries from the video the user is watching, other users whose list of video is similar to that of the user, other users whose attributes, learning goals, purchasing history, posting history, or browsing history are similar to that of the user, etc.). For example, the generation unit 133 may determine whether or not any of the words obtained as a search result for synonyms of the word extracted by the extraction unit 132 already appears in the dictionary generated for another user (for example, a word already included in the first or fourth area of ​​the dictionary generated for another user), and if it determines that any of the words already appear in the dictionary generated for another user, it may preferentially select the word that already appears as the word to be added to the fourth area. In this case, for example, if there are multiple words that have already appeared in the dictionary of the other user, the generation unit 133 determines whether or not there is a word among the multiple words that have already appeared, in which the character who is the speaker of the subtitles for the word extracted by the extraction unit 132 is the same character as the character who is the speaker of the subtitles added to the second area of ​​the dictionary of the other user.If it is determined that there is a word in which the character who is the speaker of the subtitles for the word extracted by the extraction unit 132 is the same character as the character who is the speaker of the subtitles added to the second area of ​​the dictionary of the other user, the generation unit 133 may select such a word with priority as a word to be added to the fourth area (note that if it is determined that there is no such word, the generation unit 133 may decide to use another process to select a word to be added to the fourth area with priority).Furthermore, for example, when there are multiple words that have already appeared in the dictionary of another user, the generation unit 133 determines whether or not there is a word among the multiple words that have already appeared that has similar characteristics to the characteristics of the character who is the speaker of the subtitles of the word extracted by the extraction unit 132 (which may include characteristics of the clothing worn by the character) and the characteristics of the character who is the speaker of the subtitles added to the second area of ​​the dictionary of the other user.If it is determined that there is a word that has similar characteristics to the characteristics of the character who is the speaker of the subtitles of the word extracted by the extraction unit 132 and the characteristics of the character who is the speaker of the subtitles added to the second area of ​​the dictionary of the other user, the generation unit 133 may select such a word as a word to be preferentially added to the fourth area (note that, if it is determined that there is no such word, the generation unit 133 may decide to use another process to select a word to be preferentially added to the fourth area). Furthermore, for example, when there are multiple words that have already appeared in the dictionary of another user, the generation unit 133 determines whether or not there is a word among the multiple words that have already appeared that has similar characteristics to the characteristics of the video in which a character who is the speaker of the subtitles of the word extracted by the extraction unit 132 appears (i.e., the video being watched by the user) and the characteristics of the video in which a character who is the speaker of the subtitles added to the second area of ​​the dictionary of the other user appears (i.e., the video corresponding to the dictionary of the other user).If it is determined that there is a word in which the characteristics of the video in which a character who is the speaker of the subtitles of the word extracted by the extraction unit 132 appears and the characteristics of the video in which a character who is the speaker of the subtitles added to the second area of ​​the dictionary of the other user appears, the generation unit 133 may select such a word as a word to be preferentially added to the fourth area (note that, if it determines that there is no such word, the generation unit 133 may decide to select a word to be preferentially added to the fourth area using another process).Also, for example, if there are multiple words that already appear in the dictionary of another user, the generation unit 133 may determine whether or not there is a word selected from subtitles corresponding to the speech of the main character of the video corresponding to the dictionary of the other user among the multiple words that already appear, and if it determines that there is a word selected from subtitles corresponding to the speech of the main character of the video corresponding to the dictionary of the other user, it may select such a word (a word whose speaker is the main character of the video corresponding to the dictionary of the other user) as a word to be preferentially added to the fourth area (note that if it determines that there is no such word, the generation unit 133 may decide to use another process to select a word to be preferentially added to the fourth area). Furthermore, for example, when there are multiple words that have already appeared in the dictionary of another user, the generation unit 133 determines whether or not there is a word selected from subtitles corresponding to the speech of a character with characteristics that are presumed to be characteristics of a character that are in line with the preferences of the user or another user among the multiple words that have already appeared, and if it is determined that there is a word selected from subtitles corresponding to the speech of a character with characteristics that are presumed to be characteristics of a character that are in line with the preferences of the user or another user, it may select such a word (a word in which the character that is speaking is a character with characteristics that are in line with the preferences of the user or another user) as a word to be preferentially added to the fourth area (note that, if it is determined that there is no such word, the generation unit 133 may decide to use another process to select a word to be preferentially added to the fourth area).Also, for example, if there are multiple words that already appear in the dictionary of another user, the generation unit 133 may determine whether or not there is a word selected from the subtitles of a video with characteristics that are estimated to be characteristics of a video that is in line with the preferences of the user or another user among the multiple words that already appear, and if it determines that there is a word selected from the subtitles of a video with characteristics that are estimated to be characteristics of a video that is in line with the preferences of the user or another user, it may select such a word (a word in which the character speaking is a character that appears in a video with characteristics that are in line with the preferences of the user or another user) as a word to be preferentially added to the fourth area (note that if the generation unit 133 determines that there is no such word, it may decide to select a word to be preferentially added to the fourth area using another process). Furthermore, the generation unit 133 determines whether or not any of the words obtained as a search result for synonyms of the word extracted by the extraction unit 132 already appears in a dictionary for the user generated in response to the video the user is watching, and if it determines that there is no word that already appears in the dictionary for the user generated in response to the video the user is watching, it further determines whether or not there is any word that already appears in other dictionaries generated for the user, and if it determines that there is no word that already appears in other dictionaries generated for the user, it may leave a predetermined area (a predetermined area of ​​the fourth area) for adding synonyms of the word extracted by the extraction unit 132 blank.

[0081] (Variation 5: Generate a dictionary corresponding to a video different from the video currently being viewed) In the above embodiment, the generation unit 133 adds the words extracted by the extraction unit 132 to a first area corresponding to the video currently being viewed by the user, and adds the subtitles extracted by the extraction unit 132 to a second area corresponding to the video currently being viewed by the user, thereby generating a dictionary corresponding to the video currently being viewed by the user. However, there may be cases where a character appearing in another video appears in one video. For example, there may be cases where a character appearing in a video different from the video of "XXXXXYY99", such as a character appearing in the video of "XXXXXYY97" or a character appearing in the video of "XXXXXYY98", appears in the video of "XXXXXYY99". In this case, the characters appearing in the video of "XXYY99" may include characters appearing in the video of "XXYY99" and characters appearing in a video different from the video of "XXYY99" (for example, characters appearing in the video of "XXYY97" and characters appearing in the video of "XXYY98"), or may include only characters appearing in a video different from the video of "XXYY99".

[0082] If the character who speaks the subtitles of the word extracted by the extraction unit 132 is a character who also appears in a video other than the video currently being viewed by the user, the generation unit 133 may add the word extracted by the extraction unit 132 to a first area corresponding to the other video (the video other than the video currently being viewed by the user) in which the character who speaks the subtitles of the word appears, and add the subtitles extracted by the extraction unit 132 to a second area corresponding to the other video, thereby generating a dictionary that compiles words selected by the user for each video. For example, when a user selects a word from the displayed subtitles while watching the video of "XXYY99", and the character who speaks the subtitles of the selected word is a character who also appears in the video of "XXYY97", the generation unit 133 may add the selected word to a first area corresponding to the video of "XXYY97" and add the subtitle of the selected word to a second area corresponding to the video of "XXYY97", thereby generating a dictionary corresponding to the video of "XXYY97" (and a dictionary corresponding to the video of "XXYY99"). Furthermore, for example, when a user selects a word from the displayed subtitles while watching the video "XXXYY99", and the character who is the speaker of the subtitles for the selected word is a character who also appears in the video "XXXYY97", the generation unit 133 may add the selected word to both the first area corresponding to the video "XXXYY97" and the first area corresponding to the video "XXXYY99" (all first areas corresponding to the video in which the character who is the speaker of the subtitles for the selected word appears), and add the subtitles for the selected word to both the second area corresponding to the video "XXXYY97" and the second area corresponding to the video "XXXYY99" (all second areas corresponding to the video in which the character who is the speaker of the subtitles for the selected word appears), thereby generating a dictionary corresponding to the video "XXXYY97" and a dictionary corresponding to the video "XXXYY99".

[0083] Furthermore, a video may include a character belonging to a predetermined group (e.g., a school, classroom, club, team, unit, group, organization, or group) that appears in another video. For example, a video of "xxxyyy99" may include a character belonging to a predetermined group that appears in a video different from the video of "xxxyyy99," such as a character that appears in the video of "xxxyyyy99" and belongs to the "KOTORI1" group, or a character that appears in the video of "xxxyyyy97," or a character that appears in the "KOTORI2" group, or a character that appears in the video of "xxxyyyy98." When a character who speaks the subtitles of a word extracted by the extraction unit 132 belongs to a predetermined group that also appears in a video other than the video currently being viewed by the user, the generation unit 133 may add the word extracted by the extraction unit 132 to a first area corresponding to the group to which the character who speaks the subtitles of the word belongs, and add the subtitles extracted by the extraction unit 132 to a second area corresponding to the group, thereby generating a dictionary that compiles words selected by the user for each group to which the character belongs. Furthermore, when the generation unit 133 generates a dictionary that compiles words selected by the user for each group to which the character belongs, the update unit 134 may update the dictionary generated by the generation unit 133, for example, by determining the order of words to be added to the first area based on the relationship between the video and the predetermined group. For example, when adding words to the first area, the update unit 134 may update the dictionary so that words selected from subtitles of video that have a strong relationship with the predetermined group (e.g., a video that is a representative work of the predetermined group or a video that well represents the characteristics of the predetermined group) are displayed higher. Furthermore, the update unit 134 may update the dictionary generated by the generation unit 133 by determining the order of words to be added to the first area based on, for example, video release information (for example, information such as the release date, publication date, announcement date, or release date) predetermined for each video. For example, when adding words to the first area, the update unit 134 may update the dictionary so that words selected from subtitles of video that were released earlier are displayed higher.Furthermore, the update unit 134 may update the dictionary generated by the generation unit 133, for example, by determining the order of words to be added to the first area based on the user's preference for video. For example, the update unit 134 may update the dictionary when adding words to the first area so that words selected from subtitles of video that are more preferred by the user are displayed higher. Furthermore, the update unit 134 may update the dictionary generated by the generation unit 133, for example, by determining the order of words to be added to the first area based on the number of words selected by the user while watching the video. For example, the update unit 134 may update the dictionary when adding words to the first area so that words selected from subtitles of video that are more preferred by the user are displayed higher.

[0084] (Variation 6: Generate a dictionary containing subtitles in a language according to the user's attributes) In the above embodiment, the generation unit 133 adds words extracted by the extraction unit 132 to a first area corresponding to the video being viewed by the user and adds subtitles extracted by the extraction unit 132 to a second area corresponding to the video being viewed by the user, thereby generating a dictionary corresponding to the video being viewed by the user. However, there may be cases where a user desires to generate a dictionary that includes not only subtitles translated into the language being studied but also subtitles in a language corresponding to the user's attributes. For example, if the user is studying English and the language corresponding to the user's attributes is Japanese, the generation unit 133 may generate a dictionary corresponding to the video being viewed by adding, to the second area, the subtitle "This is a town of cobblestone streets," along with the subtitle "This is a town of cobblestone streets." In this case, the subtitles added to the second area along with the subtitles translated into the language the user is studying (subtitles in a language corresponding to the user's attributes) may be subtitles corresponding to the actual speech of the character who is the speaker of the subtitles displayed when the user selected a word (i.e., subtitles in which the speech actually spoken by the character has been converted into text), or they may be subtitles in which the subtitles translated into the language the user is studying have been further translated into a language corresponding to the user's attributes (in this case, since the subtitles are not the speech actually spoken by the character converted into text, the subtitles may differ from the speech actually spoken by the character).For example, if the voice actually spoken by the character is "This is a town of cobblestone streets" and the subtitle translated into the language the user is learning is "This is a town of cobblestone streets," the generation unit 133 may generate a dictionary by adding the subtitle "This is a town of cobblestone streets" (an example of a subtitle obtained by converting the voice actually spoken by the character, "This is a town of cobblestone streets," into text) together with the subtitle "This is a town of cobblestone streets" to the second area, or may generate a dictionary by adding the subtitle "This is a town of cobblestone streets" (an example of a subtitle obtained by further translating the subtitle "This is a town of cobblestone streets" into a language according to the user's attributes) together with the subtitle "This is a town of cobblestone streets" to the second area.

[0085] The generation unit 133 may add the words extracted by the extraction unit 132 to a first area corresponding to the video being viewed by the user, and add subtitles (and the subtitles extracted by the extraction unit 132) corresponding to the audio actually uttered by the character who is the speaker of the subtitles extracted by the extraction unit 132 to a second area corresponding to the video being viewed by the user, thereby generating a dictionary corresponding to the video being viewed by the user. In this case, the generation unit 133 (or the extraction unit 132) may acquire subtitles corresponding to the audio actually uttered by the character who is the speaker of the subtitles extracted by the extraction unit 132 from a storage unit that stores, in association with each other, speech information of the character appearing in the video and subtitle information corresponding to the character's speech. Note that while FIG. 7 shows a case in which the subtitle information storage unit 122 has items such as "video ID" and "subtitles," the subtitle information storage unit 122 may also have an item such as "speech" in addition to items such as "video ID" and "subtitles," and speech information of the character appearing in the video may be stored in "speech." That is, the subtitle information storage unit 122 may store, in association with each other, speech information of a character appearing in a video and subtitle information corresponding to the character's speech. Furthermore, the "speech" may store not only subtitle information of subtitles corresponding to the sound actually spoken by the character, but also audio data (data such as an audio file) of the sound actually spoken by the character. For example, the "speech" may store information such as a uniform resource locator (URL) where the audio data is located or a file path name indicating the storage location. That is, the generation unit 133 may generate a dictionary corresponding to the video being viewed by the user by adding the words extracted by the extraction unit 132 to a first area corresponding to the video being viewed by the user, and adding an audio file of the sound actually spoken by the character who is the speaker of the subtitles extracted by the extraction unit 132 (and the subtitles extracted by the extraction unit 132) to a second area corresponding to the video being viewed by the user.Furthermore, the generation unit 133 may generate a dictionary corresponding to the video being viewed by the user by adding the words extracted by the extraction unit 132 to a first area corresponding to the video being viewed by the user, and adding subtitles (and subtitles extracted by the extraction unit 132) obtained by further translating the subtitles extracted by the extraction unit 132 into a language corresponding to the user's attributes to a second area corresponding to the video being viewed by the user. In this case, the generation unit 133 (or the extraction unit 132) may perform a process of further translating the subtitles extracted by the extraction unit 132 into a language corresponding to the user's attributes.

[0086] <1.6.Effects> At least the following points become clear from the description of embodiment 1 and the accompanying drawings.

[0087] Aspect 1 is characterized in that a computer is caused to execute the following steps: an extraction step of extracting a word selected by a user from a predetermined subtitle while the predetermined subtitle is displayed among subtitles of a predetermined video that the user is watching, among subtitles in which speech spoken in a language corresponding to the user's attributes is translated into a predetermined language; a generation step of generating a dictionary of words selected by the user for each video by adding the word extracted by the extraction step to a first area corresponding to the predetermined video among first areas set for each video, and adding the predetermined subtitle extracted by the extraction step to a second area corresponding to the predetermined video, set for each video in correspondence with the first area, the second area being a second area corresponding to the predetermined video for assisting memory of the words added to the first area; and an update step of updating the dictionary generated by the generation step when a word is added to the first area so that the earlier the predetermined subtitle is displayed in the subtitles of the predetermined video, the higher the word is displayed.

[0088] According to the first aspect, for example, if a word that the user wants to remember appears in the subtitles while the user is watching a video, the user can select the word while the subtitles are displayed, thereby generating a dictionary in which the word is associated with the subtitle and added to a predetermined area. Also, a dictionary for the user can be generated for each video that the user has watched. Furthermore, since the subtitles are displayed in association with the video, the user can recall the video in which the subtitles are displayed from the subtitles.

[0089] Furthermore, according to aspect 1, for example, while watching a video primarily targeted at viewers born and raised in the same culture as the user, subtitles in a different cultural language that the user is learning can be displayed in response to the video. This allows the user to view the subtitles while accurately understanding the video and audio of the video with the five senses. Therefore, even if the video is in a different cultural language, the user can effectively learn how to use words contained in translated sentences displayed as subtitles from the video. For example, the user can learn not only the meaning of the words but also how the words are used in conjunction with other words, in what situations, and when the speaker feels the words. Furthermore, by accurately understanding the usage of words from the video with the five senses, not only can the video with the subtitles be recalled from the words, but also the words can be recalled from the video. Therefore, the user can recall the words simply by casually recalling the video in everyday life outside of learning. Furthermore, video primarily targeted at viewers born and raised in the same culture as the user is easy for the user to understand, and thus the user can casually recall not only the video but also the audio, thereby facilitating word recall.

[0090] Furthermore, according to aspect 1, for example, the order of words contained in the dictionary can be rearranged to match the order of subtitles displayed in a video, thereby displaying the words in the order of the video story. Therefore, by viewing the words contained in the dictionary in the correct order, a user can recall the story of the video, and thus recall the meanings and uses of the words. In this way, the story of the video can be treated as a whole, making it easier to recall the meanings and uses of words that appear in the subtitles of the video. This eliminates the need to individually check whether the meaning and use of each word can be recalled, thereby reducing the burden on the user when reviewing.

[0091] Aspect 2 is characterized in that, in aspect 1, the video is composed of multiple episodes, each episode having a predetermined length, and the dictionary generated by the generation procedure is updated so that the earlier the episode in which the predetermined subtitle appears among the multiple episodes constituting the predetermined video, the higher the word is displayed.

[0092] According to aspect 2, for example, the order of words contained in the dictionary can be rearranged taking into account the order of the stories (episodes) of a video. Therefore, even if a video consists of multiple stories, a user can recall the story of the video by viewing the words contained in the dictionary in the correct order. Furthermore, by taking the story order into account, the order of words appearing in the subtitles of each story will be similar, making it easier to recall the story of each story. Therefore, a user can recall the story of each story by viewing the words contained in the dictionary in the correct order. Furthermore, by recalling the story of each story, the user can recall the story of the entire multiple story. Therefore, recall of the story is easier both in the case of a video in which each story is complete, and in the case of a video in which the story is complete as a whole of multiple story. Furthermore, since each story has a predetermined length, it is easier to recall the story of each story, and therefore easier to recall the words. In this way, by treating the story of each story as a whole, it is easier to recall the meaning and usage of words that appear in the subtitles of each story.

[0093] Aspect 3 is characterized in that, in aspect 1, it further includes a display procedure for displaying video images that are part of a predetermined video that was displayed when the word was selected in an order corresponding to the word added to a first area corresponding to the predetermined video selected from the video for which a dictionary was generated by the generation procedure.

[0094] According to the third aspect, for example, the video images corresponding to the words in the dictionary can be displayed in an order corresponding to the order of the words. This allows the user to review whether or not they can recall the meaning and usage of the words simply by viewing the video images in the order corresponding to the words, without looking at the words in the dictionary. In this way, video images from a video that suits the user's preferences can be displayed, rather than a list of characters like in a dictionary, allowing the user to review without feeling like they are actually learning. Furthermore, the more the video images in the video are in line with the user's preferences, the easier it is for the user to recall the content before and after the video images just by viewing them, allowing the user to gain a deeper understanding of the meaning and usage of words not only during study but also during review.

[0095] A fourth aspect is characterized in that in the third aspect, an impressive video image is displayed from among the video images displayed during the scene of the video image displayed when the word is selected.

[0096] According to the fourth aspect, for example, the most impressive video image among the target video scenes can be displayed, thereby making it easier for the user to recall the scene. Therefore, by viewing such video images, the user can recall the entire scene, including the events before and after the target video image, thereby gaining a deeper understanding of the meaning and usage of the target word. Furthermore, impressive video images often contain characteristic information (e.g., effects) that differs from other video images in the scene, or at least one of the main characters in the video. Therefore, the more the video image is in line with the user's preferences, the more likely the user is to review the material without feeling like they have actually learned. Furthermore, for example, by displaying the target video image together with other impressive video images in the scene, the content before and after the target video image can be linked to the entire scene and recalled.

[0097] Aspect 5 is characterized in that, in aspect 3, a video image that is part of the specified video excluding the specified subtitles that was displayed when the word was selected is extracted, and the video image extracted by the extraction procedure is added to a third area set for each video corresponding to the first area, which corresponds to the specified video to assist in memorization of the words added to the first area, thereby generating the dictionary, and extracting the video image added to the third area and the word added to the first area corresponding to the video image from the dictionary generated by the generation procedure, and displaying the video image by superimposing the word on the video image.

[0098] According to the fifth aspect, for example, video images from a video viewed by a user can be added to a dictionary and displayed. Therefore, recalling a video image naturally recalls the context before and after the video image. Therefore, not only can the user review the video by associating the words with the video image, but also the context before and after the video image. Furthermore, the video images are displayed in an order corresponding to the order of the words in the dictionary. Therefore, by viewing the video images in that order, the user can recall the story of the video image, thereby recalling the meaning and usage of the words they understood while watching the video image. Furthermore, superimposing words on the video images allows the user to more deeply associate and memorize the words with the video image, making it easier to recall the video image from the word and vice versa. Furthermore, the more the video image is in line with the user's preferences, the more opportunities there are for the user to recall the information at casual moments, allowing the user to memorize the information naturally in their daily lives without feeling like they are learning.

[0099] Aspect 6 is characterized in that, in aspect 3, the dictionary is generated by extracting a video image that is part of the specified video excluding the specified subtitle that was displayed when the word was selected, and adding the video image extracted by the extraction procedure to a third area set for each video corresponding to the first area, the third area corresponding to the specified video for assisting memory of the words added to the first area, and extracting the video image added to the third area and the specified subtitle added to the second area corresponding to the video image from the dictionary generated by the generation procedure, and displaying the video image by superimposing the specified subtitle on the video image.

[0100] According to the sixth aspect, for example, video images from a video viewed by a user can be added to a dictionary and displayed. Therefore, recalling a video image naturally recalls the context surrounding the image. This allows not only the user to review the video by associating the words with the video image, but also the context surrounding the video image. Furthermore, the video images are displayed in an order corresponding to the order of the words in the dictionary. Therefore, viewing the video images in that order allows the user to recall the story of the video, thereby recalling the meaning and usage of words understood while watching the video. Furthermore, superimposing subtitles on the video images allows the user to more deeply associate and memorize the words contained in the subtitles with the video image. Furthermore, subtitles help recall the context surrounding the video image, allowing the context surrounding the video image to be associated and memorized. This makes it easier to recall video images from words and vice versa. Furthermore, the more a video image is in line with a user's preferences, the more opportunities there are for the user to recall the information at casual moments, allowing the user to memorize the information naturally in their daily lives without feeling like they are learning.

[0101] Aspect 7 is characterized in that, in aspect 1, it further includes a suggestion procedure for proposing, as candidates for generating a new dictionary, one or more video videos that include in their subtitles one or more words added to the first area of ​​a specified dictionary selected from the dictionary generated by the generation procedure.

[0102] According to aspect 7, for example, a user can review words that appear in the subtitles of a video in other videos, thereby solidifying their memory of the words. Furthermore, a user can check how words that appear in the subtitles of a video are used in other videos, thereby enabling a deeper understanding of the meaning and usage of the words. Furthermore, other videos that include more of the words that appear in the subtitles of a video may have similar characteristics to the video (e.g., the worldview or story of the video, or the characteristics of the central character (main character) of the video's story). Therefore, for example, after a user finishes watching a video, other videos with similar characteristics to the video can be suggested as candidates for the next video to watch. Therefore, a user can comfortably watch other videos after watching a video without hesitation, allowing for comfortable vocabulary learning using other videos without hesitation.

[0103] Aspect 8 is characterized in that, in aspect 7, one or more video videos that contain in their subtitles one or more words added to the first area of ​​the specified dictionary and have characteristics similar to the specified video video from which the specified dictionary was generated are proposed as candidates.

[0104] According to aspect 8, for example, words included in the subtitles of another video but not appearing in the subtitles of one video may be co-occurring words or synonyms (including homonyms) widely used in relation to words that appear in the subtitles of one video, and co-occurring words and synonyms are easy to remember together, making it easier to memorize words included in a dictionary generated from another video. Furthermore, in the case of co-occurring words or synonyms, even words that did not appear in the subtitles of one video may be inferred by recalling the story of the one video, making it easier to memorize words included in a dictionary generated from another video.

[0105] Aspect 9 is characterized in that, in aspect 8, based on the characteristics of the main characters of the specified video video for which the specified dictionary was generated, a video video including a main character with characteristics similar to those of one of the main characters is proposed as the candidate.

[0106] According to aspect 9, for example, words included in the subtitles of other video videos that did not appear in the subtitles of one video video may be widely used words corresponding to the speech of a character with characteristics similar to those of the main character who made the utterance corresponding to the word that appeared in the subtitles of the one video video. This makes it easier to memorize words included in a dictionary generated from other video videos. Furthermore, because a user's preferences for video videos are often due to the characteristics of the main character, the user can comfortably watch other video videos without any resistance. This allows the user to comfortably learn words using other video videos without any resistance or resistance, without feeling like they are learning.

[0107] Aspect 10 is characterized in that, in aspect 7, one or more video videos are suggested as candidates based on the characteristics of other video videos for which the user generated the dictionary, among video videos that contain in their subtitles one or more of the words added to the first area of ​​the specified dictionary.

[0108] According to aspect 10, for example, it is possible to suggest other video videos for which dictionaries other than the target dictionary have been generated based on the characteristics of other video videos for which dictionaries have not been generated, thereby making it possible to suggest video videos that suit the user's preferences.

[0109] Aspect 11 is characterized in that, in aspect 10, based on the characteristics of the main characters of other video videos for which the user generated the dictionary, video videos are suggested as candidates that include a character with a main character having characteristics similar to those of one of the main characters.

[0110] According to aspect 11, for example, it is possible to suggest other video videos for which dictionaries other than the target dictionary have been generated based on the characteristics of the main characters of other video videos, thereby making it possible to suggest video videos that include a main character with characteristics that match the user's preferences.

[0111] Aspect 12 is characterized in that, in aspect 11, video videos are proposed as candidates that include a main character whose characteristics are in line with the user's preferences, estimated based on the characteristics of the main character of the other video videos.

[0112] According to aspect 12, for example, it is possible to suggest video videos that include a main character whose characteristics match the user's preferences, allowing the user to comfortably learn words using other video videos without feeling like they are actually learning.

[0113] <<2. Embodiment 2>> <2.1. Introduction> In the above embodiment, the user may have a desire to particularly understand the meanings and usages of target words depending on the learning goal. For example, if the user's learning goal is to pass a specific qualification exam, the user may have a desire to particularly understand the meanings and usages of the target words in the specific qualification exam.

[0114] The second embodiment has been made in view of the above, and aims to make it easier for a user to effectively memorize words that the user wants to memorize in accordance with the user's learning goals.

[0115] In the second embodiment, the commercially available dictionary is a dictionary that can be purchased commercially (for example, a dictionary for qualification exams, a book used as a teaching material, a textbook, a reference book, or a vocabulary book). For example, the commercially available dictionary is a dictionary that is widely used in compulsory education schools, cram schools, etc. The commercially available dictionary may also be an e-book dictionary. Furthermore, hereinafter, the words in the commercially available dictionary will be referred to as "study words" as appropriate. The study words are, for example, the main words that are the subject of study in the commercially available dictionary. Furthermore, the study words may be words that are included in the commercially available dictionary together with the main words that are the subject of study in the commercially available dictionary (for example, words included in example sentences of the main words, synonyms, etc.). In the second embodiment, the same explanation as in the above embodiment will be omitted as appropriate.

[0116] <2.2. Information Processing System Configuration> An information processing system 1A shown in Fig. 13 will be described. As shown in Fig. 13, the information processing system 1A includes a terminal device 10 and a memory assistance device 100A. The terminal device 10 and the memory assistance device 100A are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other via wired or wireless communication. Fig. 13 is a diagram showing an example of the configuration of the information processing system 1A according to embodiment 2. Note that the terminal device 10 is the same as in the above embodiment, and therefore description thereof will be omitted.

[0117] The memory assistance device 100A is an information processing device that aims to facilitate effective memorization of words that a user wants to memorize in accordance with the user's learning goal. The memory assistance device 100A may be any device that can realize the processing in embodiment 2. For example, the memory assistance device 100A may be realized by a server device, a cloud system, or the like.

[0118] Although FIG. 13 shows a case where the terminal device 10 and the memory assistance device 100A are separate devices, the terminal device 10 and the memory assistance device 100A may be integrated.

[0119] 2.3. Configuration of memory support device Next, the configuration of a memory assistance device 100A according to embodiment 2 will be described with reference to Fig. 14. Fig. 14 is a diagram showing an example of the configuration of the memory assistance device 100A according to embodiment 2. As shown in Fig. 14, the memory assistance device 100A has a communication unit 110, a memory unit 120A, and a control unit 130A. Note that the memory assistance device 100A may also have an input unit that accepts various operations from an administrator of the memory assistance device 100A, and a display unit that displays various information.

[0120] (Communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the terminal device 10 etc. via the network N.

[0121] (Storage unit 120A) The storage unit 120A is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in Fig. 14, the storage unit 120A has a dictionary information storage unit 121, a subtitle information storage unit 122A, and a commercially available dictionary information storage unit 123. Note that the dictionary information storage unit 121 is the same as in the above embodiment, and therefore a description thereof will be omitted.

[0122] The subtitle information storage unit 122A stores information related to subtitles displayed in a video moving image. FIG. 15 shows an example of the subtitle information storage unit 122A according to the second embodiment. FIG. 15 is a diagram showing an example of the subtitle information storage unit 122A according to the second embodiment. As shown in FIG. 15, the subtitle information storage unit 122A has items such as "video moving image ID," "subtitles," and "speaker."

[0123] "Video ID" indicates identification information for identifying a video. "Subtitles" indicates subtitles displayed in a video. In the example shown in FIG. 15, conceptual information such as "Subtitle #1" and "Subtitle #2" is stored in "Subtitles," but in reality, word information (text information contained in the subtitles) that make up the subtitles is stored for each subtitle. "Speaker" indicates the character who is speaking the utterance corresponding to the subtitle.

[0124] 15 shows an example in which the subtitles displayed in a video identified by video ID "M1" are "Subtitle #1," "Subtitle #2," "Subtitle #3," "Subtitle #4," "Subtitle #5," ..., "Subtitle #N," and the speakers of the utterances corresponding to the subtitles are "Character 1," "Character 1," "Character 2," "Character 3," "Character 2," ..., "Character 1." For example, this shows that the speaker of the utterance corresponding to the subtitle "Subtitle #1" in video M1 is "Character 1."

[0125] The commercially available dictionary information storage unit 123 stores information about commercially available dictionaries. Fig. 16 shows an example of the commercially available dictionary information storage unit 123 according to the second embodiment. Fig. 16 is a diagram showing an example of the commercially available dictionary information storage unit 123 according to the second embodiment. As shown in Fig. 16, the commercially available dictionary information storage unit 123 has items such as "commercial dictionary ID" and "learning words."

[0126] "Commercial Dictionary ID" indicates identification information for identifying a commercially available dictionary. "Learning Word" indicates a learning word in a commercially available dictionary. In the example shown in FIG. 16, conceptual information such as "Learning Word #1" and "Learning Word #2" is stored in "Learning Word," but in reality, character information for the learning word is stored for each learning word.

[0127] That is, FIG. 16 shows an example in which the learning words in a commercially available dictionary identified by the commercially available dictionary ID "T1" are "learning word #1," "learning word #2," ..., "learning word #N."

[0128] (control unit 130A) The control unit 130A is a controller, and is realized by, for example, a CPU, an MPU, or the like, executing various programs stored in a storage device inside the memory assistance device 100A using RAM as a work area. The control unit 130A is also realized by, for example, an integrated circuit such as an ASIC or FPGA.

[0129] 14, the control unit 130A has an acquisition unit 131A, an extraction unit 132A, a generation unit 133, an update unit 134, a display unit 135, a proposal unit 136, and a display change unit 137, and realizes or executes the information processing action described below. Note that the internal configuration of the control unit 130A is not limited to the configuration shown in FIG. 14, and may be any other configuration as long as it performs the information processing described below. Note that the generation unit 133, the update unit 134, the display unit 135, and the proposal unit 136 are the same as those in the above embodiment, and therefore description thereof will be omitted.

[0130] (Acquisition part 131A) The acquiring unit 131A acquires the same information as the acquiring unit 131. The acquiring unit 131A also acquires various types of information from the storage unit 120A. The acquiring unit 131A also stores the acquired various types of information in the storage unit 120A.

[0131] The acquisition unit 131A acquires information about a commercially available dictionary designated in advance by the user. For example, the acquisition unit 131A acquires information about the study words in a commercially available dictionary designated in advance by the user (for example, "Study Word #1," "Study Word #2," ..., "Study Word #N" shown in FIG. 16). Note that if the user designates multiple commercially available dictionaries, the acquisition unit 131A acquires information about the study words in the multiple commercially available dictionaries designated in advance by the user.

[0132] The acquisition unit 131A acquires information about subtitles of a video moving image that a user is watching. For example, the acquisition unit 131A may acquire information about subtitles that are displayed after (for example, immediately after) subtitles that are displayed while the user is watching a video moving image, or may acquire information about all subtitles that are displayed in the video moving image that a user is watching. For example, when a user is watching the video moving image of "XXXYY1" and the subtitle "This is a town of cobblestone streets" is displayed on the screen, the acquisition unit 131A may acquire information about the subtitles that are displayed after the subtitle "This is a town of cobblestone streets." Furthermore, when a user is watching the video moving image of "XXXYY1," the acquisition unit 131A may acquire information about all subtitles that are displayed in the video moving image of "XXXYY1" (for example, "subtitle #1," "subtitle #2," ..., "subtitle #N" shown in FIG. 15).

[0133] When a learning word from a commercially available dictionary designated by the user in advance appears in the subtitles of the video being viewed by the user, the acquisition unit 131A acquires operation information when the user performs an operation on the screen while the subtitles containing the learning word are being displayed. For example, the acquisition unit 131A acquires operation information for a learning word whose display mode has been changed by the display change unit 137 described below. For example, the acquisition unit 131A acquires operation information that can determine whether the learning word whose display mode has been changed is included in a display frame displayed on the screen while the user is viewing the video.

[0134] (Display change unit 137) When a learning word from a commercially available dictionary designated by the user appears in the subtitles of the video being viewed by the user, the display change unit 137 changes the display mode of the learning word included in the subtitles while the subtitles containing the learning word appear. The display change unit 137 may determine whether a learning word from a commercially available dictionary designated by the user appears in the subtitles of the video being viewed by the user, and if it determines that the learning word appears, it may change the display mode of the learning word included in the subtitles while the subtitles containing the learning word appear by specifying the learning word and the subtitle in which the learning word appears in advance. Similarly, when the user designates multiple commercially available dictionaries, the display change unit 137 changes the display mode of the learning word included in the subtitles while the subtitles containing the learning word appear are displayed.

[0135] The display modification unit 137 changes the display mode of the learning words to a predetermined mode. For example, the display modification unit 137 may display the learning words in a larger font size, in a more eye-catching font color, in a highlighted font, or in a font with a shadow, glow, or other character effects. The predetermined mode is not particularly limited. For example, if the learning word "cobblestone" is included in a commercially available dictionary designated in advance by the user, the display modification unit 137 may display the learning word "cobblestone" in a larger font size than the font sizes of the other words ("This," "is," "a," "town," "of," and "streets") in the subtitles when the subtitle "This is a town of cobblestone streets" is displayed on the screen.

[0136] When a learning word in a commercially available dictionary designated in advance by the user appears in the subtitles of the video video being viewed by the user, the display change unit 137 may change the display mode of the subtitles containing the learning word to a predetermined mode and display the subtitles. For example, when the learning word "cobblestone" is included in the commercially available dictionary designated in advance by the user, when the subtitle "This is a town of cobblestone streets" is displayed on the screen, the display change unit 137 may display all words contained in the subtitle "This is a town of cobblestone streets" in a larger font size than words in other subtitles in which the learning word does not appear (for example, words in the subtitles before and after the subtitle "This is a town of cobblestone streets").

[0137] The display change unit 137 may change the display mode of the learning words included in the subtitles when the learning words from a commercially available dictionary specified in advance by the user appear in the subtitles corresponding to the speech of the main character of the video being viewed by the user. The determination of whether the subtitles correspond to the speech of the main character of the video being viewed by the user may be performed in any manner, and is not particularly limited. For example, the display change unit 137 identifies the character's speech to which the learning words from a commercially available dictionary specified in advance by the user appear, based on the correspondence between the subtitles and the speaking characters acquired from the subtitle information storage unit 122A. The correspondence between the subtitles and the speaking characters may be performed, for example, by AI (artificial intelligence). For example, the correspondence between the subtitles and the speaking characters may be performed by AI using natural language processing, image analysis processing, or the like (for example, by identifying the speaking character from text information included in the subtitles, or by identifying the speaking character from image information of the video in which the subtitles are displayed). That is, the display change unit 137 may identify which character's speech corresponds to a subtitle containing a learning word from a commercially available dictionary designated in advance by a user, based on the correspondence between the subtitles associated by AI and the character who speaks it.The display change unit 137 then determines whether the subtitle corresponds to the speech of the main character of the video being watched by the user, based on whether the character who speaks the speech corresponding to the subtitle is a character estimated to be a main character based on, for example, information about the subtitles of the video (e.g., the number of times the character speaks in the video, text information included in the entire subtitles in the video).The display change unit 137 may also determine whether the subtitle corresponds to the speech of the main character of the video being watched by the user, based on whether the character who speaks the speech corresponding to the subtitle is a character estimated to be a main character of the video by acquiring, for example, information about the video from an external information processing device.In this way, the display change unit 137 determines whether or not the subtitles containing the learning words from a commercially available dictionary designated in advance by the user correspond to the speech of the main character in the video being watched by the user, and if it determines that the subtitles correspond to the speech of the main character in the video being watched by the user, it may change the display mode of the learning words included in the subtitles.

[0138] The display modification unit 137 may change the display mode of the learning words included in subtitles that include learning words from a commercially available dictionary specified in advance by the user when the learning words appear in the subtitles and correspond to the speech of a character whose characteristics match the user's preferences. The determination of whether a subtitle corresponds to the speech of a character whose characteristics match the user's preferences may be performed in any manner, and is not particularly limited. For example, the display modification unit 137 may determine whether a subtitle corresponds to the speech of a character whose characteristics match the user's preferences based on the characteristics of a character in a video for which the user generated a dictionary. Furthermore, for example, the display modification unit 137 may determine whether a subtitle corresponds to the speech of a character whose characteristics match the user's preferences based on the characteristics of a character whose characteristics match the user's preferences by acquiring user preference information from an external information processing device or the like. In this way, the display change unit 137 may determine whether or not the subtitles containing the learning words from a commercially available dictionary designated in advance by the user correspond to the speech of a character with characteristics that match the user's preferences, and if it determines that the subtitles correspond to the speech of a character with characteristics that match the user's preferences, it may change the display mode of the learning words included in the subtitles.

[0139] The display modification unit 137 may change the display mode of the learning words included in subtitles that contain learning words from a commercially available dictionary specified by the user in advance if the subtitles correspond to the speech of a character with characteristics that match the preferences of another user. As with the case of users, the determination of whether a subtitle corresponds to the speech of a character with characteristics that match the preferences of another user may be performed in any manner and is not particularly limited. The display modification unit 137 may change the display mode of the learning words included in subtitles that contain learning words from a commercially available dictionary specified by the user in advance if the learning words correspond to the speech of a character with characteristics that match the preferences of another user who generated a dictionary from a video that the user is watching. For example, when a user is watching the video "XXXXXYY1," the display modification unit 137 may identify the other user who generated a dictionary from the video "XXXXXYY1," and change the display mode of the learning words included in the subtitles if the learning words correspond to the speech of a character with characteristics that match the preferences of the identified other user. Furthermore, the display modification unit 137 may change the display mode of the learning words included in subtitles in cases where the subtitles containing learning words from a commercially available dictionary designated in advance by the user correspond to the speech of a character whose characteristics match the preferences of another user whose list of videos is similar to the user's. For example, the display modification unit 137 may compare the list of videos for which the user has created a dictionary with the list of videos for which another user has created a dictionary, thereby identifying another user whose list of videos is similar to the user's (e.g., most similar), and may change the display mode of the learning words included in the subtitles in cases where the subtitles correspond to the speech of a character whose characteristics match the preferences of the identified other user.Furthermore, the display change unit 137 may, for example, identify the user and his / her attributes (for example, gender, age, hobbies, hometown, race, nationality, etc.), learning goals, purchase history (for example, purchase history of goods purchased by the user on a predetermined website selling goods related to video (for example, scale figures, character dolls, cosplay costumes, costumes for character dolls, etc.), characteristics of the goods purchased by the user), posting history (for example, posting history of cosplay images posted by the user on a predetermined website for posting cosplay images), etc., from among the other users identified in this way (other users who generated dictionaries from the video that the user is watching, other users whose video list is similar to that of the user), The display change unit 137 may further identify other users with similar attributes, learning goals, purchasing history, posting history, or browsing history (e.g., browsing history of goods viewed by the user on a predetermined site selling goods related to video, characteristics of the goods viewed by the user, browsing history of cosplay images viewed by the user on a predetermined site posting cosplay images, characteristics of cosplay costumes in the cosplay images viewed by the user), and change the display mode of the learning words included in the subtitles when the subtitles correspond to the speech of a character with characteristics that match the preferences of other users further identified based on the attributes, learning goals, purchasing history, posting history, or browsing history. Note that the attributes, learning goals, purchasing history, posting history, or browsing history of the user and other users are predetermined, and the display change unit 137 identifies other users with similar attributes, learning goals, purchasing history, posting history, or browsing history to the user based on the predetermined attributes, learning goals, purchasing history, posting history, or browsing history of the user and other users.

[0140] The display change unit 137 may change the display mode of the learning words included in the target subtitles (subtitles containing learning words from a commercially available dictionary specified in advance by the user) when the video currently being viewed by the user is a video with characteristics that match the user's preferences. The determination of whether the video is a video with characteristics that match the user's preferences may be performed in any manner and is not particularly limited. For example, the display change unit 137 may determine whether the video currently being viewed by the user is a video with characteristics that match the user's preferences based on the characteristics of the video estimated to be a video with characteristics that match the user's preferences based on the characteristics of the video for which the user generated the dictionary. Furthermore, for example, the display change unit 137 may determine whether the video currently being viewed by the user is a video with characteristics that match the user's preferences based on the characteristics of the video estimated to be a video with characteristics that match the user's preferences by acquiring user preference information from an external information processing device or the like. In this way, the display change unit 137 may determine whether the video being watched by the user is a video with characteristics that match the user's preferences, and if it determines that the video has characteristics that match the user's preferences, it may change the display mode of the learning words included in the target subtitles.

[0141] The display modification unit 137 may change the display mode of the learning words included in the target subtitles when the video currently being viewed by the user is a video with characteristics that match the preferences of another user. As with the case of the user, the determination of whether the video is a video with characteristics that match the preferences of another user may be performed in any manner and is not particularly limited. The display modification unit 137 may change the display mode of the learning words included in the target subtitles when the video currently being viewed by the user is a video with characteristics that match the preferences of another user who generated a dictionary from the video. For example, when the user is viewing the video "XXXYY1," the display modification unit 137 may identify the other user who generated a dictionary from the video "XXXYY1," and change the display mode of the learning words included in the target subtitles when the video is a video with characteristics that match the preferences of the identified other user. The display change unit 137 may also change the display mode of the learning words included in the target subtitles when, for example, the video currently being viewed by the user is a video whose list of videos has characteristics that match the preferences of another user similar to the user. For example, the display change unit 137 may compare a list of videos for which the user has generated a dictionary with a list of videos for which another user has generated a dictionary to identify another user whose list of videos is similar to the user, and change the display mode of the learning words included in the target subtitles when the video has characteristics that match the preferences of the identified other user. The display change unit 137 may also further identify, from among the identified other users, other users whose attributes, learning goals, purchasing history, posting history, browsing history, etc. are similar to the user's, and change the display mode of the learning words included in the target subtitles when the video has characteristics that match the preferences of the further identified other user based on the attributes, learning goals, purchasing history, posting history, browsing history, etc.

[0142] The display change unit 137 may change the display mode of a training word included in a target subtitle if the training word is not a word previously designated as a word not to be added to the first area for generating a dictionary (hereinafter referred to as an "exclusion word" as appropriate). The exclusion word may be a word designated by a user for each user, or may be a word designated by an administrator of the memory assistance device 100A. For example, if a user does not want to include memorized words or words that do not have a distinctive meaning as a single word, such as pronouns or articles, in the first area of ​​the dictionary, the user may designate memorized words or words that do not have a distinctive meaning as a single word, such as pronouns or articles, in advance. The display change unit 137 determines whether a training word included in a target subtitle is an exclusion word, using the designated word as an exclusion word. If the display change unit 137 determines that a training word included in a target subtitle is not an exclusion word, the display change unit 137 changes the display mode of the training word. In this way, the display modification unit 137 may change the display mode of the training words included in the target subtitle based on the designation of two types of words: words the user wants to memorize and words the user does not want to include in the words the user wants to memorize. Furthermore, to designate exclusion words, the user may designate a commercially available dictionary (hereinafter, appropriately referred to as an "other commercially available dictionary") different from the commercially available dictionary used to designate training words. For example, if the user has passed a certain qualification exam and does not want to include training words in a commercially available dictionary for that qualification exam in the first area of ​​the dictionary, the user may designate the commercially available dictionary for that qualification exam as the other commercially available dictionary. The display modification unit 137 may determine whether training words included in the target subtitle are excluded words, using the designated training words in the other commercially available dictionary as exclusion words. Then, if a training word included in the target subtitle is not a training word in the other commercially available dictionary, the display modification unit 137 may change the display mode of the training word. In this way, the display change unit 137 may change the display manner of the learning words included in the target subtitles based on the specification of two types of commercially available dictionaries: a commercially available dictionary for specifying words that the user wants to memorize, and a commercially available dictionary for specifying words that the user does not want to include in the words that the user wants to memorize.In addition, similar to the commercially available dictionaries for specifying study words, multiple other commercially available dictionaries may also be specified.

[0143] (Extraction part 132A) The extraction unit 132A extracts the same information as the extraction unit 132. Furthermore, when a user selects a training word whose display mode has been changed by the display change unit 137 while a target subtitle is being displayed, the extraction unit 132A extracts the training word and the target subtitle. For example, the extraction unit 132A determines whether the training word whose display mode has been changed is included in a display frame displayed on the screen while the user is watching a video. If the extraction unit 132A determines that the training word is included in the display frame displayed on the screen while the user is watching a video, the extraction unit 132A extracts the training word and the target subtitle containing the training word. The generation unit 133 then adds the training word extracted by the extraction unit 132A to a first area corresponding to the video the user is watching and adds the subtitle extracted by the extraction unit 132A to a second area corresponding to the video the user is watching, thereby generating a dictionary of training words selected by users for each video.

[0144] <2.4. Information processing flow> Next, the procedure of information processing by the information processing system 1A according to the second embodiment will be described with reference to Fig. 17. Fig. 17 is a flowchart showing the procedure of information processing by the information processing system 1A according to the second embodiment.

[0145] As shown in FIG. 17, the memory assistance device 100A determines whether or not a learning word from a commercially available dictionary designated in advance by the user appears in the subtitles of the video moving image that the user is viewing (step S401).

[0146] When the memory assistance device 100A determines that the subtitles of the video moving image being viewed by the user contain a learning word from a commercially available dictionary designated by the user in advance (step S401; YES), it changes the display mode of the learning word included in the target subtitle while the target subtitle containing the learning word is being displayed (step S402).On the other hand, when the memory assistance device 100A determines that the subtitles of the video moving image being viewed by the user do not contain a learning word from a commercially available dictionary designated by the user in advance (step S401; NO), it terminates information processing.

[0147] The memory assistance device 100A determines whether the user selected the training word whose display mode has been changed while the target subtitle was being displayed (step S403).

[0148] If the memory assistance device 100A determines that the user selected the training word whose display mode has been changed while the target subtitle was displayed (step S403; YES), it extracts the training word selected by the user and the target subtitle containing the training word selected by the user (step S404).On the other hand, if the memory assistance device 100A determines that the user did not select the training word whose display mode has been changed while the target subtitle was displayed (step S403; NO), it ends the information processing.

[0149] The memory assistance device 100A adds the extracted learning words to a first area of ​​a dictionary generated corresponding to the video being viewed by the user, so that the earlier the extracted target subtitle is displayed in the display order among the subtitles displayed in the video being viewed by the user, the higher it will be placed in the display order, and updates the dictionary by adding the extracted target subtitle to a second area of ​​the dictionary generated corresponding to the video being viewed by the user (step S405).

[0150] <2.5. Modifications> The information processing system 1A according to the above-described embodiment 2 may be implemented in various different forms other than the above-described embodiment 2. Therefore, other embodiments of the information processing system 1A will be described below.

[0151] (Variation 7: Changing the display format of other study words) In the second embodiment, when a learning word from a commercially available dictionary designated by the user appears in the subtitles of the video being viewed by the user, the display change unit 137 changes the display mode of the learning word included in the subtitles while the learning word appears. However, for example, a user may have become proficient in the learning words of a specific commercially available dictionary and desire to memorize words that do not appear in that specific commercially available dictionary. For example, if a user has become proficient in the learning words of a specific commercially available dictionary for a specific qualification exam in order to pass the exam, the user may desire to memorize words that do not appear in that specific commercially available dictionary or learning words that appear in another specific commercially available dictionary for the qualification exam. In this way, a user may desire to memorize words that do not appear in the commercially available dictionary that the user has studied. Hereinafter, words that are not learning words in the commercially available dictionary designated by the user and that are included in the subtitles of the video being viewed by the user will be referred to as "other learning words" as appropriate.

[0152] If the subtitles of the video being watched by the user contain other lesson words that do not appear in a commercially available dictionary designated by the user, the display change unit 137 may change the display mode of the other lesson words included in the subtitles while the subtitles containing the other lesson words are displayed. For example, the display change unit 137 may change the display mode of the other lesson words that are not included in any of multiple commercially available dictionaries designated by the user. Then, when the user selects the other lesson words whose display mode has been changed by the display change unit 137 while the subtitles containing the other lesson words are being displayed, the extraction unit 132A extracts the other lesson words and their subtitles. For example, the extraction unit 132A determines whether the other lesson words whose display mode has been changed are included in a display frame displayed on the screen while the user is watching the video, and if it determines that the other lesson words are included in a display frame displayed on the screen while the user is watching the video, it extracts the other lesson words and subtitles containing the other lesson words. Then, the generation unit 133 adds the other learning words extracted by the extraction unit 132A to a first area corresponding to the video being watched by the user, and adds the subtitles extracted by the extraction unit 132A to a second area corresponding to the video being watched by the user, thereby generating a dictionary that compiles the other learning words selected by the user for each video.

[0153] (Variation 8: By specifying a dictionary, a dictionary for the video being viewed by the user is automatically generated.) In the second embodiment, the extraction unit 132A extracts a word (learning word, other learning word) whose display mode has been changed by the display change unit 137 and the subtitles containing that word when the user selects that word while the subtitles containing that word are being displayed. Here, the extraction unit 132A may automatically extract all combinations of learning words in a commercially available dictionary designated in advance by the user that appear in the subtitles of the video moving image the user is watching and subtitles that include those learning words, or all combinations of learning words that are not learning words in a commercially available dictionary designated in advance by the user that appear in the subtitles of the video moving image the user is watching and subtitles that include those learning words. For example, when the user starts watching a video, the acquisition unit 131A acquires information about the entire subtitles of the video that the user has started watching, and the extraction unit 132A may extract a combination of the study words and the subtitles, or a combination of another study word and the subtitles, by comparing the entire subtitles with study words in a commercially available dictionary designated by the user in advance based on the information about the entire subtitles acquired by the acquisition unit 131A (i.e., by identifying study words in a commercially available dictionary designated by the user in advance from the subtitles corresponding to the video that the user is watching).In this case, the acquisition unit 131A may acquire information about the entire subtitles of the video that the user has started watching by the user reading (scanning) code information (e.g., a QR code (registered trademark)) attached to a part of the video that the user has started watching. For example, the acquisition unit 131A may identify the video that the user has started to watch by the user reading, with the terminal device 10, code information attached to the main part, opening animation (animation for opening the video), or ending animation (animation for ending the video), of the video that the user has started to watch, and acquire information regarding the entire subtitles of the identified video. Note that when the user reads, with the terminal device 10, code information attached to a part of the video that the user has started to watch, the video is displayed on an external information processing device (for example, a display device) or the like.

[0154] (Variation 9: Specify the dictionary generated for the user) In the second embodiment, a case has been described in which a commercially available dictionary is designated as a dictionary for specifying words that the user wants to memorize. Specifically, the display change unit 137 changes the display manner of the learning words included in the subtitles based on whether or not learning words in a commercially available dictionary designated by the user appear in the subtitles of the video that the user is watching. Here, the user may designate a dictionary generated by the generation unit 133 as a dictionary for specifying words that the user wants to memorize. For example, the user may designate a dictionary generated from the video of "XXXYY1" (e.g., dictionary D1) as a dictionary for specifying words that the user wants to memorize. When the user designates a dictionary generated from the video of "XXXYY1," the display change unit 137 may change the display manner of the learning words included in the subtitles based on whether or not learning words in the dictionary generated from the video of "XXXYY1" (learning words added to the first area) appear in the subtitles of the video that the user is watching. In this way, when a learning word in a dictionary generated by the generation unit 133 and designated in advance by the user appears in the subtitles of a video being viewed by a user, the display change unit 137 may change the display mode of the learning word included in the subtitles while the subtitles containing the learning word appear. The user may specify a dictionary for specifying words the user wants to memorize by specifying a video. For example, by specifying the video "XXXXYY1," the user may specify a dictionary generated from the video "XXXXYY1" as the dictionary for specifying words the user wants to memorize. When a learning word in a dictionary generated from a video designated in advance by the user appears in the subtitles of a video being viewed by a user, the display change unit 137 may change the display mode of the learning word included in the subtitles while the subtitles containing the learning word appear are displayed.

[0155] In the seventh modification, the display modification unit 137 changes the display mode of other lesson words included in the subtitles based on whether or not lesson words from a commercially available dictionary previously specified by the user appear in the subtitles of the video currently being viewed by the user. If a lesson word from a dictionary previously specified by the user and generated by the generation unit 133 does not appear in the subtitles of the video currently being viewed by the user, the display modification unit 137 may change the display mode of other lesson words included in the subtitles while displaying the subtitles containing other lesson words. For example, if the user specifies a dictionary generated from the video "XXXXYY1," the display modification unit 137 may change the display mode of other lesson words included in the subtitles if a lesson word from a dictionary generated from the video "XXXXYY1" does not appear in the subtitles of the video currently being viewed by the user. In addition, when the subtitles of the video being watched by the user do not include any learning words in a dictionary generated from a video previously specified by the user, the display change unit 137 may change the display manner of other learning words included in the subtitles while subtitles in which other learning words appear are being displayed.

[0156] In the second embodiment, a case has been described in which a commercially available dictionary is designated as a dictionary for specifying words that the user does not want to include in the words the user wants to memorize. Specifically, the display modification unit 137 changes the display manner of the training words included in the target subtitles based on whether the training words included in the target subtitles are training words in a commercially available dictionary (another commercially available dictionary) designated in advance by the user to specify exclusion words. Here, the user may designate a dictionary generated by the generation unit 133 as a dictionary for specifying words that the user does not want to include in the words the user wants to memorize. For example, the user may designate a dictionary generated from the video "XXXXXYY1" as a dictionary for specifying words that the user does not want to include in the words the user wants to memorize. When the user designates a dictionary generated from the video "XXXXXYY1", the display modification unit 137 may change the display manner of the training words included in the target subtitles based on whether the training words included in the target subtitles are training words in a dictionary generated from the video "XXXXXYY1". In this way, when the training words included in the target subtitle are not training words in the dictionary generated by the generation unit 133 and designated in advance by the user, the display change unit 137 may change the display mode of the training words included in the target subtitle while the target subtitle is being displayed. Note that the user may specify a video to specify a dictionary for specifying words that the user does not want to include in the words the user wants to memorize. For example, by specifying the video "XXXXYY1," the user may specify a dictionary generated from the video "XXXXYY1" as a dictionary for specifying words that the user does not want to include in the words the user wants to memorize. When the training words included in the target subtitle are not training words in the dictionary generated from the video designated in advance by the user, the display change unit 137 may change the display mode of the training words included in the target subtitle while the target subtitle is being displayed.

[0157] <2.6.Effects> At least the following points become clear from the description of embodiment 2 and the accompanying drawings.

[0158] In the first aspect, when a learning word in a commercially available dictionary designated in advance by a user appears in the subtitles of a predetermined video currently being viewed by a user among subtitles in which speech spoken in a language corresponding to the user's attributes is translated into a predetermined language, a display change step is performed to change the display manner of the learning word included in the predetermined subtitles while the predetermined subtitles in which the learning word appears are being displayed; an extraction step is performed to extract the learning word and the predetermined subtitle when the user selects the learning word whose display manner has been changed by the display change step while the predetermined subtitles are being displayed; and a display change step is performed to extract the learning word and the predetermined subtitle from a first region set for each video. the predetermined subtitle extracted by the extraction step is added to a first area corresponding to the first area of ​​the video, and the predetermined subtitle extracted by the extraction step is added to a second area set for each video corresponding to the first area, the second area corresponding to the predetermined video for assisting memory of the learning words added to the first area; and the computer executes a generation step of generating a dictionary of learning words selected by the user for each video; and an update step of updating the dictionary generated by the generation step when learning words are added to the first area so that the earlier the predetermined subtitle is displayed in the subtitles of the predetermined video, the higher the learning word is displayed.

[0159] According to the first aspect, for example, if a word from a commercially available dictionary specified by the user appears in the subtitles of a video being viewed by the user, the display mode of the word can be changed to a predetermined mode while the subtitles containing the word are being displayed. For example, the font size can be increased, the font color can be made more eye-catching, the font can be highlighted, or text effects such as shadows and glows can be applied to the font. This allows the word from the commercially available dictionary specified by the user that appears in the subtitles of the video being viewed by the user to be emphasized, thereby making the word more memorable to the user even while the user is watching the video. Furthermore, if the word is one that the user wants to remember, a dictionary associating the word with the subtitle can be generated by selecting the word while the subtitles are being displayed. This allows a dictionary to be generated for each video the user watches. Furthermore, because the subtitles are displayed in association with the video, the user can recall the video in which the subtitles are displayed by reviewing the dictionary.

[0160] Furthermore, according to aspect 1, for example, while watching a video primarily targeted at viewers born and raised in the same culture as the user, subtitles in a different cultural language that the user is learning can be displayed in response to the video. This allows the user to view the subtitles while accurately understanding the video and audio of the video with the five senses. Therefore, even if the video is in a different cultural language, the user can effectively learn how to use words contained in translated sentences displayed as subtitles from the video. For example, the user can learn not only the meaning of the words but also how the words are used in conjunction with other words, in what situations, and when the speaker feels the words. Furthermore, by accurately understanding the usage of words from the video with the five senses, not only can the video with the subtitles be recalled from the words, but also the words can be recalled from the video. Therefore, the user can recall the words simply by casually recalling the video in everyday life outside of learning. Furthermore, video primarily targeted at viewers born and raised in the same culture as the user is easy for the user to understand, and thus the user can casually recall not only the video but also the audio, thereby facilitating word recall.

[0161] Furthermore, according to aspect 1, for example, the order of words contained in the dictionary can be rearranged to match the order of subtitles displayed in a video, thereby displaying the words in the order of the video story. Therefore, by viewing the words contained in the dictionary in the correct order, a user can recall the story of the video, and thus recall the meanings and uses of the words. In this way, the story of the video can be treated as a whole, making it easier to recall the meanings and uses of words that appear in the subtitles of the video. This eliminates the need to individually check whether the meaning and use of each word can be recalled, thereby reducing the burden on the user when reviewing.

[0162] Aspect 2 is characterized in that in aspect 1, the display mode of the study words included in at least one of a plurality of commercially available dictionaries designated in advance by the user is changed.

[0163] According to aspect 2, for example, by specifying multiple commercially available dictionaries, a user can specify more word candidates to be added to the dictionary. Therefore, for example, by specifying multiple dictionaries for a specific qualification exam (e.g., study books or vocabulary books), a user can ensure that all words required for the specific qualification exam are included as candidates. Furthermore, when a word candidate included in one of the specified dictionaries appears in the subtitles, the display mode of the candidate can be changed to a predetermined mode while the subtitles are being displayed. Therefore, for example, by specifying multiple dictionaries for a specific qualification exam, a greater number of words that are the subject of the specific qualification exam can be emphasized. Furthermore, the meanings and usages of a greater number of words that are the subject of the specific qualification exam can be emphasized. Therefore, a greater number of words can be effectively memorized in line with the user's learning goals.

[0164] Aspect 3 is characterized in that, in aspect 1, when the predetermined subtitles correspond to the speech of the main character of the predetermined video video that the user is watching, the manner in which the learning words contained in the predetermined subtitles are displayed is changed.

[0165] According to the third aspect, for example, a word that a user wants to memorize can be emphasized based on whether or not the word is included in subtitles corresponding to the speech of a character (main character) central to the story of a video. Therefore, the word can be memorized in association with an image of the main character (for example, an image or audio of the main character when the main character makes an utterance corresponding to the subtitle of the word). Furthermore, since a user's preferences for a video are often due to the main character, associating the word with an image of the main character allows the user to memorize the word comfortably and without resistance. Furthermore, the more important the main character is among the main characters in the video the user is watching, the more easily and comfortably the user can memorize the word without feeling like they are learning.

[0166] Aspect 4 is characterized in that, in aspect 1, when the predetermined subtitles correspond to the speech of a character whose characteristics are in line with the user's preferences, the manner in which the learning words contained in the predetermined subtitles are displayed is changed.

[0167] According to the fourth aspect, for example, a word that a user wants to memorize can be emphasized based on whether or not the word is included in subtitles corresponding to the speech of a character whose characteristics match the user's preferences. Therefore, the word can be memorized in association with an image of a character whose characteristics match the user's preferences. Furthermore, by associating the word with an image of a character whose characteristics match the user's preferences, the word can be memorized comfortably and without resistance. Furthermore, the more the character whose characteristics match the user's preferences, the more comfortably and smoothly the word can be memorized without the user feeling that they are learning.

[0168] Aspect 5 is characterized in that, in aspect 1, when the predetermined subtitles correspond to the speech of a character whose characteristics are in line with the preferences of another user who generated the dictionary from a predetermined video that the user is watching, the manner in which the learning words contained in the predetermined subtitles are displayed is changed.

[0169] According to the fifth aspect, for example, a word that a user wants to memorize can be emphasized based on whether it is included in subtitles corresponding to the speech of a character whose characteristics match the preferences of another user who created a dictionary from the video the user is watching. Therefore, even if the user's character preferences cannot be determined, the word to be emphasized can be selected based on the character preferences of the other user who created a dictionary from the video the user is watching. Furthermore, the user's character preferences may be similar to the character preferences of the other user who created a dictionary from the video the user is watching. Therefore, by associating a word with an image of a character whose characteristics match the preferences of the other user who created a dictionary from the video the user is watching, the user may be able to memorize the word comfortably and without resistance. For example, if the character also matches the preferences of the user, the user may be able to memorize the word comfortably and without resistance. Furthermore, the more the character's characteristics match the preferences of the other user who created a dictionary from the video the user is watching, the more the user may be able to memorize the word comfortably and without feeling like they are learning. For example, if a character has characteristics that are in line with the preferences of other users who have created dictionaries from the video footage the user is watching, and the character also has characteristics that are in line with the user's preferences, the user will be able to memorize the word comfortably and without feeling like they are learning.

[0170] Aspect 6 is characterized in that, in aspect 1, when the predetermined subtitles are subtitles that correspond to the speech of a character whose characteristics are in line with the preferences of another user similar to the user, identified based on a comparison between a list of videos for which the user generated the dictionary and a list of videos for which another user generated the dictionary, the display manner of the learning words contained in the predetermined subtitles is changed.

[0171] According to the sixth aspect, for example, a word that a user wants to memorize can be emphasized based on whether it is included in the subtitles corresponding to the speech of a character whose characteristics match the preferences of other users whose list of videos from which the dictionary was generated is similar to the list of videos from which the dictionary was generated. Therefore, even if the user's preferences for characters cannot be determined, the word to be emphasized can be selected based on the preferences of other users whose list of videos from which the dictionary was generated is similar to the list of videos from which the dictionary was generated. Furthermore, the user's preferences for characters may be similar to the preferences of other users whose list of videos from which the dictionary was generated is similar to the list of videos from which the dictionary was generated. Therefore, by associating a word with a character whose characteristics match the preferences of other users whose list of videos from which the dictionary was generated is similar, the user may be able to memorize the word comfortably and without resistance. For example, if the character also matches the preferences of the user, the user may be able to memorize the word comfortably and without resistance. Furthermore, the more characters whose characteristics match the preferences of other users whose list of videos from which the dictionary was generated is similar to the list of videos from which the dictionary was generated, the more comfortable the user may be to memorize the word without feeling like they are learning. For example, if the list of video animations from which the dictionary was generated contains characters with characteristics that are in line with the preferences of similar users, and if the characters also have characteristics that are in line with the user's preferences, the user can memorize the words comfortably and without feeling like they are learning.

[0172] Aspect 7 is characterized in that, in aspect 1, when the specified video video that the user is watching is a video video with characteristics that match the user's preferences, the display manner of the learning words contained in the specified subtitles is changed.

[0173] According to aspect 7, for example, based on whether the video being viewed by the user has characteristics that match the user's preferences, words that appear in the subtitles of the video being viewed by the user and that the user wants to memorize can be emphasized. Therefore, the words can be associated with images in the video that match the user's preferences and memorized. Furthermore, by associating the words with images in the video that match the user's preferences, the words can be memorized comfortably and without resistance. Furthermore, the more the video has characteristics that match the user's preferences, the more easily the user can memorize the words without feeling like they are learning.

[0174] Aspect 8 is characterized in that, in aspect 1, when the specified video being watched by the user is a video with characteristics that match the preferences of another user who generated the dictionary from the specified video, the display manner of the learning words contained in the specified subtitles is changed.

[0175] According to the eighth aspect, for example, based on whether the video being viewed by the user has characteristics that match the preferences of other users who generated dictionaries from the video being viewed, it is possible to highlight words that appear in the subtitles of the video being viewed by the user and that the user wants to remember. Therefore, even if the user's preferences for the video cannot be determined, it is possible to select words to highlight based on the preferences for the video of other users who generated dictionaries from the video being viewed by the user. Furthermore, the user's preferences for the video may be similar to the preferences for the video of other users who generated dictionaries from the video being viewed by the user. Therefore, by associating a word with a video in such a video that matches the preferences of other users who generated dictionaries from the video being viewed by the user, it may be possible to help the user memorize the word comfortably and without resistance. For example, if the video also has characteristics that match the user's preferences, the user can memorize the word comfortably and without resistance. Furthermore, the more video that matches the preferences of other users who generated dictionaries from the video that the user is currently watching, the more easily the user can memorize the words without feeling that they are learning. For example, if the video that matches the preferences of other users who generated dictionaries from the video that the user is currently watching, and the video also matches the preferences of the user, the more easily the user can memorize the words without feeling that they are learning.

[0176] Aspect 9 is characterized in that, in aspect 1, when the specified video video being watched by the user is a video video with characteristics that are in line with the preferences of other users similar to the user, identified based on a comparison of a list of video videos for which the user generated the dictionary with a list of video videos for which other users generated the dictionary, the display manner of the learning words included in the specified subtitles is changed.

[0177] According to the ninth aspect, for example, based on whether the video being watched by the user is a video with characteristics that match the preferences of other users whose list of videos from which the dictionary was generated is similar to the list of videos from which the dictionary was generated, it is possible to highlight words that appear in the subtitles of the video being watched that the user wants to remember. Therefore, even if the user's preferences for video cannot be determined, it is possible to select words to highlight based on the preferences of other users whose list of videos from which the dictionary was generated is similar. Furthermore, the user's preferences for video may be similar to the preferences of other users whose list of videos from which the dictionary was generated is similar. Therefore, by associating a word with a video from such a video with characteristics that match the preferences of other users whose list of videos from which the dictionary was generated is similar, it may be possible to allow the user to memorize the word comfortably and without resistance. For example, if the video is also a video with characteristics that match the user's preferences, the user can memorize the word comfortably and without resistance. Furthermore, the more videos from which the dictionary is generated have characteristics that are in line with the preferences of similar users, the more easily the user can memorize the words without feeling that they are learning. For example, if the more videos from which the dictionary is generated have characteristics that are in line with the preferences of similar users, and the more easily the user can memorize the words without feeling that they are learning, the more easily the user can memorize the words without feeling that they are learning.

[0178] Aspect 10 is characterized in that, in aspect 1, if a learning word included in the specified subtitle is not a word previously designated as an excluded word that is not to be added to the first area in order to generate the dictionary, the manner in which the learning word is displayed is changed.

[0179] According to aspect 10, for example, a word that a user wants to memorize can be emphasized based on whether the word is a word that the user has previously designated as a word not to be added to the dictionary. Therefore, words to be emphasized can be selected based on two types of word designations: words that the user wants to memorize and words that the user does not want to include in the words the user wants to memorize (for example, words that the user has already memorized, or words that do not have a distinctive meaning as a single word, such as pronouns and articles). Therefore, the user can select words to be emphasized by selectively designating two types of words: words that the user wants to memorize and words that the user does not want to include in the words the user wants to memorize, thereby enabling the user to learn words that are in line with their learning goals.

[0180] Aspect 11 is characterized in that, in aspect 10, if the learning word included in the specified subtitle is not a learning word in a commercially available dictionary specified by the user to specify the excluded word, the display manner of the learning word is changed.

[0181] According to aspect 11, for example, a word that a user wants to memorize can be emphasized based on whether the word is included in a commercially available dictionary that the user has specified to specify words not to be added to the dictionary. Therefore, words to be emphasized can be selected based on the specification of two types of commercially available dictionaries: a commercially available dictionary for specifying words the user wants to memorize, and a commercially available dictionary for specifying words the user does not want to include in the words the user wants to memorize. Therefore, the user can select words to be emphasized by selectively specifying two types of commercially available dictionaries: a commercially available dictionary for specifying words the user wants to memorize, and a commercially available dictionary for specifying words the user does not want to include in the words the user wants to memorize. This allows the user to learn words that are in line with their learning goals.

[0182] Aspect 12 is characterized in that, in aspect 1, the video is composed of multiple episodes, each episode having a predetermined length, and the dictionary generated by the generation procedure is updated so that the earlier the episode in which the predetermined subtitle appears among the multiple episodes constituting the predetermined video, the higher the learning words are displayed.

[0183] According to aspect 12, for example, the order of words contained in the dictionary can be rearranged taking into account the order of the stories (episodes) of a video. Therefore, even if a video consists of multiple stories, a user can recall the story of the video by viewing the words contained in the dictionary in the correct order. Furthermore, by taking the story order into account, the order of words appearing in the subtitles of each story becomes similar, making it easier to recall the story of each story. Therefore, a user can recall the story of each story by viewing the words contained in the dictionary in the correct order. Furthermore, by recalling the story of each story, the user can recall the story of the entire multiple story. Therefore, recall of the story is easier both in the case of a video in which each story is complete, and in the case of a video in which the story is complete as a whole of multiple story. Furthermore, since each story has a predetermined length, it is easier to recall the story of each story, and therefore easier to recall the words. In this way, by treating the story of each story as a whole, it is easier to recall the meaning and usage of words that appear in the subtitles of each story.

[0184] Aspect 13 is characterized in that, in aspect 1, it further includes a display procedure for displaying video images that are part of a specified video that was displayed when the learning words were selected in an order corresponding to the learning words added to a first area corresponding to the specified video selected from the video for which the dictionary was generated by the generation procedure.

[0185] According to aspect 13, for example, video images corresponding to words in a dictionary can be displayed in an order corresponding to the order of the words. This allows a user to review whether or not they can recall the meaning and usage of a word simply by viewing the video images in an order corresponding to the order of the words, without looking at the words in the dictionary. In this way, video images from a video that suits the user's preferences can be displayed, rather than a list of characters like in a dictionary, allowing the user to review without feeling like they are actually learning. Furthermore, the more video images from a video that suits the user's preferences, the easier it is for the user to recall the content before and after the video image just by viewing the video image, allowing for a deeper understanding of the meaning and usage of a word not only during study but also during review.

[0186] Aspect 14 is characterized in that in aspect 13, an impressive video image is displayed from among the video images displayed during the scene of the video image displayed when the learning word is selected.

[0187] According to the fourteenth aspect, for example, the most impressive video image among the scenes in the target video image can be displayed, thereby making it easier for the user to recall the scene. Therefore, by viewing such video image, the user can recall the entire scene, including the scenes before and after the target video image, thereby gaining a deeper understanding of the meaning and usage of the target word. Furthermore, impressive video images often contain characteristic information (e.g., effects) that differs from other videos in the scene, or at least one of the main characters in the video. Therefore, the more the video image is in line with the user's preferences, the more likely the user is to review the material without feeling like they have actually learned. Furthermore, for example, by displaying the target video image together with other impressive video images in the scene, the content before and after the target video image can be linked to the entire scene and recalled.

[0188] Aspect 15 is characterized in that, in aspect 13, the dictionary is generated by extracting a video image that is part of the specified video excluding the specified subtitles, which was displayed when the learning word was selected, and adding the video image extracted by the extraction procedure to a third area set for each video corresponding to the first area, which corresponds to the specified video, and which is intended to assist in memorizing the learning words added to the first area; the video image added to the third area and the learning word added to the first area corresponding to the video image are extracted from the dictionary generated by the generation procedure; and the video image is displayed by superimposing the learning word on the video image.

[0189] According to aspect 15, for example, video images from a video viewed by a user can be added to a dictionary and displayed. Therefore, recalling the video images naturally recalls the context surrounding the images. This allows users to review not only the words and video images by associating them with each other, but also the context surrounding the images. Furthermore, the video images are displayed in an order corresponding to the order of the words in the dictionary. Therefore, viewing the video images in that order allows users to recall the story of the video, thereby recalling the meanings and usages of words they understood while watching the video. Furthermore, superimposing words on video images allows users to more deeply associate and memorize the words and video images, making it easier to recall video images from words and vice versa. Furthermore, the more a video image is in line with a user's preferences, the more opportunities there are for users to recall the information at casual moments, allowing users to memorize the information naturally in their daily lives without feeling like they are learning.

[0190] Aspect 16 is characterized in that, in aspect 13, the dictionary is generated by extracting a video image that is part of the specified video excluding the specified subtitles, which was displayed when the learning word was selected, and adding the video image extracted by the extraction procedure to a third area set for each video corresponding to the first area, which corresponds to the specified video, and which is intended to assist in memorization of the learning words added to the first area; the video image added to the third area and the specified subtitle added to the second area corresponding to the video image are extracted from the dictionary generated by the generation procedure; and the video image is displayed by superimposing the specified subtitles on the video image.

[0191] According to aspect 16, for example, video images from a video viewed by a user can be added to a dictionary and displayed. Therefore, recalling a video image naturally recalls the context surrounding the image. This allows not only the user to review the video by associating the words with the video image, but also the context surrounding the video image. Furthermore, the video images are displayed in an order corresponding to the order of the words in the dictionary. Therefore, viewing the video images in that order allows the user to recall the story of the video, thereby recalling the meaning and usage of words understood while watching the video. Furthermore, superimposing subtitles on the video image allows the user to more deeply associate and memorize the words contained in the subtitles with the video image. Furthermore, subtitles aid in recalling the context surrounding the video image, allowing the context surrounding the video image to be associated and memorized. This facilitates recall of video images from words and vice versa. Furthermore, the more a video image is in line with a user's preferences, the more opportunities there are for casual recall, allowing the user to memorize the information naturally in everyday life without feeling like they are learning.

[0192] Aspect 17 is characterized in that, in aspect 1, it further includes a proposal procedure for proposing, as candidates for generating a new dictionary, one or more video videos that include in their subtitles one or more of the learning words added to the first area of ​​a specified dictionary selected from the dictionaries generated by the generation procedure.

[0193] According to aspect 17, for example, a user can review words that appear in the subtitles of a video in another video, thereby solidifying the memory of the words. Furthermore, a user can check how words that appear in the subtitles of a video are used in other video, thereby enabling a deeper understanding of the meaning and usage of the words. Furthermore, since other video containing more words that appear in the subtitles of a video may have similar characteristics (e.g., the worldview, story, or main character characteristics) to the video, other video with similar characteristics to the video can be suggested as a candidate for the next video to watch after the user has finished watching the video. Therefore, a user can comfortably watch other video after watching the video, allowing for comfortable vocabulary learning using other video.

[0194] Aspect 18 is characterized in that, in aspect 17, one or more video videos that contain in their subtitles one or more learning words added to the first area of ​​the specified dictionary and that have characteristics similar to the specified video video from which the specified dictionary was generated are proposed as candidates.

[0195] According to aspect 18, for example, words included in the subtitles of another video but not appearing in the subtitles of one video may be co-occurring words or synonyms (including homonyms) widely used in relation to words that appear in the subtitles of one video, and co-occurring words and synonyms are easy to remember together, making it easier to memorize words included in a dictionary generated from another video. Furthermore, in the case of co-occurring words or synonyms, even words that did not appear in the subtitles of one video may be inferred by recalling the story of the one video, making it easier to memorize words included in a dictionary generated from another video.

[0196] Aspect 19 is characterized in that, in aspect 18, based on the characteristics of the main characters of the specified video video for which the specified dictionary was generated, a video video including a main character with characteristics similar to those of one of the main characters is proposed as the candidate.

[0197] According to aspect 19, for example, words included in the subtitles of other video videos that did not appear in the subtitles of one video video may be widely used words corresponding to the speech of a character with characteristics similar to those of the main character who made the utterance corresponding to the word that appeared in the subtitles of the one video video. This makes it easier to memorize words included in a dictionary generated from other video videos. Furthermore, because a user's preferences for video videos are often due to the characteristics of the main character, the user can comfortably watch other video videos without any resistance. This allows the user to comfortably learn words using other video videos without any resistance or resistance, without feeling like they are learning.

[0198] Aspect 20 is characterized in that, in aspect 17, one or more video videos are suggested as candidates based on the characteristics of other video videos for which the user generated the dictionary, among video videos that contain in their subtitles one or more of the learning words added to the first area of ​​the specified dictionary.

[0199] According to aspect 20, for example, it is possible to suggest other video videos for which dictionaries other than the target dictionary have been generated based on the characteristics of other video videos for which dictionaries have not been generated, thereby making it possible to suggest video videos that suit the user's preferences.

[0200] Aspect 21 is characterized in that, in aspect 20, based on the characteristics of the main characters of other video videos for which the user generated the dictionary, video videos are suggested as candidates that include a character with a main character having characteristics similar to those of one of the main characters.

[0201] According to aspect 21, for example, it is possible to suggest other video videos for which dictionaries other than the target dictionary have been generated based on the characteristics of the main characters of other video videos, thereby making it possible to suggest video videos that include a main character with characteristics that match the user's preferences.

[0202] Aspect 22 is characterized in that, in aspect 21, video videos are proposed as candidates that include a main character whose characteristics are in line with the user's preferences, estimated based on the characteristics of the main character of the other video videos.

[0203] According to aspect 22, for example, it is possible to suggest video videos that include a main character whose characteristics match the user's preferences, allowing the user to comfortably learn words using other video videos without feeling like they are actually learning.

[0204] <<3. Embodiment 3>> <3.1. Introduction> In the second embodiment, a user may desire to easily identify subtitles that allow learning of target vocabulary according to the user's learning goal, even while watching a video. For example, if the user's learning goal is to pass a specific qualification exam, the user may desire to easily identify subtitles that allow learning of target vocabulary for the specific qualification exam, even while watching a video.

[0205] The third embodiment has been made in view of the above, and aims to make it easier for a user to effectively memorize words that the user wants to memorize in accordance with the user's learning goals.

[0206] <3.2. Information Processing System Configuration> An information processing system 1B shown in Fig. 18 will be described. As shown in Fig. 18, the information processing system 1B includes a terminal device 10, a display device 20, a memory assistance device 100B, and a video / movie distribution server 200. The terminal device 10, the display device 20, the memory assistance device 100B, and the video / movie distribution server 200 are communicably connected via a predetermined communication network (network N) by wire or wirelessly. Fig. 18 is a diagram showing an example of the configuration of an information processing system 1B according to embodiment 3. In embodiment 3, descriptions similar to those of the above embodiment (embodiment 1 or embodiment 2) will be omitted as appropriate.

[0207] The terminal device 10 activates the camera in response to a user's operation, and reads code information included in the range that can be captured at the angle of view to which the camera is pointed. For example, when the camera is pointed at the display device 20, the terminal device 10 reads code information displayed on the screen of the display device 20. In the third embodiment, when the user is watching the opening animation of a video, the user points the camera at the display device 20 to read the code information attached to the opening animation. Then, the terminal device 10 transmits the read code information to the memory assistance device 100B. The terminal device 10 also displays a dictionary generated by the memory assistance device 100B.

[0208] The display device 20 is an information processing device for displaying video images distributed from the video image distribution server 200. The display device 20 may be any device that can implement the processing in the third embodiment. The display device 20 may also be a device such as a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, or a PDA. The display device 20 may also be a television. For example, the display device 20 may be an exhibition television set in a shopping center or the like.

[0209] The display device 20 is, for example, a smart device such as a smartphone or a tablet, and is a mobile terminal device that can communicate with any server device via a wireless communication network such as 4G to 6G or LTE. The display device 20 has a screen such as a liquid crystal display with a touch panel function, and may accept various operations on display data such as content, such as tapping, sliding, scrolling, etc., using a finger or a stylus from an administrator or user of the display device 20.

[0210] The memory assistance device 100B is an information processing device that aims to facilitate effective memorization of words that a user wants to memorize in accordance with the user's learning goal. The memory assistance device 100B may be any device that can realize the processing in embodiment 3. For example, the memory assistance device 100B may be realized by a server device, a cloud system, or the like.

[0211] The video distribution server 200 is an information processing device for distributing video. The video distribution server 200 distributes video with subtitles translated into a language that a user is learning. For example, if the user is learning English, the video distribution server 200 distributes video in which subtitles translated into English are displayed along with audio spoken in the user's language. For example, the video distribution server 200 distributes subtitle information to be displayed on the video together with the video data of the video. Furthermore, the video distribution server 200 distributes code information together with the video data and subtitle information of the video to display the code information in at least a part of the main part of the video, the opening animation of the video, and the ending animation of the video. The video distribution server 200 may be any device capable of implementing the processing described in the third embodiment. For example, the video distribution server 200 may be implemented by a server device, a cloud system, or the like.

[0212] The video and moving image distribution server 200 receives a video and moving image distribution request from an administrator of the display device 20, and distributes the video and moving image requested by the administrator of the display device 20 to the display device 20. In this case, the video and moving image distribution server 200 receives a distribution request transmitted from the display device 20. The video and moving image distribution server 200 may also receive a video and moving image distribution request from a user, and distribute the video and moving image requested by the user to the display device 20. In this case, the video and moving image distribution server 200 receives a distribution request transmitted from the terminal device 10. In addition, if the user is the administrator of the display device 20, the video and moving image distribution server 200 may receive a video and moving image distribution request transmitted from the display device 20 by the user. In addition, the video and moving image distribution server 200 may distribute to the display device 20 a video and moving image specified by the administrator of the memory assistance device 100B. In addition, the video and moving image distribution server 200 may distribute to the display device 20 a video and moving image specified by the administrator of the video and moving image distribution server 200. Furthermore, the video / moving image distribution server 200 may distribute to the display device 20 video / moving images designated in advance according to a television broadcasting time slot.

[0213] Here, a description will be given of the storage unit of the video / movie distribution server 200 according to embodiment 3. The video / movie distribution server 200 has a video / movie storage unit 220. The video / movie storage unit 220 is realized by, for example, a semiconductor memory element such as RAM or flash memory, or a storage device such as a hard disk or optical disk.

[0214] The video / movie storage unit 220 stores information related to video / movie. Fig. 19 shows an example of the video / movie storage unit 220 according to the third embodiment. Fig. 19 is a diagram showing an example of the video / movie storage unit 220 according to the third embodiment. As shown in Fig. 19, the video / movie storage unit 220 has items such as "video / movie ID", "video", "subtitles", "code information 1 (for main feature)", "code information 2 (for opening)", and "code information 3 (for ending)".

[0215] "Video ID" indicates identification information for identifying a video. "Video" indicates a video. In the example shown in FIG. 19, conceptual information such as "video #1" and "video #2" is stored in "video." However, in reality, video data of a video is stored for each video. In addition, "video" may store information such as a uniform resource locator (URL) where the video data is located or a file path name indicating the storage location. "Subtitle" indicates subtitles displayed in a video. In the example shown in FIG. 19, conceptual information such as "subtitle #1" and "subtitle #2" is stored in "subtitle." However, in reality, word information constituting the subtitle is stored for each subtitle. In addition, "subtitle" may store information such as the timing at which the subtitle is displayed in the video together with the subtitle. For example, if the subtitle "subtitle #1" is displayed for five seconds one minute after the start of the video, "subtitle" may store information such as the timing at which the subtitle is displayed one minute after the start of the video. For example, information such as 1:00 to 1:05 may be stored in "subtitles." "Code information 1 (for main feature)" indicates code information for the main feature of a video. Specifically, "code information 1 (for main feature)" indicates code information that is displayed on the screen of the display device 20 together with the main feature of the video that a user is watching when the user is watching the video. In the example shown in FIG. 19, conceptual information such as "code information #11" and "code information #12" is stored in "code information 1 (for main feature)," but in reality, code information such as a QR code (registered trademark) is stored for each video. By reading the code information in "code information 1 (for main feature)," the video that the user is watching is identified, and it is also identified that the user read the code information attached to the main feature of the video when watching the main feature of the video. "Code information 2 (for OP)" indicates code information for the opening animation of the video. Specifically, "code information 2 (for OP)" indicates code information that is displayed on the screen of the display device 20 together with the opening animation of the video that the user is viewing when the user is viewing the video.In the example shown in FIG. 19, conceptual information such as "code information #21" and "code information #22" is stored in "code information 2 (for OP)," but in reality, code information such as a QR code (registered trademark) is stored for each video. By reading the code information in "code information 2 (for OP)," the video that the user is watching is identified, and it is also identified that the user read the code information attached to the opening animation of the video while watching the opening animation of the video. "Code information 3 (for ED)" indicates code information for the ending animation of the video. Specifically, "code information 3 (for ED)" indicates code information that is displayed on the screen of the display device 20 together with the ending animation of the video that the user is watching when the user is watching the video. In the example shown in FIG. 19, conceptual information such as "code information #31" and "code information #32" is stored in "code information 3 (for ED)," but in reality, code information such as a QR code (registered trademark) is stored for each video. By reading the code information of "Code Information 3 (for ED)", the video that the user is watching is identified, and it is also determined that the user read the code information attached to the ending animation of the video when watching the ending animation of the video.

[0216] That is, Figure 19 shows an example in which the video data of the video identified by the video ID "M1" is "video #1", the subtitles displayed in the video are "subtitle #1", "subtitle #2", ..., "subtitle #N", the code information displayed in the main part of the video is "code information #11", the code information displayed in the opening animation of the video is "code information #21", and the code information displayed in the ending animation of the video is "code information #31".

[0217] 19 shows a case where the video / movie storage unit 220 has items such as "Code Information 1 (for main feature)," "Code Information 2 (for OP)," and "Code Information 3 (for ED)," and stores code information for the main feature of the video, code information for an opening animation of the video, and code information for an ending animation of the video, but is not limited to this example. The video / movie storage unit 220 may issue code information including information about the display device 20 that is the distribution destination when distributing the video, each time it receives a distribution request for the video. Specifically, the video / movie storage unit 220 may issue three types of code information, one for the main feature of the video, one for an opening animation of the video, and one for an ending animation of the video, including information about the display device 20 that is the distribution destination when distributing the video, each time it receives a distribution request for the video.

[0218] 18 shows a case where the terminal device 10 and the memory assistance device 100B are separate devices, but the terminal device 10 and the memory assistance device 100B may be integrated. Also, a case where the display device 20 and the video / movie distribution server 200 are separate devices is shown, but the display device 20 and the video / movie distribution server 200 may be integrated. Also, a case where the memory assistance device 100B and the video / movie distribution server 200 are separate devices is shown, but the memory assistance device 100B and the video / movie distribution server 200 may be integrated.

[0219] <3.3. Configuration of memory support device> Next, the configuration of a memory assistance device 100B according to the third embodiment will be described with reference to FIG. 20. FIG. 20 is a diagram showing an example of the configuration of the memory assistance device 100B according to the third embodiment. As shown in FIG. 20, the memory assistance device 100B has a communication unit 110, a memory unit 120A, and a control unit 130B. The memory assistance device 100B may also have an input unit that accepts various operations from an administrator of the memory assistance device 100B, and a display unit that displays various information. The communication unit 110 and the memory unit 120A are the same as those in the above embodiment (embodiment 1 or embodiment 2), and therefore description thereof will be omitted.

[0220] (control unit 130B) The control unit 130B is a controller, and is realized by, for example, a CPU, an MPU, or the like, executing various programs stored in a storage device inside the memory assistance device 100B using RAM as a work area. The control unit 130B is also realized by, for example, an integrated circuit such as an ASIC or FPGA.

[0221] 20, the control unit 130B has an acquisition unit 131B, an extraction unit 132B, a generation unit 133, an update unit 134, a display unit 135, a proposal unit 136, and a display control unit 138, and realizes or executes the information processing action described below. Note that the internal configuration of the control unit 130B is not limited to the configuration shown in FIG. 20, and may be any other configuration as long as it performs the information processing described below. Note that the generation unit 133, the update unit 134, the display unit 135, and the proposal unit 136 are the same as those in the above embodiment, and therefore description thereof will be omitted.

[0222] (Acquisition part 131B) The acquisition unit 131B acquires the same information as the acquisition unit 131 or the acquisition unit 131A. Furthermore, the acquisition unit 131B acquires code information transmitted from the terminal device 10 by the user reading code information displayed on the screen of the display device 20 with the terminal device 10. Furthermore, the acquisition unit 131B acquires information related to subtitles of the video identified as the video being viewed by the user based on the acquired code information (or subtitles predetermined and linked to the acquired code information). For example, the acquisition unit 131B acquires information related to subtitles displayed in the main part of the video. Note that the acquisition unit 131B may acquire information related to some of the subtitles displayed in the main part of the video.

[0223] The acquiring unit 131B acquires information about the display device 20 whose code information has been read by the user with the terminal device 10, in order to identify the display device 20 to which the control information is to be transmitted by the display control unit 138 (described later). For example, the acquiring unit 131B transmits information about the video identified as the video being viewed by the user based on the acquired code information to the video distribution server 200, and the video distribution server 200 transmits information about the display device 20 to which the video has been distributed (or is currently being distributed) to the memory assistance device 100B, thereby acquiring information about the display device 20 whose code information has been read by the user with the terminal device 10. Note that, when there are multiple display devices 20 to which the video distribution server 200 has distributed (or is currently distributing) the video, the acquiring unit 131B identifies the display device 20 located within a predetermined range from the terminal device 10 (for example, located closest to the terminal device 10) based on the location information of the terminal device 10 and the respective location information of the multiple display devices 20, and acquires information about the identified display device 20. The video / movie distribution server 200 may identify the display devices 20 located within a predetermined range from the terminal device 10 based on the location information of the terminal device 10 and the location information of each of the plurality of display devices 20, and transmit information about the identified display devices 20 to the memory assistance device 100B, so that the acquisition unit 131B acquires information about the identified display devices 20. Furthermore, if the video / movie distribution server 200 issues code information including information about the display devices 20 to be distributed when distributing the video each time it receives a video distribution request, the acquisition unit 131B acquires information about the display devices 20 whose code information the user reads with the terminal device 10 from the acquired code information.

[0224] (Display control unit 138) If a learning word from a commercially available dictionary specified by the user appears in the subtitles of the video being viewed by the user, the display control unit 138 transmits control information for displaying only the subtitles containing the learning word. Specifically, if a learning word from a commercially available dictionary specified by the user appears in the subtitles of the video being viewed by the user based on the code information acquired by the acquisition unit 131B, the display control unit 138 transmits control information for displaying only the subtitles containing the learning word. Note that the display control unit 138 may determine whether a learning word from a commercially available dictionary specified by the user appears in the subtitles of the video being viewed by the user, and if it determines that the learning word appears, it may transmit control information for displaying only the subtitles containing the learning word by identifying the learning word and the subtitles containing the learning word in advance. Similarly, if the user has specified multiple commercially available dictionaries, the display control unit 138 may transmit control information for displaying only the subtitles containing the learning word from at least one of the multiple commercially available dictionaries specified by the user.

[0225] For example, if the learning word appears in the subtitle "subtitle #1" of the video currently being viewed by the user, but the learning word does not appear in the subtitle "subtitle #2" of the video currently being viewed by the user, the display control unit 138 transmits control information to display the subtitle "subtitle #1" and not display the subtitle "subtitle #2" while the user is watching the video. For example, if the subtitle "subtitle #1" is predetermined to be displayed for five seconds one minute after the start of the video, and the subtitle "subtitle #2" is predetermined to be displayed for five seconds one minute and ten seconds after the start of the video, when the display control unit 138 transmits control information to the display device 20 to display the subtitle "subtitle #1" and not display the subtitle "subtitle #2," the subtitle "subtitle #1" will be displayed on the screen of the display device 20 for five seconds one minute after the start of the video, but the subtitle will not be displayed on the screen of the display device 20 for five seconds one minute and ten seconds after the start of the video. In addition, if the subtitle "subtitle #3" that is predetermined to be displayed for 5 seconds 1 minute 10 seconds after the start of the video is a subtitle that contains a learning word from a commercially available dictionary that the user has previously specified, then the subtitle "subtitle #3" will be displayed for 5 seconds 1 minute 10 seconds after the start of the video on the screen of the display device 20, even if the subtitle "subtitle #2" is not displayed.

[0226] The display control unit 138 may transmit control information for displaying subtitles containing study words from a commercially available dictionary designated in advance by the user if the subtitles correspond to the speech of the main character in the video being viewed by the user, and for not displaying the subtitles if the subtitles do not correspond to the speech of the main character in the video being viewed by the user. Specifically, the display control unit 138 may determine whether subtitles containing study words from a commercially available dictionary designated in advance by the user correspond to the speech of the main character in the video being viewed by the user, and for displaying subtitles determined to correspond to the speech of the main character in the video being viewed by the user, and for not displaying subtitles determined to not correspond to the speech of the main character in the video being viewed by the user. For example, if the subtitle "subtitle #1" is determined to be a subtitle that corresponds to the speech of the main character in the video currently being viewed by the user, and the subtitle "subtitle #2" is determined to be a subtitle that does not correspond to the speech of the main character in the video currently being viewed by the user, then when the display control unit 138 sends control information to the display device 20 to display the subtitle "subtitle #1" and not display the subtitle "subtitle #2," the subtitle "subtitle #1" will be displayed on the screen of the display device 20 for 5 seconds 1 minute after the start of the video, but the subtitle will not be displayed on the screen of the display device 20 for 5 seconds 1 minute 10 seconds after the start of the video. Note that if the subtitle "subtitle #3" that is predetermined to be displayed for 5 seconds 1 minute 10 seconds after the start of the video is a subtitle that contains a study word from a commercially available dictionary that the user has specified in advance and corresponds to the speech of the main character of the video that the user is watching, then even if the subtitle "subtitle #2" is not displayed on the screen of the display device 20, the subtitle "subtitle #3" will be displayed for 5 seconds 1 minute 10 seconds after the start of the video. Note that the details for determining whether the subtitle corresponds to the speech of the main character of the video that the user is watching are the same as those in the second embodiment, and therefore will not be described here.

[0227] The display control unit 138 may transmit control information for displaying subtitles containing study words from a commercially available dictionary designated by the user if the subtitles correspond to the speech of a character whose characteristics match the user's preferences, and for preventing the display of subtitles if the subtitles do not correspond to the speech of a character whose characteristics match the user's preferences. Specifically, the display control unit 138 may determine whether subtitles containing study words from a commercially available dictionary designated by the user correspond to the speech of a character whose characteristics match the user's preferences, and for displaying subtitles determined to correspond to the speech of a character whose characteristics match the user's preferences, and for preventing the display of subtitles determined to not correspond to the speech of a character whose characteristics match the user's preferences. For example, if the subtitle "subtitle #1" is determined to be a subtitle that corresponds to the speech of a character with characteristics that match the user's preferences, and the subtitle "subtitle #2" is determined to be a subtitle that does not correspond to the speech of a character with characteristics that match the user's preferences, when the display control unit 138 sends control information to the display device 20 to display the subtitle "subtitle #1" and not display the subtitle "subtitle #2", the subtitle "subtitle #1" will be displayed on the screen of the display device 20 for 5 seconds 1 minute after the start of the video, but the subtitle will not be displayed on the screen of the display device 20 for 5 seconds 1 minute 10 seconds after the start of the video. Note that if "subtitle #3," which is predetermined to be displayed for five seconds one minute and ten seconds after the start of the video, is a subtitle that features study words from a commercially available dictionary designated by the user in advance and corresponds to the speech of a character whose characteristics match the user's preferences, then "subtitle #3" will be displayed for five seconds one minute and ten seconds after the start of the video on the screen of the display device 20, even if "subtitle #2" is not displayed. Note that the details for determining whether or not a subtitle corresponds to the speech of a character whose characteristics match the user's preferences are the same as those in the second embodiment, and therefore a description thereof will be omitted.

[0228] The display control unit 138 may transmit control information for displaying subtitles containing study words from a commercially available dictionary designated by the user if the subtitles correspond to the speech of a character with characteristics that match the preferences of other users (other users who generated a dictionary from a video the user is watching, other users whose video list is similar to the user's), and for preventing the subtitles from being displayed if the subtitles do not correspond to the speech of a character with characteristics that match the preferences of other users. Specifically, the display control unit 138 may determine whether subtitles containing study words from a commercially available dictionary designated by the user correspond to the speech of a character with characteristics that match the preferences of other users, and for displaying subtitles determined to correspond to the speech of a character with characteristics that match the preferences of other users, and for preventing the display of subtitles determined to not correspond to the speech of a character with characteristics that match the preferences of other users. For example, if the subtitle "subtitle #1" is determined to be a subtitle corresponding to the speech of a character with characteristics that match the preferences of other users, and the subtitle "subtitle #2" is determined to be a subtitle that does not match the speech of a character with characteristics that match the preferences of other users, then when the display control unit 138 sends control information to the display device 20 to display the subtitle "subtitle #1" and not display the subtitle "subtitle #2," the subtitle "subtitle #1" will be displayed on the screen of the display device 20 for 5 seconds 1 minute after the start of the video, but the subtitle will not be displayed on the screen of the display device 20 for 5 seconds 1 minute 10 seconds after the start of the video. Note that if "subtitle #3," which is predetermined to be displayed for five seconds one minute and ten seconds after the start of the video, is a subtitle that features study words from a commercially available dictionary previously designated by the user and corresponds to the speech of a character whose characteristics match the preferences of other users, then "subtitle #3" will be displayed for five seconds one minute and ten seconds after the start of the video on the screen of the display device 20, even if "subtitle #2" is not displayed. Note that the details for determining whether or not a subtitle corresponds to the speech of a character whose characteristics match the preferences of other users are the same as those in the second embodiment, and therefore a description thereof will be omitted.

[0229] The display control unit 138 may transmit control information for displaying only target subtitles (subtitles containing learning words from a commercially available dictionary designated in advance by the user) when the video being viewed by the user is a video with characteristics that match the user's preferences. Specifically, the display control unit 138 may determine whether the video being viewed by the user is a video with characteristics that match the user's preferences, and when it is determined that the video is a video with characteristics that match the user's preferences, transmit control information for displaying only the target subtitles. Note that the details for determining whether the video is a video with characteristics that match the user's preferences are the same as those in the second embodiment, and therefore description thereof will be omitted.

[0230] The display control unit 138 may transmit control information for displaying only the target subtitle when the video currently being viewed by the user is a video with characteristics that match the preferences of other users. Specifically, the display control unit 138 may determine whether the video currently being viewed by the user is a video with characteristics that match the preferences of other users, and when it is determined that the video is a video with characteristics that match the preferences of other users, may transmit control information for displaying only the target subtitle. Note that the details for determining whether the video is a video with characteristics that match the preferences of other users are the same as those in the second embodiment, and therefore description thereof will be omitted.

[0231] The display control unit 138 may transmit control information for displaying the target subtitle when a training word included in the target subtitle is not a word previously designated as an exclusion word not to be added to the first region for generating a dictionary, and for not displaying the target subtitle when the training word is a word previously designated as an exclusion word not to be added to the first region for generating a dictionary. Specifically, the display control unit 138 may determine whether a training word included in the target subtitle is a word previously designated as an exclusion word not to be added to the first region for generating a dictionary, and transmit control information for displaying the target subtitle in which the training word determined to be not a word previously designated as an exclusion word not to be added to the first region for generating a dictionary appears, and for not displaying the target subtitle in which the training word determined to be a word previously designated as an exclusion word not to be added to the first region for generating a dictionary appears. For example, if the subtitle "subtitle #1" is a target subtitle containing a learning word that has been determined not to be a word previously designated as an excluded word that will not be added to the first area for generating a dictionary, and the subtitle "subtitle #2" is a target subtitle containing a learning word that has been determined to be a word previously designated as an excluded word that will not be added to the first area for generating a dictionary, when the display control unit 138 sends control information to the display device 20 to display the subtitle "subtitle #1" and not display the subtitle "subtitle #2," the subtitle "subtitle #1" will be displayed on the screen of the display device 20 for 5 seconds 1 minute after the start of the video, but the subtitle will not be displayed on the screen of the display device 20 for 5 seconds 1 minute 10 seconds after the start of the video. Note that if the subtitle "subtitle #3," which is predetermined to be displayed for five seconds one minute and ten seconds after the start of the video, is a target subtitle containing a learning word that is not a word previously designated as an excluded word not to be added to the first area for dictionary generation, then the subtitle "subtitle #3" will be displayed for five seconds one minute and ten seconds after the start of the video, even if the subtitle "subtitle #2" is not displayed on the screen of the display device 20. Note that the details of determining whether a word is a word previously designated as an excluded word not to be added to the first area for dictionary generation are the same as those in the second embodiment, and therefore will not be described here.Furthermore, when the user specifies a commercially available dictionary other than the one used to specify training words in order to specify exclusion words, and the display control unit 138 determines whether a training word included in a target subtitle is an exclusion word by treating the training word in the other commercially available dictionary as an exclusion word, the display control unit 138 may transmit control information to display the target subtitle if the training word included in the target subtitle is not a training word in the other commercially available dictionary specified by the user to specify exclusion words, and not to display the target subtitle if the training word is a training word in the other commercially available dictionary specified by the user to specify exclusion words.

[0232] (Extraction part 132B) The extraction unit 132B extracts the same information as the extraction unit 132 or the extraction unit 132A. The extraction unit 132B also extracts target subtitles to be displayed based on the control information transmitted by the display control unit 138 and the training words included in the target subtitles. That is, the extraction unit 132B extracts subtitles to be displayed on the screen of the display device 20 based on the control information transmitted by the display control unit 138 and the training words included in the subtitles. The extraction unit 132B may execute the extraction information processing before the display control unit 138 processes the control information for transmission, or may execute the extraction information processing in parallel (or simultaneously) with the display control unit 138 processes the control information for transmission. Therefore, the extraction unit 132B may extract target subtitles to be displayed based on the control information transmitted by the display control unit 138 and the training words included in the target subtitles. In other words, the display control unit 138 may transmit control information for displaying only subtitles in which the training words extracted by the extraction unit 132B appear. Then, the generation unit 133 adds the learning words extracted by the extraction unit 132B to a first area corresponding to the video currently being viewed by the user, and adds the subtitles extracted by the extraction unit 132B to a second area corresponding to the video currently being viewed by the user, thereby generating a dictionary for the user that compiles learning words that appear in the subtitles of the video currently being viewed by the user. As in the case of the extraction unit 132B, the generation unit 133 may execute the information generation process before the information processing for transmitting the control information by the display control unit 138, or may execute the information generation process in parallel (or simultaneously) with the information processing for transmitting the control information by the display control unit 138. For this reason, the display control unit 138 may transmit control information for displaying only subtitles that appear with learning words included in the dictionary generated by the generation unit 133.

[0233] The extraction unit 132B may extract video images displayed when the learning words extracted by the extraction unit 132B appear. For example, the extraction unit 132B may transmit subtitle information extracted together with the learning words to the video / movie distribution server 200, and the video / movie distribution server 200 may extract video images at the timing when the subtitles are displayed based on the received subtitle information and transmit the extracted video images to the memory assistance device 100B, thereby extracting the video images displayed when the learning words appear. For example, if the extraction unit 132B transmits subtitle information for "Subtitle #1" to the video / movie distribution server 200, the video / movie distribution server 200 may extract video images from the video images displayed from 1 minute to 1 minute and 5 seconds into the video. The extraction unit 132B may then obtain the video images transmitted from the video / movie distribution server 200 to extract the video images displayed when the learning words appear. Alternatively, the extraction unit 132B may extract impressive video images from the video images displayed in the scene where the learning words extracted by the extraction unit 132B appear. For example, the extraction unit 132B may transmit the extracted subtitle information along with the learning words to the video distribution server 200, which may then identify a scene in the video where the subtitle appears based on the received subtitle information, extract an impressive video image from among the video images displayed in that scene, and transmit the extracted video image to the memory assistance device 100B, thereby extracting an impressive video image from among the video images displayed in the scene where the learning words appear. For example, if the extraction unit 132B transmits the subtitle information for "Subtitle #1" to the video distribution server 200, the video distribution server 200 may identify a scene in the video that appears from 1 minute to 1 minute and 5 seconds into the video, and extract an impressive video image from among the video images displayed before the scene transitions to the next scene. For example, if the scene transitions to the next scene 5 minutes after the start of the video, the video distribution server 200 may extract an impressive video image from among the video images displayed from 5 minutes after the start of the video. Then, the extraction unit 132B may obtain video images transmitted from the video / movie distribution server 200 and extract impressive video images from among the video images displayed in the scene when the learning word appears.Furthermore, the generation unit 133 may add the video images extracted by the extraction unit 132B to a third area corresponding to the video being viewed by the user, thereby generating a dictionary for the user that compiles the learning words that appear in the subtitles of the video being viewed by the user. Furthermore, the display unit 135 may display the video images that were displayed when the learning words appeared, in an order corresponding to the order of the learning words updated by the update unit 134. For example, when the subtitle "Subtitle #1" is added to the dictionary together with the learning words, the display unit 135 may display the video images extracted from the video images that were displayed from 1 minute to 1 minute and 5 seconds into the video. Furthermore, the display unit 135 may display the most impressive video images that were displayed in the scene of the video that was displayed when the learning words appeared, in an order corresponding to the order of the learning words updated by the update unit 134. For example, when the subtitle "subtitle #1" is added to the dictionary along with the learning words, the display unit 135 may display a video image extracted from the video images displayed up to 5 minutes from the start of the video video in which the scene in which the subtitle "subtitle #1" is displayed transitions to the next scene.

[0234] <3.4. Information processing flow> Next, the procedure of information processing by the information processing system 1B according to embodiment 3 will be described with reference to Fig. 21 and Fig. 22. Fig. 21 and Fig. 22 are flowcharts showing the procedure of information processing by the information processing system 1B according to embodiment 3. In the procedure of information processing by the information processing system 1B according to embodiment 3, as in Fig. 21, the information processing for transmitting control information may be executed before the information processing for extracting or generating, or as in Fig. 22, the information processing for extracting or generating may be executed before the information processing for transmitting control information.

[0235] As shown in FIG. 21, the memory assistance device 100B determines whether or not a learning word from a commercially available dictionary previously designated by the user appears in the subtitles of the video identified as the video the user is watching based on the code information attached to the opening animation of the video the user is watching (step S501).

[0236] When the memory assistance device 100B determines that the subtitles of the video identified as the video the user is watching contain a learning word from a commercially available dictionary previously designated by the user (step S501; YES), it transmits control information for displaying only the target subtitles containing the learning word (step S502).On the other hand, when the memory assistance device 100B determines that the subtitles of the video identified as the video the user is watching do not contain a learning word from a commercially available dictionary previously designated by the user (step S501; NO), it terminates information processing.

[0237] The memory assistance device 100B extracts the target subtitles to be displayed according to the transmitted control information and the learning words included in the target subtitles (step S503).

[0238] The memory assistance device 100B adds the extracted learning words to a first area corresponding to the video being watched by the user, and adds the extracted target subtitles to a second area corresponding to the video being watched by the user, thereby generating a dictionary for the user that compiles learning words that appear in the subtitles of the video being watched by the user (step S504).

[0239] As shown in FIG. 22, the memory assistance device 100B determines whether or not a learning word from a commercially available dictionary previously designated by the user appears in the subtitles of the video identified as the video the user is watching based on the code information attached to the opening animation of the video the user is watching (step S601).

[0240] When the memory assistance device 100B determines that the subtitles of the video identified as the video the user is watching contain a learning word from a commercially available dictionary previously designated by the user (step S601; YES), it extracts the target subtitles in which the learning word appears and the learning word contained in the target subtitles (step S602).On the other hand, when the memory assistance device 100B determines that the subtitles of the video identified as the video the user is watching do not contain a learning word from a commercially available dictionary previously designated by the user (step S601; NO), it terminates information processing.

[0241] The memory assistance device 100B adds the extracted learning words to a first area corresponding to the video being watched by the user, and adds the extracted target subtitles to a second area corresponding to the video being watched by the user, thereby generating a dictionary for the user that compiles learning words that appear in the subtitles of the video being watched by the user (step S603).

[0242] The memory assistance device 100B transmits control information for displaying only target subtitles in which learning words included in the generated dictionary appear (step S604).

[0243] <3.5. Modifications> The information processing system 1B according to the above-described third embodiment may be implemented in various different forms other than the above-described third embodiment. Therefore, other embodiments of the information processing system 1B will be described below.

[0244] (Variation 10: Changing the display format of study words) In the third embodiment, the display control unit 138 transmits control information for displaying only subtitles containing training words from a commercially available dictionary designated by the user when the subtitles of the video being viewed contain training words. For example, when training words appear in the subtitles of "subtitle #1" of the video being viewed by the user but no training words appear in the subtitles of "subtitle #2" of the video being viewed by the user, the display control unit 138 transmits control information for displaying "subtitle #1" and not displaying "subtitle #2" while the user is viewing the video. However, for example, among subtitles that allow users to learn target words according to their learning goals, the user may wish to easily identify and focus on target words according to their learning goals while viewing the video. When training words from a commercially available dictionary designated by the user appear in the subtitles of the video being viewed by the user, the display control unit 138 may transmit control information for changing the display mode of the training words included in the subtitles while the training words appear. In other words, while a target subtitle targeted by the control information for changing the display mode is being displayed, the display control unit 138 may transmit control information for changing the display mode of the training words included in the target subtitle. Specifically, while a target subtitle targeted by the control information for controlling display is being displayed, the display control unit 138 may transmit control information for changing the display mode of the training words included in the target subtitle based on the control information for controlling the display mode. In this case, the control information for controlling display may include control information for controlling the display mode, or the control information for controlling display may include control information for controlling display. Furthermore, the extraction unit 132B may extract training words whose display mode will be changed based on the control information transmitted by the display control unit 138 and subtitles in which the training words appear. Furthermore, when the information processing for extraction is performed before the information processing for transmitting the control information by the display control unit 138, the extraction unit 132B may extract training words whose display mode will be changed based on the control information transmitted by the display control unit 138 and subtitles in which the training words appear.

[0245] (Variation 11: Display only other study words) In the third embodiment, the display control unit 138 transmits control information for displaying only subtitles containing training words from a commercially available dictionary designated by the user in advance when the subtitles of the video being viewed by the user contain training words from a commercially available dictionary designated by the user. However, for example, a user may have become proficient in the training words from a specific commercially available dictionary and may wish to memorize words that did not appear in that specific commercially available dictionary. For example, if a user has become proficient in the training words from a specific commercially available dictionary for a particular qualification exam in order to pass the exam, the user may wish to memorize words that did not appear in that specific commercially available dictionary or training words that appear in another specific commercially available dictionary for the qualification exam. In this way, a user may wish to memorize words that did not appear in the commercially available dictionary that the user has studied.

[0246] If the subtitles of the video being viewed by the user contain other learning words that do not appear in a commercially available dictionary designated by the user in advance, the display control unit 138 may transmit control information for displaying only the subtitles containing the other learning words. For example, the display control unit 138 may transmit control information for displaying only the subtitles containing other learning words that do not appear in any of the multiple commercially available dictionaries designated by the user in advance. The extraction unit 132B may then extract the subtitles to be displayed according to the control information transmitted by the display control unit 138 and the other learning words contained in the subtitles. In other words, the extraction unit 132B may extract the subtitles to be displayed on the screen of the display device 20 and the other learning words contained in the subtitles based on the control information transmitted by the display control unit 138. Then, the generation unit 133 may add other learning words extracted by the extraction unit 132B to a first area corresponding to the video being watched by the user, and add the subtitles extracted by the extraction unit 132B to a second area corresponding to the video being watched by the user, thereby generating a dictionary for the user that compiles other learning words that appear in the subtitles of the video being watched by the user.

[0247] (Variation 12: Obtaining subtitle information using short-range wireless communication technology) In the third embodiment, the acquiring unit 131B acquires information about subtitles of the video video being viewed by the user based on code information transmitted from the terminal device 10 by the user reading code information displayed on the screen of the display device 20 while the user is viewing the video video. However, the information about subtitles of the video video being viewed by the user may be acquired using a short-range wireless communication technology such as NFC (Near Field Communication). In this case, the terminal device 10 may be an information processing device having an NFC function. In other words, the terminal device 10 may be an information processing device capable of reading data such as an NFC tag (a tag equipped with an IC chip having an NFC function). Furthermore, the display device 20 may be an information processing device having an NFC function or an NFC tag. For example, when the display device 20 is an information processing device having an NFC function, the acquiring unit 131B may acquire information acquired by the terminal device 10 from the display device 20 by the user bringing the terminal device 10 close to the display device 20 (by exchanging data between NFC terminals). Furthermore, for example, when the display device 20 is an information processing device having an NFC tag, the acquisition unit 131B may acquire information acquired by the terminal device 10 from the display device 20 by having the terminal device 10 read an NFC tag attached to the display device 20 by the user. Then, the acquisition unit 131B may acquire information related to subtitles of the video moving image being viewed by the user based on the information acquired in this manner. Furthermore, when the display device 20 has a different NFC tag for each video moving image, the acquisition unit 131B may acquire information related to subtitles of the video moving image being viewed by the user based on information transmitted from the terminal device 10 by having the terminal device 10 read an NFC tag corresponding to the video moving image being viewed by the user.

[0248] <3.6.Effects> At least the following points become clear from the description of embodiment 3 and the accompanying drawings.

[0249] Aspect 1 includes a display control step of transmitting control information for displaying only predetermined subtitles in which learning words appear in a commercially available dictionary designated by a user, when the learning words appear in predetermined subtitles linked to code information added to an opening animation of a predetermined video currently being viewed by the user among subtitled videos in which speech spoken in a language according to a user's attributes is translated into a predetermined language; an extraction step of extracting the predetermined subtitles to be displayed by the control information transmitted by the display control step and the learning words included in the predetermined subtitles; and a display control step of displaying the learning words extracted by the extraction step in a first area set for each video. the predetermined subtitles extracted by the extraction step are added to a first area corresponding to the video, and the predetermined subtitles extracted by the extraction step are added to a second area set for each video corresponding to the first area, the second area corresponding to the predetermined video for assisting memory of the training words added to the first area; and the dictionary generated by the generation step is updated when training words are added to the first area so that the earlier the predetermined subtitles are displayed in the subtitles of the predetermined video, the higher the training words are displayed.

[0250] According to the first aspect, for example, if a word from a commercially available dictionary specified by the user appears in the subtitles of a video that the user is watching, only the subtitles that include the word from the commercially available dictionary specified by the user can be displayed when the user watches the main part of the video. For example, subtitles that include the word from the commercially available dictionary specified by the user can be displayed among the subtitles of the video that the user is watching, and subtitles that do not include the word from the commercially available dictionary specified by the user can be hidden. This allows the subtitles that include the word from the commercially available dictionary specified by the user to be highlighted among the subtitles of the video that the user is watching. Furthermore, a dictionary can be generated that associates words from the commercially available dictionary specified by the user that appear in the subtitles of the video that the user is watching with the subtitles in which those words appear. Therefore, a dictionary can be generated for each video that the user watches. Furthermore, because the subtitles are displayed in association with the video, the user can recall the video in which the subtitles are displayed by reviewing the dictionary from the subtitles added to the dictionary.

[0251] Furthermore, according to aspect 1, for example, while watching a video primarily targeted at viewers born and raised in the same culture as the user, subtitles in a different cultural language that the user is learning can be displayed in response to the video. This allows the user to view the subtitles while accurately understanding the video and audio of the video with the five senses. Therefore, even if the video is in a different cultural language, the user can effectively learn how to use words contained in translated sentences displayed as subtitles from the video. For example, the user can learn not only the meaning of the words but also how the words are used in conjunction with other words, in what situations, and when the speaker feels the words. Furthermore, by accurately understanding the usage of words from the video with the five senses, not only can the video with the subtitles be recalled from the words, but also the words can be recalled from the video. Therefore, the user can recall the words simply by casually recalling the video in everyday life outside of learning. Furthermore, video primarily targeted at viewers born and raised in the same culture as the user is easy for the user to understand, and thus the user can casually recall not only the video but also the audio, thereby facilitating word recall.

[0252] Furthermore, according to aspect 1, for example, the order of words contained in the dictionary can be rearranged to match the order of subtitles displayed in a video, thereby displaying the words in the order of the video story. Therefore, by viewing the words contained in the dictionary in the correct order, a user can recall the story of the video, and thus recall the meanings and uses of the words. In this way, the story of the video can be treated as a whole, making it easier to recall the meanings and uses of words that appear in the subtitles of the video. This eliminates the need to individually check whether the meaning and use of each word can be recalled, thereby reducing the burden on the user when reviewing.

[0253] Aspect 2 is characterized in that, in aspect 1, the code information is transmitted based on information regarding subtitles linked to the code information obtained by the user reading it on the user's terminal device, which is the display destination terminal device that displays the dictionary generated by the generation procedure, and control information for displaying only specified subtitles in which the learning words appear is transmitted.

[0254] According to aspect 2, for example, if a word from a commercially available dictionary specified by the user appears in the subtitles of a video that the user is watching, a dictionary that compiles the words from the commercially available dictionary specified by the user that appear in the subtitles of the video that the user is watching can be generated by simply reading code information attached to the opening animation with the user's terminal device. Furthermore, even if the display device that displays the video does not belong to the user, a dictionary for the user can be generated and displayed on the user's terminal device. For example, even if the display device on which the user watches the video is a desktop PC at a compulsory education school or cram school, or a display TV at a shopping center, the user can generate a dictionary for the user and display it on the user's terminal device by simply reading code information displayed on the screen.

[0255] Aspect 3 is characterized in that in aspect 1, if a learning word from a commercially available dictionary previously designated by the user appears in predetermined subtitles linked to code information attached to the ending animation of the predetermined video video that the user is watching, the predetermined subtitle in which the learning word appears and the learning word contained in the predetermined subtitle are extracted.

[0256] According to aspect 3, for example, if a word from a commercially available dictionary specified by the user appears in the subtitles of a video that the user is watching, even after the user has finished watching the main part of the video, a dictionary can be generated from the code information attached to the ending animation, compiling the words from the commercially available dictionary specified by the user that appear in the subtitles of the video that the user is watching. Therefore, if a word that the user wants to remember appears in the subtitles of the main part of the video, the user can generate a dictionary for the user from the ending animation without rewinding the video (specifically, without rewinding the video and displaying the subtitles containing that word again).

[0257] Aspect 4 is characterized in that, in aspect 1, while a predetermined subtitle that is the target of display by the control information is being displayed, control information for changing the display mode of a learning word included in the predetermined subtitle is transmitted, and the learning word whose display mode is changed based on the control information transmitted by the display control procedure and the predetermined subtitle in which the learning word appears are extracted.

[0258] According to the fourth aspect, for example, if a word from a commercially available dictionary specified by the user appears in the subtitles of a video being viewed by the user, the display mode of the word can be changed to a predetermined mode while the subtitles containing the word are displayed. For example, the font size can be increased, the font color can be made more eye-catching, the font can be highlighted, or text effects such as shadows and glows can be applied to the font. This allows the word from the commercially available dictionary specified by the user that appears in the subtitles of the video being viewed by the user to be emphasized. Therefore, the word can be appropriately emphasized to the user even while the user is watching the video. Furthermore, if the user specifies multiple commercially available dictionaries, and a word candidate included in one of the specified dictionaries appears in the subtitles, the display mode of the candidate can be changed to a predetermined mode while the subtitles are displayed.

[0259] Aspect 5 is characterized in that, in aspect 1, control information is sent to display only specified subtitles that contain learning words included in at least one of multiple commercially available dictionaries previously designated by the user.

[0260] According to the fifth aspect, for example, by specifying multiple commercially available dictionaries, a user can specify more candidate words to be added to the dictionary. Therefore, for example, by specifying multiple dictionaries for a specific qualification exam (e.g., study guides or vocabulary books), a user can ensure that all words required for the specific qualification exam are included as candidates. Furthermore, based on whether a candidate word included in one of the specified dictionaries appears in the subtitles, the user can select whether to display the subtitles. Specifically, if a candidate word included in one of the specified dictionaries appears in the subtitles, the subtitles can be displayed, and if a candidate word included in one of the specified dictionaries does not appear in the subtitles, the subtitles can be hidden. Therefore, for example, by specifying multiple dictionaries for a specific qualification exam, a user can display more subtitles containing words that are subject to the specific qualification exam, thereby emphasizing more words that are subject to the specific qualification exam. Furthermore, the meanings and usages of more words that are subject to the specific qualification exam can also be emphasized. Therefore, a larger number of words can be effectively memorized in line with the user's learning goals.

[0261] Aspect 6 is characterized in that in aspect 1, control information is transmitted to display the specified subtitles if the specified subtitles correspond to the utterances of the main character in the specified video video that the user is watching, and to prevent the specified subtitles from being displayed if the specified subtitles do not correspond to the utterances of the main character in the specified video video that the user is watching.

[0262] According to the sixth aspect, for example, a user can select whether or not to display subtitles based on whether the word the user wants to memorize is included in subtitles corresponding to the speech of a character (main character) central to the story of the video. Therefore, the words included in the displayed subtitles can be associated with the image of the main character (for example, the image or audio of the main character when the main character makes the speech corresponding to the subtitles) and memorized. Furthermore, since a user's preferences for a video are often based on the main character, associating the word with the image of the main character allows the user to memorize the word comfortably and without resistance. Furthermore, the more important the main character is among the main characters in the video the user is watching, the more easily and comfortably the user can memorize the word without feeling like they are learning.

[0263] Aspect 7 is characterized in that in aspect 1, control information is transmitted to display the predetermined subtitles if the predetermined subtitles correspond to the speech of a character with characteristics that are in line with the user's preferences, and to prevent the predetermined subtitles from being displayed if the predetermined subtitles do not correspond to the speech of a character with characteristics that are in line with the user's preferences.

[0264] According to aspect 7, for example, a user can select whether to display subtitles based on whether the word the user wants to memorize is included in subtitles corresponding to the speech of a character whose characteristics match the user's preferences. Therefore, the words included in the displayed subtitles can be associated with an image of a character whose characteristics match the user's preferences and memorized. Furthermore, by associating a word with an image of a character whose characteristics match the user's preferences, the user can memorize the word comfortably and without resistance. Furthermore, the more the character whose characteristics match the user's preferences, the more the user can memorize the word comfortably and without feeling like they are learning.

[0265] Aspect 8 is characterized in that in aspect 1, control information is transmitted to display the predetermined subtitles if the predetermined subtitles correspond to the speech of a character with characteristics that are in line with the preferences of the other user who generated the dictionary from the predetermined video video that the user is watching, and to prevent the predetermined subtitles from being displayed if the predetermined subtitles do not correspond to the speech of a character with characteristics that are in line with the preferences of the other user who generated the dictionary from the predetermined video video that the user is watching.

[0266] According to the eighth aspect, for example, a user can select whether to display a subtitle based on whether the word the user wants to memorize is included in a subtitle corresponding to the speech of a character whose characteristics match the preferences of another user who created a dictionary from the video the user is watching. Therefore, even if the user's character preferences cannot be determined, the subtitle to be displayed can be selected based on the character preferences of the other user who created a dictionary from the video the user is watching. Furthermore, the user's character preferences may be similar to the character preferences of the other user who created a dictionary from the video the user is watching. Therefore, by associating a word with an image of a character whose characteristics match the preferences of the other user who created a dictionary from the video the user is watching, the user may be able to memorize the word comfortably and without resistance. For example, if the character also matches the preferences of the user, the user may be able to memorize the word comfortably and without resistance. Furthermore, the more the character's characteristics match the preferences of the other user who created a dictionary from the video the user is watching, the more the user may be able to memorize the word comfortably and without feeling like they are learning. For example, if a character has characteristics that are in line with the preferences of other users who have created dictionaries from the video footage the user is watching, and the character also has characteristics that are in line with the user's preferences, the user will be able to memorize the word comfortably and without feeling like they are learning.

[0267] Aspect 9 is characterized in that, in aspect 1, the predetermined subtitle is displayed when the list of videos identified based on a comparison between a list of videos for which the user generated the dictionary and a list of videos for which other users generated the dictionary is a subtitle corresponding to the speech of a character with characteristics that are in line with the preferences of other users similar to the user, and control information is transmitted to prevent the predetermined subtitle from being displayed when the list of videos identified based on a comparison between the list of videos for which the user generated the dictionary and a list of videos for which other users generated the dictionary is not a subtitle corresponding to the speech of a character with characteristics that are in line with the preferences of other users similar to the user.

[0268] According to the ninth aspect, for example, a user can select whether to display a subtitle based on whether the word the user wants to memorize is included in the list of videos for which the user generated the dictionary and subtitles corresponding to the speech of a character with characteristics that match the preferences of other users whose list of videos for which the dictionary was generated is similar. Therefore, even if the user's preferences for characters cannot be determined, the subtitles to be displayed can be selected based on the preferences for characters of other users whose list of videos for which the dictionary was generated is similar. Furthermore, the user's preferences for characters may be similar to the preferences for characters of other users whose list of videos for which the dictionary was generated is similar. Therefore, by associating a word with a video of a character with characteristics that match the preferences of other users whose list of videos for which the dictionary was generated is similar, the user may be able to memorize the word comfortably and without resistance. For example, if the character is also a character with characteristics that match the user's preferences, the user may be able to memorize the word comfortably and without resistance. Furthermore, the more characters in the list of videos from which the dictionary was generated have characteristics that are in line with the preferences of similar users, the more likely the user will be able to memorize the words comfortably and without feeling like they are learning. For example, if the more characters in the list of videos from which the dictionary was generated have characteristics that are in line with the preferences of similar users, and the more likely the characters are to be in line with the preferences of the user, the more likely the user will be able to memorize the words comfortably and without feeling like they are learning.

[0269] Aspect 10 is characterized in that, in aspect 1, when the specified video video that the user is watching is a video video with characteristics that match the user's preferences, control information is sent to display only specified subtitles that contain learning words.

[0270] According to aspect 10, for example, based on whether the video being viewed by the user has characteristics that match the user's preferences, the user can select whether to display subtitles that appear in the subtitles of the video being viewed and that include words that the user wants to memorize. Therefore, words included in the displayed subtitles can be associated with images in the video that match the user's preferences and memorized. Furthermore, by associating words with images in the video that match the user's preferences, the user can memorize the words comfortably and without resistance. Furthermore, the more the video has characteristics that match the user's preferences, the more the user can memorize the words comfortably and without feeling like they are learning.

[0271] Aspect 11 is characterized in that in aspect 1, when the specified video being watched by the user is a video with characteristics that match the preferences of another user who generated the dictionary from the specified video, control information is sent to display only specified subtitles that contain learning words.

[0272] According to aspect 11, for example, based on whether the video being viewed by the user has characteristics that match the preferences of another user who generated a dictionary from the video being viewed, it is possible to select whether to display subtitles containing words that the user wants to memorize, which appear in the subtitles of the video being viewed by the user. Therefore, even if the user's preferences for the video cannot be determined, it is possible to select subtitles to display based on the preferences for the video of the other user who generated a dictionary from the video being viewed by the user. Furthermore, the user's preferences for the video may be similar to the preferences for the video of the other user who generated a dictionary from the video being viewed by the user. Therefore, by associating a word with a video in such a video that matches the preferences of the other user who generated a dictionary from the video being viewed by the user, it may be possible to allow the user to memorize the word comfortably and without resistance. For example, if the video also has characteristics that match the user's preferences, the user can memorize the word comfortably and without resistance. Furthermore, the more video that matches the preferences of other users who generated dictionaries from the video that the user is currently watching, the more easily the user can memorize the words without feeling that they are learning. For example, if the video that matches the preferences of other users who generated dictionaries from the video that the user is currently watching, and the video also matches the preferences of the user, the more easily the user can memorize the words without feeling that they are learning.

[0273] Aspect 12 is characterized in that in aspect 1, when the specified video video being watched by the user is a video video with characteristics that are in line with the preferences of other users similar to the user, identified based on a comparison of a list of video videos for which the user generated the dictionary with a list of video videos for which other users generated the dictionary, control information is sent to display only specified subtitles containing learning words.

[0274] According to aspect 12, for example, based on whether the video being viewed by the user is a video with characteristics that match the preferences of other users whose list of videos from which the dictionary was generated is similar to the list of videos from which the dictionary was generated, it is possible to select whether to display subtitles containing words that the user wants to memorize, which appear in the subtitles of the video being viewed. Therefore, even if the user's preferences for video cannot be determined, it is possible to select subtitles to display based on the preferences of other users whose list of videos from which the dictionary was generated is similar. Furthermore, the user's preferences for video may be similar to the preferences of other users whose list of videos from which the dictionary was generated is similar. Therefore, by associating a word with a video from such a video with characteristics that match the preferences of other users whose list of videos from which the dictionary was generated is similar, it may be possible to allow the user to memorize the word comfortably and without resistance. For example, if the video is also a video with characteristics that match the user's preferences, the user can memorize the word comfortably and without resistance. Furthermore, the more videos from which the dictionary is generated have characteristics that are in line with the preferences of similar users, the more easily the user can memorize the words without feeling that they are learning. For example, if the more videos from which the dictionary is generated have characteristics that are in line with the preferences of similar users, and the more easily the user can memorize the words without feeling that they are learning, the more easily the user can memorize the words without feeling that they are learning.

[0275] Aspect 13 is characterized in that, in aspect 1, control information is transmitted to display the predetermined subtitle when the learning word included in the predetermined subtitle is not a word previously designated as an exclusion word that is not to be added to the first area for generating the dictionary, and to prevent the predetermined subtitle from being displayed when the learning word is a word previously designated as an exclusion word that is not to be added to the first area for generating the dictionary.

[0276] According to aspect 13, for example, a user can select whether or not to display subtitles containing a word that the user wants to memorize, based on whether the word is a word that the user has previously designated as a word not to be added to the dictionary. Therefore, the user can select subtitles to be displayed (or words to be emphasized) based on the designation of two types of words: a word that the user wants to memorize and a word that the user does not want to include in the words the user wants to memorize (for example, a word that the user has already memorized, or a word that does not have a distinctive meaning as a single word, such as a pronoun or article). Therefore, the user can select the subtitles to be displayed (or words to be emphasized) by selectively designating two types of words: a word that the user wants to memorize and a word that the user does not want to include in the words the user wants to memorize, thereby enabling the user to learn words in line with their learning goals.

[0277] Aspect 14 is characterized in that, in aspect 13, control information is sent to display the specified subtitle if the learning word included in the specified subtitle is not a learning word i...

Claims

1. an acquisition step for acquiring subtitle information of a video work and viewing information of the user with respect to the video work when the video work viewed by the user is a video work with subtitles in which audio spoken in a language corresponding to the attributes of the user is translated into a predetermined language; an extraction step of extracting learning words estimated to have appeared in the subtitles of the video work while the user was watching based on the viewing information of the user and predetermined subtitles including the learning words, based on the user's preference for characters who are speakers of the predetermined subtitles; a generation step of generating a dictionary corresponding to the video work by adding the training words extracted by the extraction step to a first area corresponding to the video work and adding the predetermined subtitles extracted by the extraction step to a second area corresponding to the video work; A memory support program using a video work, characterized by causing a computer to execute the above.

2. 1. A computer-implemented method for assisting memory, comprising: an acquisition step of acquiring subtitle information of the video work and viewing information of the user with respect to the video work when the video work viewed by the user is a video work with subtitles in which audio spoken in a language corresponding to the attribute of the user is translated into a predetermined language; an extraction step of extracting learning words estimated to have appeared in the subtitles of the video work while the user was watching based on the viewing information of the user and predetermined subtitles including the learning words, based on the user's preference for the character who is the speaker of the predetermined subtitle; a generation step of generating a dictionary corresponding to the video work by adding the learning words extracted in the extraction step to a first area corresponding to the video work and adding the predetermined subtitles extracted in the extraction step to a second area corresponding to the video work; A memory assistance method using a video work, comprising:

3. an acquisition unit that acquires subtitle information of a video work and viewing information of the user for the video work when the video work viewed by the user is a video work with subtitles in which audio spoken in a language corresponding to the attributes of the user is translated into a predetermined language; an extraction unit that extracts learning words that are estimated to have appeared in the subtitles of the video work while the user was watching based on the viewing information of the user and predetermined subtitles that include the learning words, based on the user's preference for characters who are speakers of the predetermined subtitles; a generation unit that generates a dictionary corresponding to the video work by adding the learning words extracted by the extraction unit to a first area corresponding to the video work and adding predetermined subtitles extracted by the extraction unit to a second area corresponding to the video work; A memory support device using a video work, comprising:

Citation Information

Patent Citations

  • Foreign language learning support system

    JP2011221414A

Cited By

  • Method for identifying encountered words, program for identifying encountered words, and device for identifying encountered words

    JP7925211B1