Information processing device and program

Abstract

To detect a term candidate for which explanation is read out from read-out text data, and enable explanation text data of the detected term candidate to be read by voice.SOLUTION: An information processing device includes: a term candidate detection part configured to detect a term candidate for which explanation is to be read out by voice from read-out text data; a notification part configured to notify a user that explanation text data for explaining the term candidate can be read out in accordance with timing of reading out the term candidate; and an explanation reading-out part configured to read out the explanation text data by voice in the case of receiving operation for reading out the explanation text data from the user.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and a program.

Background Art

[0002] In recent years, a voice reading function that reads text data aloud and provides it to users has become common due to the spread of voice reading devices or voice reading programs such as screen readers. By using a voice reading device or voice reading program such as a screen reader, users can read aloud the text data included in various contents (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, if the text data read aloud by the voice reading function contains terms whose meanings are unclear, the user may search a website or the like to find out the meanings of the terms.

[0005] However, a user who is listening to the content of the text data read aloud by the voice reading function has a problem that even if they understand how to read a term whose meaning is unclear, they do not know how the term is written, and it takes time and effort to find out the meaning. Note that Patent Document 1 does not describe such a problem.

[0006] An object of the present disclosure is to detect a term candidate for which an explanation is to be read aloud from the read aloud text data and to be able to read aloud the explanation text data of the detected term candidate by voice. [Means for solving the problem]

[0007] This disclosure is characterized by an information processing device comprising: a term candidate detection unit configured to detect term candidates for which explanations are to be read aloud from text data read aloud by voice; a notification unit configured to notify the user that it is possible to read aloud explanatory text data that explains the term candidates in accordance with the timing at which the term candidates are read aloud; and an explanation reading unit configured to read aloud the explanatory text data when an operation to read aloud the explanatory text data is received from the user. [Effects of the Invention]

[0008] According to this disclosure, it is possible to detect term candidates whose explanations will be read aloud from text data, and to make the text data of the detected term candidates available for voice reading. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of the hardware configuration of the information processing device according to this embodiment. [Figure 2] This figure shows an example of the functional configuration of the information processing device according to this embodiment. [Figure 3] This is an explanatory diagram of an example of text-to-speech data. [Figure 4] This is a diagram illustrating an example of a new word dictionary. [Figure 5] This is a diagram illustrating an example of the structure of the text-to-speech history information. [Figure 6] This is a flowchart illustrating an example of the processing performed by the information processing device according to this embodiment. [Figure 7] This is an explanatory diagram of an example of text that can be read aloud. [Figure 8] This is an illustrative diagram of an example of a smartphone equipped with a screen reader app that has a text-to-speech function. [Figure 9]This is a diagram illustrating an example of the information processing system according to this embodiment. [Figure 10] This is a flowchart illustrating an example of the processing performed by the information processing device according to this embodiment. [Figure 11] This is an explanatory diagram of an example of a smartphone equipped with an explanatory application. [Figure 12] This is a diagram illustrating an example of the information processing system according to this embodiment. [Figure 13] This is a flowchart illustrating an example of the processing of the information processing system according to this embodiment. [Modes for carrying out the invention]

[0010] Hereinafter, an embodiment for implementing this disclosure (hereinafter referred to as this embodiment) will be described with reference to the drawings. In this embodiment, as examples of text data to be read aloud, we will describe text data of a web page that is read aloud using a screen reader or other text reading function, and text data that is read aloud in television broadcast programs, but we will not be limited to these examples.

[0011] For example, this could be text data read aloud on a radio broadcast, text data read aloud by an application on a smartphone, or text data read aloud in content such as games or movies.

[0012] [First Embodiment] <Overview> This embodiment solves the following problems. For example, a user may use a text-to-speech function such as a screen reader to read aloud the text data of a web page. If the text data of the web page contains unknown terms, the user may search the website or the like to find the meaning of the terms. However, even if the user using the text-to-speech function knows how to read an unknown term, they do not know the notation of the term until they confirm it on the screen or the like, so it takes time to find the meaning. In addition, for example, a visually impaired person, who is a user, cannot confirm the notation of an unknown term on the screen or the like even if they know how to read it, so it takes much more time to find the meaning compared to a healthy person.

[0013] Therefore, in this embodiment, in a situation where text data is being read aloud, for a user listening to the text-to-speech, it is possible to read aloud the explanatory text data of terms included in the text data that the user is likely to desire an explanation for. For example, terms that the user is likely to desire an explanation for are newly emerged words and characteristic words described later that are included in the text data read aloud.

[0014] This embodiment detects term candidates for reading aloud explanations such as newly emerged words or characteristic words from the text data read aloud, and at the timing when the term candidates are read aloud, notifies the user that it is possible to read aloud the explanatory text data of the term candidates by performing operations such as outputting a sound such as a chime, vibration by a vibration function, or changing the voice of the read aloud from male to female. When this embodiment receives an operation (such as pressing a button) from the user to read aloud the explanatory text data of the term candidate, it reads aloud the explanatory text data. In this way, the user can easily confirm the explanatory text data of the term candidates detected from the read aloud text data by reading it aloud.

[0015] <Hardware Configuration> The information processing apparatus 10 according to this embodiment is realized by, for example, the configuration shown in FIG. 1. FIG. 1 is a diagram showing an example of the hardware configuration of the information processing apparatus according to this embodiment.

[0016] The information processing apparatus 10 in FIG. 1 includes, for example, a CPU (Central Processing Unit) 500, a storage device 502, a communication device 504, an input device 506, an output device 508, and a media I / F 510.

[0017] The CPU 500 controls the information processing apparatus 10 according to a program. The storage device 502 is a memory such as a ROM (Read Only Memory) or a RAM (Random Access Memory), and a storage such as a HDD (Hard Disk Drive) or a SSD (Solid State Drive). The storage device 502 stores programs and data to be executed by the CPU 500.

[0018] The communication device 504 is a communication device such as a network circuit that controls communication. The input device 506 is an input device such as a touch pad, a controller, a mouse, a keyboard, a camera, or a microphone. The output device 508 is an output device such as a display or a speaker. The touch panel is realized by combining a touch pad, which is an example of the input device 506, and a display, which is an example of the output device 508. The media I / F 510 controls reading or writing of data to / from a media 512 such as a USB memory or a flash memory. The hardware configuration in FIG. 1 is an example.

[0019] <Functional configuration> FIG. 2 is a diagram showing an example of the functional configuration of the information processing apparatus according to this embodiment. Note that the functional configuration in FIG. 2 is an example, and at least a part of the functional configuration of the information processing apparatus 10 shown in FIG. 2 may be provided in another information processing apparatus 10 and processing may be performed in cooperation.

[0020] The functional configuration of the information processing device 10 in Figure 2 is realized by processing that one or more programs cause the CPU 500 to execute. The information processing device 10 in Figure 2 includes a text data acquisition unit 20, a term candidate detection unit 22, an operation reception unit 24, a voice reading unit 26, and a notification unit 28.

[0021] The term candidate detection unit 22 includes a new word determination unit 40, a characteristic word determination unit 42, a history confirmation unit 44, a new word dictionary 50, and reading history information 52. The voice reading unit 26 includes an explanation reading unit 60, an explanation text data acquisition unit 62, and a text data reading unit 64.

[0022] The text-to-speech data acquisition unit 20 acquires text-to-speech data that the user reads aloud using a screen reader or other text-to-speech function. The text-to-speech data acquired by the text-to-speech data acquisition unit 20 is, for example, text data from a web page as shown in Figure 3. The text-to-speech data acquired by the text-to-speech data acquisition unit 20 may also be, for example, text data read from media 512. Here, we will explain using the text data from the web page in Figure 3 as an example.

[0023] The term candidate detection unit 22 detects term candidates whose explanations are to be read aloud from the text data of the web page in Figure 3, as follows. The text data of the web page in Figure 3 is input to the new word determination unit 40 and the characteristic word determination unit 42 of the term candidate detection unit 22.

[0024] The new word detection unit 40 uses, for example, the new word dictionary 50 shown in Figure 4 to detect term candidates whose explanations are to be read aloud from the text data of the web page in Figure 3. Figure 4 is a diagram of an example of a new word dictionary configuration. In the new word dictionary 50 in Figure 4, new terms are recorded in association with their registration date. New terms recorded in the new word dictionary 50 include newly created terms, terms that have recently come into use, etc. The new word dictionary 50 may utilize websites that provide information on new terms, or a dedicated dictionary may be prepared.

[0025] For example, the new word detection unit 40 matches the text data of the web page in Figure 3 with the new word dictionary 50 in Figure 4 to detect the term "mutant virus" included in the new word dictionary 50 in Figure 4 as a new word from the text data of the web page in Figure 3.

[0026] The feature word determination unit 42 detects term candidates for which explanations are read aloud from the text data of the web page in Figure 3, using a method for determining characteristic words (feature words), such as TF-IDF (Term Frequency - inverse document frequency). TF-IDF is an example of a method for evaluating the importance of words contained in a document. For example, the feature word determination unit 42 extracts words with high importance from the words contained in the text data of the web page in Figure 3 using TF-IDF, and detects these high-importance words as feature words. Here, we will explain assuming that no feature words were detected from the text data of the web page in Figure 3.

[0027] Although the information processing device 10 in Figure 2 is described as having both a new word detection unit 40 and a characteristic word detection unit 42, it may also be configured to have only one of them. The new word detection unit 40 and the characteristic word detection unit 42 are examples of functions that detect term candidates whose explanations are to be read aloud from the text data, and other functions that can detect term candidates whose explanations the user is likely to want may also be used.

[0028] The history verification unit 44 uses, for example, the reading history information 52 shown in Figure 5 to detect term candidates whose explanations will be read aloud, based on the new words detected by the new word determination unit 40 and the feature words detected by the feature word determination unit 42. Figure 5 is a diagram illustrating an example of the reading history information. The reading history information 52 in Figure 5 stores terms that have been previously presented to the user operating the information processing device 10 as term candidates whose explanations will be read aloud. The history verification unit 44 matches the new words detected by the new word determination unit 40 and the feature words detected by the feature word determination unit 42 with the reading history information 52 in Figure 5, thereby excluding new words and feature words that are identical to those stored in the reading history information 52 in Figure 5 from the new words detected by the new word determination unit 40 and the feature words detected by the feature word determination unit 42. In other words, the history confirmation unit 44 detects term candidates that have not yet been presented to the user operating the information processing device 10, based on the new words detected by the new word determination unit 40 and the characteristic words detected by the characteristic word determination unit 42.

[0029] The history confirmation unit 44 creates text data of the web page (hereinafter referred to as text data TM) with markup that allows it to identify term candidates that have not yet been presented to the user operating the information processing device 10 from the text data of the web page shown in Figure 3 (hereinafter referred to as text data TX), and transmits it to the text-to-speech unit 26.

[0030] The explanatory text data acquisition unit 62 of the speech reading unit 26 checks the markup of the received text data TM and acquires the explanatory text data (hereinafter referred to as explanatory text data TD) for the term candidates whose explanations will be read aloud by searching a website or database. Term candidates for which explanatory text data TD could not be acquired may be excluded from the list of term candidates whose explanations will be read aloud.

[0031] The text data reading unit 64 generates speech, such as synthesized speech, to read the text data TM, and outputs it from a speaker, which is an example of an output device 508. The notification unit 28 also notifies the user that the explanatory text data TD for a given term can be read aloud, depending on when the text data reading unit 64 reads out the term candidate.

[0032] For example, the notification unit 28 notifies the user that the explanatory text data TD for a term candidate can be read aloud immediately before, during, or after the text data reading unit 64 reads a term candidate, by means of a chime or other signal sound, the insertion of a speech (e.g., "explanation available"), vibration using a vibration function, a change in voice such as changing the reading voice from male to female, or a combination of the above methods.

[0033] The user can recognize term candidates for which explanatory text data TD can be read aloud, based on notifications from the notification unit 28. The operation reception unit 24 receives various operations from the user. The user can perform the necessary operations from the operation reception unit 24 to have the explanatory text data TD read aloud. For example, the user can perform an operation to have the explanatory text data TD read aloud within a predetermined time after receiving a notification from the notification unit 28. The operation reception unit 24 notifies the explanatory text reading unit 60 of the operation to have the explanatory text data TD read aloud, which was received from the user.

[0034] When the operation reception unit 24 receives an operation from the user to read out the explanatory text data TD, the explanation reading unit 60 generates a synthesized voice or other voice that reads out the explanatory text data TD and outputs it from a speaker, which is an example of an output device 508.

[0035] The information processing device 10 according to this embodiment makes it easy to have the user listen to a reading of the explanatory text data TD by, for example, preparing explanatory text data TD for term candidates that are likely to be heard by the user from among the terms included in the text data TX.

[0036] <Processing> Figure 6 is a flowchart of an example of the processing of the information processing device according to this embodiment. Figure 7 is an explanatory diagram of an example of text to be read aloud.

[0037] In step S100, the user uses the text-to-speech function to obtain text data to be read aloud. The text data obtained by the text-to-speech data acquisition unit 20 is, for example, the text data of a news article shown in Figure 7(A).

[0038] In step S102, the term candidate detection unit 22 detects term candidates to be read aloud from the text data of the web page shown in Figure 7(A) (hereinafter referred to as text data TX). Here, the term "mutant virus" contained in text data TX is detected as a term candidate. The term candidate detection unit 22 also creates text data of the web page shown in Figure 7(B) (hereinafter referred to as text data TM) with markup that makes the detected term candidate "mutant virus" identifiable, and sends it to the text-to-speech unit 26.

[0039] In step S104, the explanatory text data acquisition unit 62 of the speech reading unit 26 checks the markup of the received text data TM and acquires the explanatory text data (hereinafter referred to as explanatory text data TD) of the term candidate "mutant virus" in Figure 7(C) for which the explanation is read aloud.

[0040] In step S106, the text data reading unit 64 generates the voice shown in Figure 7(D) (hereinafter referred to as the text reading voice AT) that reads the text data TM, and outputs it from a speaker, which is an example of an output device 508.

[0041] In step S108, the notification unit 28 determines the timing to notify the user that it is possible to read aloud the explanatory text data TD for the term candidate "mutant virus," based on the timing at which the text data reading unit 64 reads aloud the term candidate "mutant virus" using text-to-speech voice AT.

[0042] For example, the notification unit 28 determines that it is time to notify immediately before the text data reading unit 64 reads out the term candidate "mutant virus" using text-to-speech voice AT, while the term candidate is being read out, or immediately after the term candidate has been read out. If the information processing device 10 determines that it is time to notify, it proceeds to step S110. If the information processing device 10 does not determine that it is time to notify, it proceeds to step S116.

[0043] In step S110, the notification unit 28 notifies the user that the explanatory text data TD for the term "mutant virus," which is being read aloud by the text-to-speech voice AT, is available for reading aloud. Figure 7(D) shows an example of notifying the user with a chime sound, but the user may also be notified by speech insertion, vibration using a vibration function, or a change in voice. Furthermore, the user can be notified by a combination of the above methods. For example, by combining speech insertion and a change in voice, if the "ping (chime sound)" shown in Figure 7(D) is being read aloud in a female voice, the user may be notified by having a different male voice read "explanation available." The user can recognize from the notification from the notification unit 28 that the explanatory text data TD for the term "mutant virus," which is being read aloud by the text-to-speech voice AT, is available for reading aloud.

[0044] Users who wish to hear the explanatory text data TD for the term "mutant virus" read aloud must perform the action to have the explanatory text data TD read aloud within a specified time (e.g., 5 seconds) after receiving the notification. Users who do not wish to hear the explanatory text data TD for the term "mutant virus" read aloud do not need to perform the action to have the explanatory text data TD read aloud.

[0045] In step S112, the explanation reading unit 60 determines whether it has received an operation from the user to read the explanation text data TD within a predetermined time from the notification. If the explanation reading unit 60 has received an operation from the user to read the explanation text data TD within a predetermined time from the notification, it performs the process in step S114.

[0046] In step S114, the explanation reading unit 60 generates the audio shown in Figure 7(E) (hereinafter referred to as the explanation reading audio AD) which reads the explanation text data TD, outputs it from a speaker which is an example of the output device 508, and then proceeds to the process in step S116. If the explanation reading unit 60 does not receive an operation from the user to read the explanation text data TD within a predetermined time from the notification, it skips the process in step S114 and proceeds to the process in step S116.

[0047] In step S116, the information processing device 10 determines whether the reading of the text data TM has finished. If the reading of the text data TM has not finished, the information processing device 10 returns to step S106 and continues processing. Once the reading of the text data TM is finished, the information processing device 10 terminates the processing shown in the flowchart of Figure 6.

[0048] The information processing device 10 according to this embodiment can easily provide an explanatory text data AD to a user who requests it, by preparing explanatory text data TD for a term candidate "mutant virus" among the terms included in the text data TX that the user is likely to want an explanation of.

[0049] For example, this embodiment can be applied to a smartphone equipped with a screen reader application (hereinafter referred to as a screen reader app), which is an example of an application having a text-to-speech function. The smartphone is an example of an information processing device 10.

[0050] Figure 8 is an explanatory diagram of an example of a smartphone equipped with a screen reader application that has a text-to-speech function. In Figure 8, when the screen reader application is executed, the smartphone 1000 displays a display field 1006 for text data to be read aloud, a read-aloud button 1002 to start reading the text data aloud, and an explanation button 1004 to start reading the explanation text data aloud, on the display which is an example of an output device 508.

[0051] The user can start reading aloud the text data displayed in the display field 1006 by pressing the read-aloud button 1002. When the read-aloud button 1002 is pressed, the term candidate detection unit 22 of the smartphone 1000 detects the terms "mutant virus" and "Delta strain" as new terms by matching the text data in the display field 1006 with the new word dictionary 50 in Figure 4. In addition, the feature word determination unit 42 detects feature words from the text data in the display field 1006. Here, we will explain assuming that no feature words were detected from the text data in the display field 1006.

[0052] The history verification unit 44 detects the term candidate "mutant virus" by using, for example, the spoken history information 52 shown in Figure 5 to exclude the new term "Delta strain" that is identical to the term stored in the spoken history information 52 shown in Figure 5 from the new term "mutant virus" and "Delta strain" detected by the new term determination unit 40.

[0053] Furthermore, the history confirmation unit 44 creates text data with markup that makes the term candidate "mutant virus" included in the text data of the display field 1006 identifiable, and sends it to the text-to-speech unit 26. The explanatory text data acquisition unit 62 of the text-to-speech unit 26 checks the markup of the received text data and acquires the explanatory text data for the term candidate "mutant virus" to be read aloud.

[0054] The text data reading unit 64 generates audio to read the text data in the display field 1006 and outputs it from a speaker, which is an example of an output device 508. At the same time that the text data reading unit 64 reads out the term candidate "mutant virus," the notification unit 28 notifies the user that the explanatory text data for the term candidate "mutant virus" is available to be read aloud, for example, by a chime or other signal sound, speech insertion, vibration, or change in voice.

[0055] The user can recognize from the notification unit 28 that it is possible to have the explanatory text data for the term "mutant virus" read aloud. Users who wish to hear the explanatory text data for the term "mutant virus" read aloud must press the explanation button 1004 within a predetermined time after receiving the notification. Upon receiving the press of the explanation button 1004, the explanation reading unit 60 generates audio to read the explanatory text data and outputs it from the speaker, which is an example of the output device 508. The user can also return to having the text data in the display field 1006 read aloud by pressing the read-aloud button 1002.

[0056] According to this embodiment, even if the text data being read aloud contains unfamiliar terms, the user can easily hear an explanation of those terms.

[0057] [Second Embodiment] The first embodiment described an example of text data on a web page that is read aloud. The second embodiment describes an example of text data that is read aloud in a television broadcast program. The second embodiment is similar to the first embodiment except for a few parts, so some explanations will be omitted.

[0058] <System Configuration> Figure 9 is a diagram illustrating an example of an information processing system according to this embodiment. The information processing system in Figure 9 comprises a television broadcasting station 100, a television receiver 102 that outputs programs from received television broadcasts, an information processing device 10 equipped with an explanatory application which is an example of a program according to this embodiment, and a website 104.

[0059] The television receiver 102 can receive and output television broadcast programs from the broadcasting station 100 via the broadcasting network 108. The information processing device 10 can search for explanatory text data from the website 104 via a network such as the internet.

[0060] A user utilizing the explanatory application according to this embodiment places the information processing device 10, on which the explanatory application is running, in a position where the audio of the television broadcast output by the television receiver 102 can be input using a microphone, which is an example of an input device 506.

[0061] The information processing device 10, which has launched the explanatory application, uses the microphone, which is an example of an input device 506, to perform speech recognition processing on the audio of the television broadcast output by the television receiver 102. The text data converted by the speech recognition processing is an example of the read-aloud text data acquired by the information processing device 10.

[0062] The information processing device 10 performs, for example, morphological analysis on text data converted from the audio of a television broadcast by speech recognition processing, and detects term candidates to be read aloud in a process similar to that of the first embodiment.

[0063] When the information processing device 10 detects a candidate term whose explanation is to be read aloud, it notifies the user of the detection of the candidate term by reading it aloud, using a chime or other signal sound, inserting a speech, or using vibration functions. For example, a user who wants to hear the explanation of a candidate term in audio form will perform an operation to have the explanation text data read aloud within a predetermined time after receiving the notification.

[0064] The information processing device 10, having received a request from the user to have explanatory text data read aloud, obtains the explanatory text data by searching the website 104. The information processing device 10 generates speech, such as synthesized speech, to read the obtained explanatory text data and outputs it from a speaker, which is an example of an output device 508.

[0065] <Processing> Figure 10 is a flowchart of an example of the processing of the information processing device according to this embodiment. The information processing device 10, which has launched the explanatory application, is installed in a position where it can receive audio of the television broadcast output by the television receiver 102.

[0066] In step S200, the text-to-speech data acquisition unit 20 of the information processing device 10 performs speech recognition processing on the audio of the television broadcast to acquire text-to-speech data. In step S202, the term candidate detection unit 22 continues to attempt to detect term candidates from the text-to-speech data that will be read aloud.

[0067] If no candidate term for which an explanation is to be read is detected, the information processing device 10 proceeds to step S218. If a candidate term for which an explanation is to be read is detected, the information processing device 10 proceeds to step S204.

[0068] In step S204, the term candidate detection unit 22 transmits information about the detected term candidates to the voice reading unit 26. The notification unit 28 of the voice reading unit 26 notifies the user of the detection of a term candidate whose explanation is to be read by a chime or other signal sound, speech insertion, vibration using a vibration function, etc. The text data reading unit 64 of the voice reading unit 26 may also notify the user of the detection of a term candidate whose explanation is to be read by reading the term candidate aloud again.

[0069] In step S206, the explanation reading unit 60 determines whether it has received an operation from the user to read out the explanation text data (for example, by pressing the explanation button) within a predetermined time from the notification. If the information processing device 10 receives an operation from the user to press the explanation button within a predetermined time from the notification, it performs the process in step S208. If the information processing device 10 does not receive an operation from the user to press the explanation button within a predetermined time from the notification, it performs the process in step S218.

[0070] In step S208, the explanatory text data acquisition unit 62 of the voice reading unit 26 checks the information of the received term candidates and acquires the explanatory text data of the term candidates whose explanations are to be read aloud.

[0071] In step S210, the explanation reading unit 60 generates audio to read the explanation text data and outputs it from a speaker, which is an example of an output device 508. In step S212, the explanation reading unit 60 determines whether or not the reading of the explanation text data has finished. If the reading of the explanation text data has finished, the information processing device 10 performs the process in step S218. If the reading of the explanation text data has not finished, the information processing device 10 performs the process in step S214.

[0072] In step S214, the explanation reading unit 60 determines whether or not it has received an operation from the user for the explanation button before it finishes reading the explanation text data. If the explanation reading unit 60 receives an operation from the user for the explanation button before it finishes reading the explanation text data, it proceeds to step S216.

[0073] In step S216, the explanation reading unit 60 stops reading the explanation text data and then performs the process in step S218. If the explanation reading unit 60 does not receive an operation from the user on the explanation button before it finishes reading the explanation text data, it returns to the process in step S210 and continues reading the explanation text data.

[0074] In step S218, the information processing device 10 determines whether the execution of the explanatory application has finished. If the execution of the explanatory application has not finished, the information processing device 10 returns to step S200 and continues processing. If the execution of the explanatory application has finished, the information processing device 10 terminates the processing of the flowchart in Figure 10.

[0075] The information processing device 10 according to this embodiment makes it easy to read out explanatory text data to a user who requests an explanation of a term that a user might want explained, for example, when a term that a user might want explained is read aloud in a television broadcast program.

[0076] Figure 11 is an explanatory diagram of an example of a smartphone equipped with an explanatory application. When the explanatory application is executed, the smartphone 1100 in Figure 11 displays on the display, which is an example of an output device 508, a display field 1006 for the text data read aloud in the program, an explanatory button 1004 to start the audio reading of the explanatory text data, and a selection button 1010 to select the previous term candidate or the next term candidate.

[0077] By pressing the explanation button 1004, the user can initiate the reading aloud of the explanatory text data for the most recently notified term candidate. The smartphone 1100 may, after receiving the press of the explanation button 1004, read aloud the term candidate again for the user to confirm.

[0078] Furthermore, by operating the selection button 1010, the user can freely select from the previously notified term candidates, and by pressing the explanation button 1004, the explanation text data for the selected term candidate may be read aloud. This allows the user to later listen to the explanation text data for term candidates that were skipped without listening to the explanation, or to listen again to the explanation text data for term candidates that were already explained. In addition, the user may stop the reading of the explanation text data by pressing the explanation button 1004 while the explanation text data is being read aloud.

[0079] According to this embodiment, even if a user encounters unfamiliar terminology in a television broadcast program they are watching, they can easily hear an explanation of that term.

[0080] [Third Embodiment] The second embodiment describes an example of text data that is read aloud in a television broadcast program, and is obtained by processing the audio of the television broadcast program using speech recognition. The third embodiment describes an example of text data that is read aloud in a television broadcast program, and is obtained from a television receiver 102 that works in conjunction with a commentary application. Note that the third embodiment is similar to the first or second embodiment except for a few parts, so the explanation will be omitted as appropriate.

[0081] <System Configuration> Figure 12 is a configuration diagram of an example of an information processing system according to this embodiment. The information processing system in Figure 12 comprises a television broadcasting station 100, a television receiver 102 that outputs the received television broadcast program, an information processing device 10 equipped with an explanatory application which is an example of a program according to this embodiment, and a website 104.

[0082] The television receiver 102 can receive and output television broadcast programs from the broadcasting station 100 via the broadcasting network 108. The information processing device 10 can search for explanatory text data from the website 104 via a network such as the internet.

[0083] The television receiver 102 and the explanatory application installed on the information processing device 10 are linked using functions such as Hybridcast Connect. Hybridcast Connect is a function that connects Hybridcast-compatible televisions and internet services via smartphones or other devices. The television receiver 102 and the information processing device 10 are connected via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark) to enable data communication.

[0084] Hybridcast Connect is described, for example, in Japanese Patent Publication No. 6381106, or in "Hybridcast Utilization Technology" (https: / / www.nes.or.jp / transfer / catalog / hybridcast_05.html).

[0085] In the third embodiment, signals contained in the broadcast waves of a television broadcast can be used to activate an explanatory application on the information processing device 10, which is linked to the television receiver 102, or to display relevant information about the television broadcast program on the screen of the information processing device 10.

[0086] For example, in the information processing system according to the third embodiment, when a news program, which is an example of a program for which commentary is desirable, begins, a signal indicating the start of a program for which commentary is desirable is included in the broadcast wave from the broadcasting station 100. Upon receiving the signal indicating the start of a program for which commentary is desirable, the television receiver 102 activates the commentary application installed in the linked information processing device 10.

[0087] The information processing device 10, with the commentary application launched, can acquire text-to-speech data from information such as program subtitles obtained from a connected television receiver 102. The information processing device 10, with the commentary application launched, may also acquire text-to-speech data separately from the broadcasting station 100's website via the network 110 in accordance with the progress of the program.

[0088] The information processing device 10 performs morphological analysis on the acquired text data and detects term candidates for which explanations will be read aloud, using the same processing as in the second embodiment. When a term candidate for which an explanation will be read aloud is detected, the information processing device 10 notifies the user of the detection of the term candidate for which an explanation will be read aloud by reading the term candidate aloud, a chime or other signal sound, speech insertion, vibration using a vibration function, etc. For example, a user who wants to hear the explanation of a term candidate in audio form will perform an operation to have the explanatory text data read aloud within a predetermined time after the notification.

[0089] The information processing device 10, having received a request from the user to have explanatory text data read aloud, obtains the explanatory text data by searching the website 104. The information processing device 10 generates speech, such as synthesized speech, to read the obtained explanatory text data and outputs it from a speaker, which is an example of an output device 508.

[0090] <Processing> Figure 13 is a flowchart of an example of the processing of the information processing system according to this embodiment. In the information processing system according to the third embodiment, in step S300, the linkage between the television receiver 102 and the commentary application installed on the information processing device 10 is started using a function such as Hybridcast Connect.

[0091] In step S302, the television receiver 102 determines whether or not a program for which commentary is desirable is about to start, based on whether or not it has received a signal indicating the start of such a program. If the television receiver 102 receives a signal indicating the start of such a program, it proceeds to step S304.

[0092] In step S304, the television receiver 102 starts the commentary application installed on the linked information processing device 10. In step S306, the text-to-speech data acquisition unit 20 of the information processing device 10 acquires text-to-speech data from the linked television receiver 102 or the broadcasting station 100's website, etc. In step S308, the term candidate detection unit 22 continues to attempt to detect term candidates for commentary from the text-to-speech data.

[0093] If no candidate term for which an explanation is to be read is detected, the information processing device 10 proceeds to step S324. If a candidate term for which an explanation is to be read is detected, the information processing device 10 proceeds to step S310.

[0094] In step S310, the term candidate detection unit 22 transmits information about the detected term candidates to the voice reading unit 26. The notification unit 28 of the voice reading unit 26 notifies the user of the detection of a term candidate whose explanation is to be read by a chime or other signal sound, speech insertion, vibration using a vibration function, etc. The text data reading unit 64 of the voice reading unit 26 may also notify the user of the detection of a term candidate whose explanation is to be read by reading the term candidate aloud again.

[0095] In step S312, the explanation reading unit 60 determines whether it has received an operation from the user to read out the explanation text data (for example, by pressing the explanation button) within a predetermined time from the notification. If the information processing device 10 receives an operation from the user to press the explanation button within a predetermined time from the notification, it performs the process in step S314. If the information processing device 10 does not receive an operation from the user to press the explanation button within a predetermined time from the notification, it performs the process in step S324.

[0096] In step S314, the explanatory text data acquisition unit 62 of the voice reading unit 26 checks the information of the received term candidates and acquires the explanatory text data of the term candidates whose explanations are to be read aloud.

[0097] In step S316, the explanation reading unit 60 generates audio to read the explanation text data and outputs it from a speaker, which is an example of an output device 508. In step S318, the explanation reading unit 60 determines whether or not the reading of the explanation text data has finished. If the reading of the explanation text data has finished, the information processing device 10 performs the process in step S324. If the reading of the explanation text data has not finished, the information processing device 10 performs the process in step S320.

[0098] In step S320, the explanation reading unit 60 determines whether or not it has received an operation from the user for the explanation button before it finishes reading the explanation text data. If the explanation reading unit 60 receives an operation from the user for the explanation button before it finishes reading the explanation text data, it proceeds to step S322.

[0099] In step S322, the explanation reading unit 60 stops reading the explanation text data and then performs the process in step S324. If the explanation reading unit 60 does not receive an operation from the user on the explanation button before it finishes reading the explanation text data, it returns to the process in step S316 and continues reading the explanation text data.

[0100] In step S324, the information processing device 10 determines whether the execution of the explanatory application has finished. If the execution of the explanatory application has not finished, the information processing system returns to step S300 and continues processing. If the execution of the explanatory application has finished, the information processing system terminates the processing shown in the flowchart of Figure 13.

[0101] The information processing device 10 according to this embodiment makes it easy to read out explanatory text data to a user who requests an explanation of a term that a user might want explained, for example, when a term that a user might want explained is read aloud in a television broadcast program.

[0102] According to this embodiment, even if a user encounters unfamiliar terminology in a television broadcast program they are watching, they can easily hear an explanation of that term.

[0103] The information processing system of the disclosed embodiment should be considered illustrative and not restrictive. The above embodiment can be modified and improved in various ways without departing from the scope and spirit of the appended claims. Furthermore, the matters described in the above-described embodiment can be configured in other ways and combined in a non-contradictory manner. [Explanation of Symbols]

[0104] 10 Information Processing Devices 20. Text-to-speech data acquisition unit 22 Term Candidate Detection Unit 24 Operation Reception Section 26. Text-to-speech section 28 Notification Department 40 New word judgment department 42 Characteristic word determination unit 44 History Confirmation Section 50 New Words Dictionary 52. Text-to-Speech History Information 60 Commentary Reading Section 62 Explanation Text Data Acquisition Unit 64 Text Data Reading Unit

Claims

1. A term candidate detection unit is configured to detect term candidates for which explanations are to be read aloud from text data read aloud, and to exclude term candidates from the detected term candidates that are identical to terms stored in the reading history information. A notification unit is configured to notify the user that explanatory text data explaining the aforementioned term candidate can be read aloud, depending on the timing at which the term candidate is read aloud. The explanation reading unit is configured to read aloud the explanation text data when the user requests that the explanation text data be read aloud, An information processing device having

2. A term candidate detection unit configured to detect term candidates for which explanations are to be read aloud from text data read aloud, A notification unit is configured to notify the user that explanatory text data explaining the term candidate can be read aloud, by at least one of sound, voice, vibration, and voice change, depending on the timing at which the term candidate is read aloud. The explanation reading unit is configured to read aloud the explanation text data when the user requests that the explanation text data be read aloud, An information processing device having

3. A term candidate detection unit configured to detect term candidates for which explanations are to be read aloud from text data read aloud, A notification unit is configured to notify the user that explanatory text data explaining the aforementioned term candidate can be read aloud, depending on the timing at which the term candidate is read aloud. The system includes an explanatory text reading unit configured to read aloud the explanatory text data when the user requests that the explanatory text data be read aloud, The explanation reading unit is configured to, when it receives the operation from the user within a predetermined time after notification from the notification unit, to read aloud the explanation text data of the most recently read term candidate, and when it receives an operation from the user to select a term candidate from a plurality of term candidates for which to read aloud the explanation text data, to read aloud the explanation text data of the term candidate selected by the user. Information processing device.

4. The term candidate detection unit is configured to perform at least one of the following: determining new words from the spoken text data and detecting them as term candidates; and determining characteristic words from the spoken text data and detecting them as term candidates. The information processing apparatus according to any one of claims 1 to 3.

5. The notification unit is configured to notify the user that the explanatory text data can be read aloud, in accordance with the timing at which the candidate terms are read aloud by computer screen reading software, television broadcasts, or radio broadcasts. The information processing apparatus according to any one of claims 1 to 4.

6. The term candidate detection unit is configured to acquire the text-to-speech data by performing speech recognition processing on the audio of the television broadcast or radio broadcast. The information processing apparatus according to claim 5.

7. On the computer, A term candidate detection procedure that detects term candidates for which explanations are to be read aloud from text data read aloud by voice, and excludes term candidates from the detected term candidates that are identical to terms stored in the reading history information. A notification procedure that notifies the user that explanatory text data explaining the aforementioned term candidate can be read aloud, depending on the timing at which the term candidate is read aloud. When the user requests that the aforementioned explanatory text data be read aloud, the explanatory text data is read aloud in an explanatory text reading procedure. A program that executes the command.

8. A computer, A term candidate detection procedure for detecting term candidates whose explanations are read aloud from text data read aloud by voice. A notification procedure that, depending on the timing at which the aforementioned term candidate is read aloud, notifies the user that explanatory text data explaining the term candidate can be read aloud, through at least one of sound, voice, vibration, and voice change. When the user requests that the aforementioned explanatory text data be read aloud, the explanatory text data is read aloud in an explanatory text reading procedure. A program that executes the command.

9. A computer, A term candidate detection procedure for detecting term candidates whose explanations are read aloud from text data read aloud by voice. A notification procedure that notifies the user that explanatory text data explaining the aforementioned term candidate can be read aloud, depending on the timing at which the term candidate is read aloud. When the user requests that the explanatory text data be read aloud, the system executes an explanatory text reading procedure, which reads the explanatory text data aloud. The explanation reading procedure, when the user performs the operation within a predetermined time after notification by the notification procedure, reads aloud the explanation text data of the most recently read term candidate, and when the user performs an operation to select a term candidate from a plurality of term candidates for which to read aloud the explanation text data, reads aloud the explanation text data of the term candidate selected by the user. program.

Images