Information processing device, information processing method, and program

The information processing device uses syntax analysis to distinguish between current and future programs in user utterances, facilitating easy recording reservation settings by displaying separate search results for currently available and scheduled programs, addressing the challenge of ambiguous user inputs.

JP7606562B2Active Publication Date: 2024-12-25SATURN LICENSING LLC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023078391
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2016-09-26
Filing Date
2023-05-11
Publication Date
2024-12-25
Estimated Expiration
2037-09-12

AI Technical Summary

Technical Problem

Existing systems struggle to easily set recording reservations for programs based on user utterances that may include information about the desired program, such as 'Record the drama of 〇〇〇〇 next week', without clearly distinguishing between current and future program availability.

Method used

An information processing device and method that performs syntax analysis on user utterances to determine if the utterance includes time indicators, and if not, it searches for both current and future programs, displaying separate results for programs currently available and those scheduled, allowing easy reservation setting based on decomposed search strings.

Benefits of technology

Enables intuitive and easy setting of recording reservations by distinguishing between current and future program availability, ensuring accurate and efficient program selection based on user intent.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007606562000001
    Figure 0007606562000001
  • Figure 0007606562000002
    Figure 0007606562000002
  • Figure 0007606562000003
    Figure 0007606562000003
Patent Text Reader

Abstract

To make it possible to easily set a schedule for recording programs listed in a search result.SOLUTION: An information processing apparatus according to an aspect of the present technique is configured to obtain a first search result by performing a search for programs that include a content provided over a network and programs that have already been recorded or programs that will be provided after the present time, on the basis of a string indicating a content of user's utterance, and if the string contains a first string indicating that a search is to be performed for programs provided after the present time, obtain a second search result by performing a search for programs provided after the present time on the basis of the string. It is controlled to display the first search result or the second search result. The present technique can be applied to devices capable of receiving broadcast programs such as television receivers.SELECTED DRAWING: Figure 13
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present technology relates to an information processing device, an information processing method, and a program, and more particularly to an information processing device, an information processing method, and a program that enable easy setting of a recording reservation for a program listed as a search result. [Background technology]

[0002] In recent years, the accuracy of voice recognition has improved. For example, some television receivers allow users to search for programs by speaking into a microphone provided on a remote controller or the like.

[0003] By selecting a desired program from among the programs displayed in the search results, the user can schedule a recording of that program or start playing back a program that has already been recorded. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2011-118775 A Summary of the Invention [Problem to be solved by the invention]

[0005] The content of a user's speech when searching for a program may contain information that can identify what the user intends to do with the program found by the search. For example, if a user says, "Record a drama about XXX next week," it can be assumed that the user is trying to record a drama related to "XXX."

[0006] The present technology has been made in consideration of such circumstances, and makes it possible to easily set a recording reservation for a program listed as a search result. [Means for solving the problem]

[0007] According to one aspect of the present technology, there is provided an information processing device comprising: If the character string representing the content of the user's utterance does not include a first character string indicating that a search is to be performed for programs to be provided from now on, A search for programs including content provided via the network and recorded programs or programs provided in the future, The string obtaining a first search result by performing If the first string is included The display device further includes a circuit for obtaining a second search result by performing a search for programs to be provided from now on based on the character string, and the circuit controls to display the first search result or the second search result.

[0008] In one aspect of the present technology, If the character string representing the content of the user's utterance does not include a first character string indicating that a search is to be performed for programs to be provided from now on, A search for programs including content provided via the network and recorded programs or programs provided in the future, The string A first search result is obtained by performing If the first string is included A second search result is obtained by performing a search for programs to be provided from now on based on the character string. Also, control is performed to display the first search result or the second search result. Effect of the Invention

[0009] According to the present technology, it is possible to easily set a recording reservation for a program listed as a search result.

[0010] Note that the effects described herein are not necessarily limited to those described herein, and may be any of the effects described in this disclosure. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present technology. [Diagram 2] FIG. 1 is a diagram illustrating an example of an application structure of a TV. [Diagram 3] FIG. 13 is a diagram showing an example of a search result screen. [Figure 4]FIG. 13 is a diagram showing another example of the search result screen. [Diagram 5] FIG. 13 is a diagram illustrating an example of syntax analysis. [Figure 6] FIG. 2 is a block diagram showing an example of the hardware configuration of a TV. [Figure 7] FIG. 2 is a block diagram showing an example of the functional configuration of a TV. [Figure 8] FIG. 2 is a block diagram showing an example of a hardware configuration of a cooperation server. [Figure 9] 4 is a block diagram showing an example of a functional configuration of a cooperation server; FIG. [Figure 10] FIG. 2 is a sequence diagram illustrating an operation of the information processing system. [Figure 11] FIG. 1 illustrates an example of identifying a user's intent. [Figure 12] FIG. 13 illustrates another example of identifying a user's intent. [Figure 13] FIG. 11 is a diagram showing an example of a flow of screen display. [Figure 14] FIG. 11 is a sequence diagram illustrating another operation of the information processing system. [Figure 15] FIG. 13 is a diagram showing an example of a search result screen. [Figure 16] FIG. 13 is a diagram showing another display example of the search result screen. [Figure 17] FIG. 11 is a diagram showing an example of a flow of screen display. [Figure 18] FIG. 11 is a diagram showing another example of the flow of screen display. [Figure 19] FIG. 11 is a sequence diagram illustrating still another operation of the information processing system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the present technology will be described in the following order. 1. Example of information processing system configuration 2. Example of search results 3. First search example (search using strings with different granularity) 4. Second search example (Example of narrowing the search range according to the content of the utterance) 5. Third search example (when the program can be identified on the server side) 6. Variations

[0013] <<1. Example of information processing system configuration>> FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment of the present technology.

[0014] The information processing system in FIG. 1 is configured by connecting a television receiver 1 (hereinafter, appropriately referred to as TV 1) and a link server 2 via a network 3 such as the Internet.

[0015] Communication is performed between the TV 1 and the link server 2 via a network 3. The network 3 may be any of a wired network, a wireless network, and a combination of a wired and wireless network.

[0016] The TV 1 receives television broadcasts such as terrestrial digital broadcasts, satellite broadcasts, and cable broadcasts. The TV 1 displays the images of the broadcasted programs on a display and outputs the audio of the programs from a speaker. The programs may be provided via a network 3.

[0017] The TV 1 also has a function of recording (storing) the received programs on an internal or external recording medium, and a function of playing back the recorded programs. The recording of the programs may be performed by a recording device connected to the TV 1.

[0018] FIG. 2 is a diagram showing an example of an application structure of the TV1.

[0019] A TV OS (Operating System) is installed on the TV 1. Various applications such as a search application, a program playback application, a program recording application, and a program guide application run on the TV OS in cooperation with the TV OS.

[0020] The search application in Figure 2 is, for example, an application that searches for content on the Web. The content includes various types of digital data available to users, such as videos, still images, music, games, e-books, applications, and combinations of two or more of these.

[0021] The program playback application is an application that plays programs that are currently being broadcast or that have been recorded. The program recording application is an application that records programs. The program guide application is an application that displays an EPG (Electronic Program Guide) and manages program recording reservations.

[0022] The TV 1 is also provided with various modules such as a program search module that works with the search application. The program search module searches for programs listed in the EPG, for example, or for recorded programs. While the search application searches for Web content, which is external content provided via the network 3, the program search module searches for content within the TV 1.

[0023] For example, the search application is software prepared by a company that provides a TV OS, while the program search module is software prepared by a company that manufactures and sells the TV1, receiving software such as the TV OS and the search application.

[0024] Various functions such as receiving programs, recording programs, playing back recorded programs, and searching for programs are realized by executing these programs.

[0025] The TV 1 having such various functions is operated using a remote controller 4. The remote controller 4 transmits to the TV 1 information indicating the content of an operation performed by a user.

[0026] The remote controller 4 is provided with a microphone in addition to buttons used for various operations. When the microphone button is pressed, the remote controller 4 collects the user's voice with the microphone and transmits the voice data to the TV 1.

[0027] As described later, in the TV 1, it is possible to search for various contents including programs using voice. Of course, it is also possible to search for contents using character strings manually input using buttons on the remote controller 4. The following description will be focused on the case where content is searched for using voice.

[0028] The link server 2 is a server managed by a company that provides the OS for TVs. The link server 2 provides various functions, such as a search function for web content and a function for recognizing voice transmitted from the TV 1, to each device equipped with the OS for TVs, including the TV 1.

[0029] <<2. Example of search results>> FIG. 3 is a diagram showing an example of a search result screen.

[0030] For example, when the user operates the remote controller 4 to execute a search function and utters a search key word, a search result screen as shown in FIG.

[0031] A character string display field 11 is formed above the search result screen to display a character string that is a key for searching for content. In the example of Fig. 3, the character string "Programs in which XXX appears" is displayed. In the TV 1, it is possible for a user to search for content using such natural language that is used daily.

[0032] When a user presses the microphone button on the remote controller 4 and speaks, voice data is transmitted from the remote controller 4 to the TV 1. The voice data transmitted to the TV 1 is transmitted to the linking server 2, where voice recognition is performed. The display in the character string display field 11 is based on the result of the voice recognition transmitted from the linking server 2.

[0033] Below the character string display field 11, a Web video area 21, a program area 22, and a movie area 23 are formed in that order from the top. In each area, card-shaped images representing contents listed as search results are displayed side by side. Hereinafter, the card-shaped images representing contents are simply referred to as card images as appropriate.

[0034] The Web video area 21 is a display area for rows of card images representing videos on the Web. For example, the linked server 2 provides a service for distributing videos posted by various users. The card images displayed in the Web video area 21 are images representing videos searched for by the linked server 2 among videos distributed by a video distribution service.

[0035] The program area 22 is a display area for rows of card images representing programs. The words "Terrestrial D Reservation" are displayed above the card image on the left side. The card images displayed in the program area 22 in Fig. 3 are images representing programs that can be scheduled for recording, searched from among programs currently being broadcast and programs scheduled to be broadcast, i.e., programs to be broadcast from now onwards.

[0036] A card image representing a program is divided into two sections: the top section displays a thumbnail image of the program, and the bottom section displays information about the program, such as the program name and broadcast date and time.

[0037] The movie area 23 is a display area for rows of card images representing movie content on the Web. For example, the linked server 2 also provides a service for selling movie content by download or streaming. The card images displayed in the movie area 23 are images representing movie content searched for among movie content sold by the linked server 2.

[0038] It should be noted that the dashed lines indicating the Web video area 21, the program area 22, and the movie area 23 are not actually displayed on the screen. Although not shown on the search result screen in Fig. 3, a display area for search results of content in other categories is arranged below the movie area 23. The user can view search results of content in other categories that are not displayed by scrolling the display range.

[0039] As will be described in more detail later, the search results displayed in the Web video area 21 and the movie area 23 are the results obtained by performing a search using a string representing what the user has said, i.e., the entire string displayed in the string display field 11, as a key.

[0040] On the other hand, the search results displayed in the program area 22 are the results obtained by performing a search using a decomposed character string obtained as a result of syntactic analysis of a character string expressing the contents of a user's speech.

[0041] A single search result screen will display the results obtained by searching based on the entire string entered by the user, as well as the results obtained by searching based on the broken down strings that make up the string.

[0042] FIG. 4 is a diagram showing another example of the search result screen.

[0043] A row of card images representing programs for which recording can be scheduled and a row of card images representing programs that have already been recorded may be displayed in the program area 22. Of the two rows of card images displayed in the program area 22 in Fig. 4, the lower row is the row of card images representing programs that have already been recorded. The words "Terrestrial D Recorded" are displayed above the leftmost card image representing a recorded program.

[0044] In the program area 22, there are cases where rows of card images representing programs for which recording can be scheduled are not displayed, and only rows of card images representing programs that have already been recorded are displayed.

[0045] When such a search result screen is displayed, the user can operate the remote controller 4 to select a desired content, and can then watch a Web video, schedule a recording of a program, play a recorded program, download movie content, etc. The card image representing the selected content is highlighted in a pop-up state, as shown in the Web video at the top left of Figs.

[0046] <<3. First search example>> Here, an example will be described in which a search is performed based on the entire character string input by the user, and also based on decomposed character strings that constitute the character string.

[0047] FIG. 5 is a diagram showing an example of syntax analysis.

[0048] As shown in the upper part of FIG. 5, for example, when a user utters the words "XXX drama next week," the link server 2 performs voice recognition and generates the character string "XXX drama next week."

[0049] Assume that "xxx" is a proper noun, such as the name of an actor. In this example, the user intends to find out about a drama that "xxx" will be appearing in, which will be broadcast next week. The character string "xxx's drama next week" is transmitted from the link server 2 to the TV 1.

[0050] The search application of the TV1, which receives the character string "Next week's drama of XXX" transmitted from the link server 2, further acquires the search results of the Web content. The search results of the Web content are transmitted to the TV1 from the link server 2, following the character string representing the content of the user's utterance.

[0051] In the link server 2, a search for Web video and movie content is performed using the entire character string "next week's XXX drama" as a single entity, and the search results are transmitted to the TV 1.

[0052] The TV 1 displays card images representing Web videos obtained as search results in the Web video area 21 of the search result screen, and displays card images representing movie contents in the movie area 23 of the search result screen.

[0053] Furthermore, TV1 performs syntactic analysis of the character string "Next week's drama about XXX", as indicated by the arrow in Fig. 5. Syntactic analysis divides the natural language spoken by the user into morphemes, which are the smallest units that have meaning, and determines the part of speech of each morpheme. Also, by combining each morpheme, a decomposed character string with attributes suitable for use in searching for programs is generated.

[0054] In the example of Figure 5, based on the character string "Next week's XXX drama", decomposed character strings are generated for the "tense" attribute "next week", the "person's name" attribute "XXX", and the "genre" attribute "drama".

[0055] The TV1 sets search conditions based on "next week", "xxx", and "drama" obtained as a result of the syntax analysis, and searches for programs. For example, the search conditions are set to search for programs in the genre of "drama" that will be broadcast "next week" based on today. The TV1 adds and displays card images representing the programs obtained as search results in the program area 22 of the search result screen.

[0056] This will result in a search result screen being displayed that includes search results based on the entire string representing the content of the user's utterance, as well as search results based on the broken down strings that make up that string, as described with reference to Figures 3 and 4.

[0057] <3-1. Example of each device configuration> <3-1-1. TV1 Configuration> FIG. 6 is a block diagram showing an example of the hardware configuration of the TV 1. As shown in FIG.

[0058] The broadcast receiving unit 101 receives a broadcast wave signal supplied from an antenna (not shown), performs various processes such as A / D conversion and demodulation, and outputs program data to a decoder 102 .

[0059] The decoder 102 decodes the video stream constituting the program data, and displays the video of the program on a display 103 consisting of an LCD (Liquid Crystal Display), an organic EL display, etc. The decoder 102 also decodes the audio stream constituting the program data, and outputs the audio of the program from a speaker 104 in synchronization with the video.

[0060] A CPU (Central Processing Unit) 106, a ROM (Read Only Memory) 107, and a RAM (Random Access Memory) 108 are connected to one another via a bus 105. The CPU 106 executes programs stored in the ROM 107 and a storage unit 109 using the RAM 108, and controls the entire TV 1.

[0061] The recording unit 109 is configured with a recording medium such as a hard disk drive (HDD) or a solid state drive (SSD), etc. The recording unit 109 records various data such as content such as a program, EPG data, and a program.

[0062] The communication unit 110 is an interface with the network 3. The communication unit 110 communicates with the link server 2.

[0063] The operation I / F unit 111 receives data transmitted from the remote controller 4 , and outputs the data to the CPU 106 via the bus 105 .

[0064] FIG. 7 is a block diagram showing an example of the functional configuration of the TV 1. As shown in FIG.

[0065] At least some of the functional units shown in FIG. 7 are realized by the CPU 106 in FIG. 6 executing the programs in FIG.

[0066] The recording control unit 121 refers to the information recorded in the program information recording unit 125, and when the broadcast of a program for which recording is scheduled starts, controls the broadcast receiving unit 101 to acquire data of the program to be recorded. Information related to the recording schedule of the program is recorded in the program information recording unit 125. The recording control unit 121 outputs the acquired program data to the recorded program recording unit 122 to record it.

[0067] For example, the recording control unit 121 is realized by executing a program recording application.

[0068] The recorded program recording unit 122 is realized in the recording unit 109. The recorded program recording unit 122 records the program data supplied from the recording control unit 121, and manages it as a recorded program.

[0069] The playback control unit 123 reads out data of the program instructed to be played back from among the recorded programs stored in the recorded program recording unit 122, and outputs the data to the decoder 102 for playback.

[0070] The broadcast wave reception control unit 124 controls reception of broadcast waves by the broadcast receiving unit 101. In addition, the broadcast wave reception control unit 124 extracts EPG data from the broadcast wave signal received by the broadcast receiving unit 101, and causes the program information recording unit 125 to record it.

[0071] For example, the playback control unit 123 and the broadcast wave reception control unit 124 are realized by executing a program playback application.

[0072] The program information recording unit 125 is realized in the recording unit 109. The program information recording unit 125 records the EPG data supplied from the broadcast wave reception control unit 124 and information relating to recording reservations supplied from the recording reservation management unit 126.

[0073] The recording reservation management unit 126 sets a recording reservation for a given program in accordance with a user's operation, and causes the program information recording unit 125 to record information indicating the contents of the reservation.

[0074] For example, the recording reservation management unit 126 is realized by executing a program guide application.

[0075] The program search unit 127 outputs the character string supplied from the character string acquisition unit 129 to the syntax analysis unit 131, and causes the syntax analysis unit 131 to perform syntax analysis. The program search unit 127 searches for a program using the decomposed character string supplied from the syntax analysis unit 131 as a result of the syntax analysis, as a search key.

[0076] Specifically, the program search unit 127 refers to the EPG data recorded in the program information recording unit 125 and searches for programs that are currently being broadcast or scheduled to be broadcast. The program search unit 127 also searches for recorded programs recorded in the recorded program recording unit 122. The program search unit 127 outputs information about the programs in the search results to the display control unit 132.

[0077] For example, the program search unit 127 is realized by executing a program search module.

[0078] The voice data receiving unit 128 receives voice data indicating the contents of the user's speech transmitted from the remote controller 4 by controlling the operation I / F unit 111. The voice data receiving unit 128 outputs the received voice data to the character string acquiring unit 129.

[0079] The character string acquisition unit 129 controls the communication unit 110 to transmit the received voice data to the linking server 2. Furthermore, the character string acquisition unit 129 acquires a character string transmitted from the linking server 2 in response to the transmission of the voice data. The character string acquisition unit 129 outputs the acquired character string to the program search unit 127 and the Web content search unit 130.

[0080] When a character string to be used as a search key is manually input by the user, the character string transmitted from the remote controller 4 is also received by the operation I / F unit 111 and acquired by the character string acquisition unit 129 .

[0081] The Web content search unit 130 controls the communication unit 110 to obtain the search results of the Web content transmitted from the link server 2. The Web content search unit 130 outputs the search results of the Web content to the display control unit 132.

[0082] A character string may be transmitted from TV 1 to link server 2, and in response thereto, link server 2 may search for Web content, and search results may be transmitted from link server 2 to TV 1. In this case, Web content search unit 130 transmits the character string provided from character string acquisition unit 129 to link server 2, and acquires the search results of Web content.

[0083] The syntax analysis unit 131 performs syntax analysis of the character string supplied from the program search unit 127, and outputs the resolved character string to the program search unit 127. The syntax analysis unit 131 has information used for natural language processing.

[0084] The display control unit 132 causes the display 103 to display a search result screen based on the search results supplied from the program search unit 127 and the search results supplied from the Web content search unit 130 .

[0085] For example, a voice data receiving unit 128, a character string acquiring unit 129, a Web content searching unit 130, and a display control unit 132, which are enclosed by a dashed line L1, are realized by executing the search application.

[0086] <3-1-2. Configuration of Collaboration Server 2> FIG. 8 is a block diagram showing an example of the hardware configuration of the linking server 2. As shown in FIG.

[0087] The CPU 201, the ROM 202, and the RAM 203 are interconnected by a bus 204. To the bus 204, an input / output interface 205 is further connected.

[0088] An input unit 206 including a keyboard, a mouse, etc., and an output unit 207 including a display, a speaker, etc. are connected to the input / output interface 205. In addition, a recording unit 208 including a hard disk, a non-volatile memory, etc., a communication unit 209 including a network interface, etc., which communicates with the TV 1, and a drive 210 which drives a removable medium 211 are also connected to the input / output interface 205.

[0089] FIG. 9 is a block diagram showing an example of the functional configuration of the linking server 2. As shown in FIG.

[0090] At least some of the functional units shown in Fig. 9 are realized by executing a predetermined program by CPU 201 in Fig. 8. In link server 2, a voice data acquisition unit 221, a voice recognition unit 222, and a search unit 223 are realized.

[0091] The voice data acquisition unit 221 controls the communication unit 209 to acquire voice data transmitted from the TV 1. The voice data acquisition unit 221 outputs the acquired voice data to the voice recognition unit 222.

[0092] The voice recognition unit 222 performs voice recognition on the voice data supplied from the voice data acquisition unit 221. The voice recognition unit 222 controls the communication unit 209 to transmit a character string representing the content of the user's utterance to the TV 1. In addition, the voice recognition unit 222 outputs the character string representing the content of the user's utterance to the search unit 223.

[0093] The search unit 223 searches for Web content based on the character string supplied from the voice recognition unit 222 or, as appropriate, the character string transmitted from the TV 1. The recording unit 208 records various content data such as data of Web videos distributed by a video distribution service provided by the linking server 2, and movie content transmitted by a content sales service provided by the linking server 2. The search unit 223 controls the communication unit 209 to transmit the search results to the TV 1.

[0094] In this example, the functions of linking server 2 are realized by one computer, but the functions of linking server 2 may be distributed and realized by multiple computers. When the functions of linking server 2 are distributed and realized by multiple computers, each configuration shown in Fig. 9 is realized on multiple computers, and processing is performed in cooperation with each other.

[0095] <3-2. Examples of operation of information processing system> Here, the operations of the TV 1 and the link server 2 having the above-described configuration will be described with reference to the sequence diagram of FIG.

[0096] For example, when a user's voice such as "next week's XXX drama" is collected by a microphone, the remote controller 4 transmits the collected voice data to the TV 1 in step S1.

[0097] In step S11, the audio data receiving unit 128 of the TV 1 receives the audio data transmitted from the remote controller 4. The received audio data is supplied to the character string obtaining unit 129.

[0098] In step S 12 , the character string acquiring unit 129 transmits the voice data to the link server 2 .

[0099] In step S51, the voice data acquisition unit 221 of the link server 2 receives the voice data transmitted from the TV 1. The received voice data is supplied to the voice recognition unit 222.

[0100] In step S52, the voice recognition unit 222 performs voice recognition based on the voice data, and generates a character string representing the content of the user's utterance. The character string obtained by the voice recognition is supplied to the search unit 223.

[0101] In step S53, the voice recognition unit 222 transmits the character string obtained by the voice recognition to the TV 1.

[0102] In step S54, the search unit 223 searches for Web content based on the entire character string obtained by the voice recognition, and in step S55, transmits the search results to the TV 1.

[0103] The character string transmitted from the link server 2 in step S53 is received by the character string acquisition unit 129 of the TV 1 in step S13. The search result transmitted from the link server 2 in step S55 is received by the Web content search unit 130 of the TV 1 in step S14. The search result received by the Web content search unit 130 is supplied to the display control unit 132.

[0104] In step S 15 , the character string acquiring unit 129 outputs the character string transmitted from the link server 2 to the program searching unit 127 .

[0105] In step S16, the display control unit 132 causes the display 103 to display a search result screen on which card images representing the searched Web contents are arranged, based on the search result supplied from the Web content search unit 130. At this time, the card images representing the searched Web videos are displayed in the Web video area 21, and the card images representing the movie contents are displayed in the movie area 23.

[0106] On the other hand, in step S31, the program search unit 127 receives the character string supplied from the character string acquisition unit 129, and outputs it to the syntax analysis unit 131 in step S32.

[0107] In step S41, the syntax analysis unit 131 receives the character string supplied from the program search unit 127, and performs syntax analysis in step S42.

[0108] In step S43, the syntax analysis unit 131 outputs the decomposed character strings acquired as a result of the syntax analysis to the program search unit 127 together with information on the attributes of each decomposed character string.

[0109] In step S33, the program search unit 127 receives the information supplied from the syntax analysis unit 131, and in step S34, searches for programs currently being broadcast / scheduled to be broadcast and recorded programs based on the decomposed character string. For example, a search condition is set based on the decomposed character string, and a program search is performed.

[0110] In step S35, the program search unit 127 outputs information about the programs in the search results together with information specifying the application to be started when each program is selected to the display control unit 132. For example, for a searched program that is currently being broadcast or is scheduled to be broadcast, information is output that indicates a program guide application as the application to be started when the program is selected. Also, for a searched recorded program, information is output that indicates a program playback application as the application to be started when the program is selected.

[0111] In step S17, the display control unit 132 receives the information supplied from the program search unit 127, and in step S18, adds and displays a card image of the searched program on the search result screen.

[0112] As a result, in addition to displaying the Web video area 21 and the movie area 23, one or both of a row of card images representing programs currently being broadcast or scheduled to be broadcast and a row of card images representing recorded programs are displayed in the program area 22. After that, the series of processes for displaying the search result screen is completed.

[0113] When a user selects a card image of a program currently being broadcast or scheduled to be broadcast, displayed in the program area 22, a program guide application is launched, detailed information about the program is displayed, and then a recording reservation for the selected program is set by the recording reservation management unit 126.

[0114] Furthermore, when a card image of a recorded program displayed in the program area 22 is selected by the user, a program playback application is started and data of the selected recorded program is read from the recorded program storage unit 122. The read data is supplied to the playback control unit 123, and playback of the recorded program is started.

[0115] Through the above series of processes, a single search result screen will display information about web content searched for based on the entire string entered by the user, as well as information about programs searched for based on the broken-down strings that make up the string.

[0116] Among the programs that are the subject of a search, there are some that cannot be found when searching using the entire string, but can be found when searching using a decomposed string. Also, if a program search is performed using the entire string, programs that are unrelated to the "xxx" that the user is looking for, for example, may be found based on strings other than "xxx."

[0117] By performing a search using the decomposed character string, it is possible to realize a highly accurate search for programs that is in line with the user's intention.

[0118] Although the search using the resolved character string is performed for TV programs, it may also be performed for Web content.

[0119] 10 is performed in parallel with other steps or before or after other steps as appropriate. The same applies to the processing in the sequence diagrams described below.

[0120] <<4. Second search example>> Depending on the content of the user's utterance, it may be possible to determine whether the user is trying to find a program among currently airing / scheduled airings and set up a recording schedule for it, or whether the user is trying to find a program among recorded programs and watch it.

[0121] When the user's intention can be identified, the way in which search results are presented and the flow of screen displays may be changed in accordance with the user's intention.

[0122] 11 and 12 are diagrams showing specific examples of user intent.

[0123] As shown in the upper part of Fig. 11, when a user utters a word with a specific attribute following the word "recorded", it is identified that the user is trying to watch a recorded program related to the word uttered after the word "recorded". In this example, when the user utters a word with at least one attribute of "tense", "person's name", "program name", "genre", and "broadcast station name" following the word "recorded", such user's intention is identified.

[0124] When a syntactic analysis of a character string representing the contents of a user's utterance detects that the user has uttered a word with a specific attribute following the word "recorded," a recording list display command is output from the syntactic analysis unit 131 to the program search unit 127, as indicated by the arrow. The recording list display command is a command that instructs the display of the search results of recorded programs.

[0125] The program search unit 127 that has received the recording list display command searches for recorded programs only. The search result screen displays recorded programs found based on the resolved character string following "recorded" as search results, and does not display programs currently being broadcast or scheduled to be broadcast.

[0126] For example, as shown in the lower part of Fig. 11, when a user utters "I want to watch the recorded △△△△", the syntax of the character string is parsed by the syntax analysis unit 131, and a recording list display command is supplied together with the "program name" attribute "△△△△" to the program search unit 127. Here, "△△△△" is assumed to be a proper noun representing the program name.

[0127] The program search unit 127 searches for programs based on "△△△△", targeting only recorded programs. The program search screen displays the search results of recorded programs that contain "△△△△" as the "program name".

[0128] On the other hand, as shown in the upper part of Fig. 12, when a user utters any one of the words "reserve", "record", and "reserve recording" following a word with a specific attribute, the user is identified as attempting to set up a recording reservation for a program currently being broadcast or scheduled to be broadcast that is related to the word uttered before the word "reserve", etc. In this example, too, the user's intention is identified when the user utters a word such as "reserve" following at least one of the words with attributes of "tense", "person's name", "program name", "genre", and "broadcast station name".

[0129] In addition, when the user utters the words "reserve", the same processing is performed as when the user utters the words "reserve". In addition, when the user utters the words "record", the same processing is performed as when the user utters the words "record".

[0130] When a syntactic analysis of a character string representing the contents of a user's utterance detects that the user has uttered a word such as "reserve" following a word with a specific attribute, as indicated by the arrow, a recording reservation setting command is output from the syntactic analysis unit 131 to the program search unit 127. The recording reservation setting command is a command that instructs displaying the search results of currently airing / scheduled to air programs for which recording reservations can be set.

[0131] The program search unit 127 that has received the recording reservation setting command searches for programs only for programs that are currently being broadcast or scheduled to be broadcast. On the search result screen, programs that are currently being broadcast or scheduled to be broadcast, which are searched for based on the resolved character string before "reserve", etc., are displayed as search results, and recorded programs are not displayed.

[0132] 12, when a user utters "record the drama of XXX next week," the character string is parsed in the parsing unit 131. As a result of the parsing, a recording reservation setting command is supplied to the program search unit 127 together with the resolved character strings of "next week" in the "tense" attribute, "XXX" in the "person's name" attribute, and "drama" in the "genre" attribute.

[0133] The program search unit 127 searches for programs based on "xxx", targeting only "drama" programs that will be broadcast "next week". The program search screen displays the search results of programs in which "xxx" appears.

[0134] In this way, the TV 1 can identify the user's intention from the content of the utterance and change the way in which the search results are presented.

[0135] That is, if a user finds a program among currently airing / scheduled programs and wants to schedule a recording of it, the search range is narrowed down and the search results of currently airing / scheduled programs are displayed, whereas if a user finds a program among recorded programs and wants to watch it, the search range is narrowed down and the search results of recorded programs are displayed.

[0136] By changing the way search results are presented in this way, it is possible to display a search result screen that is intuitive and easy for the user to understand.

[0137] <4-1. Screen transition examples> FIG. 13 is a diagram showing an example of the flow of screen display.

[0138] Screen #1 shown on the left side of Fig. 13 is the screen of the program being viewed. For example, if the user presses the microphone button on the remote controller 4 in this state, the TV 1 enters a state of waiting for voice input from the user, as indicated by the tip of the arrow A1. The display on the display 103 switches to screen #2, which is a voice standby screen.

[0139] The voice data transmitted from the remote controller 4 is transmitted to the linking server 2, and a character string representing the contents of the user's speech is acquired. The character string transmitted from the linking server 2 is parsed by the TV 1, and a decomposed character string is acquired. Depending on the contents of the decomposed character string, the parsing unit 131 outputs a recording list display command or a recording reservation setting command to the program search unit 127 as appropriate.

[0140] If the results of the syntax analysis output from syntax analysis unit 131 do not include a recording list display command or a recording reservation setting command, as shown by the tip of arrow A2, the display on display 103 switches to search result screen #3 in which the program search range has not been narrowed. Search result screen #3 is the same screen as that described with reference to Fig. 4, including search results for programs currently being broadcast / scheduled to be broadcast and recorded programs.

[0141] When a specific program currently being broadcast or scheduled to be broadcast is selected on the search result screen #3, the display on the display 103 switches to a program details screen #4, as indicated by the tip of an arrow A3. The program details screen #4 is a screen including detailed information such as the contents and broadcast date and time of the program selected by the user. The program details screen #4 is displayed based on the EPG recorded in the program information recording unit 125, for example.

[0142] The program details screen #4 displays a recording reservation button that is operated when setting a recording reservation for the program whose detailed information is being displayed, a viewing reservation button that is operated when setting a viewing reservation, and a back button that is operated to return to the search result screen #3.

[0143] For example, when the recording reservation button is operated, as shown by the tip of arrow A4, the display on display 103 switches to reservation content confirmation screen #5. In addition to the reservation content, reservation content confirmation screen #5 also displays a confirmation button that is operated to confirm the reservation, etc.

[0144] When the Confirm button is operated, as shown by the end of arrow A5, the recording reservation of the program is completed, and information indicating the content is recorded in program information recording unit 125. As shown by arrow A6, the display on display 103 switches to program details screen #4. When the Back button is operated on program details screen #4, as shown by arrow A7, the display on display 103 returns to search result screen #3.

[0145] When a specific recorded program is selected on the search result screen #3, as shown by the tip of the arrow A8, the display on the display 103 switches to the program playback screen #6. The data of the recorded program is read from the recorded program storage unit 122 and played back by the playback control unit 123.

[0146] When the playback of the program ends, as indicated by an arrow A9, the display on the display 103 returns to the search result screen #3, as indicated by an arrow A10.

[0147] If the result of syntax analysis output from syntax analysis unit 131 does not include a recording list display command or a recording reservation setting command, the display on display 103 during recording reservation setting is switched to be surrounded by a dashed line L11.

[0148] On the other hand, if the result of the syntax analysis output from the syntax analysis unit 131 includes a recording list display command or a recording reservation setting command, as shown at the end of arrow A11, the display on the display 103 switches to search result screen #7 in which the program search range has been narrowed down.

[0149] Search result screen #7 becomes a screen that shows the search results of recorded programs when a recording list display command is output, and becomes a screen that shows the search results of programs currently being broadcast / scheduled to be broadcast when a recording reservation setting command is output.

[0150] When the command output from the syntax analysis unit 131 is a recording reservation setting command and a specific program currently being broadcast or scheduled to be broadcast is selected on the search result screen #7, as indicated by the tip of the arrow A12, the recording reservation of the program is completed, and information indicating the details thereof is recorded in the program information recording unit 125. That is, in this case, since it is specified that the user is attempting to set up a recording reservation of the program, the program details screen #4 and the like are not displayed.

[0151] As indicated by arrow A13, while a program is being scheduled, search result screen #7 continues to be displayed on display 103. The user can set up recording reservations for multiple programs one after another simply by selecting a program currently being broadcast or scheduled to be broadcast that is listed as a search result on search result screen #7.

[0152] When the command output from the syntax analysis unit 131 is a recording list display command and a specific recorded program is selected on the search result screen #7, the display on the display 103 switches to the program playback screen #6, as indicated by the tip of the arrow A14. The data of the recorded program is read from the recorded program storage unit 122 and played back by the playback control unit 123.

[0153] When the playback of the program has ended, the display on display 103 returns to search result screen #7, as indicated by arrow A15.

[0154] In this way, when the result of syntax analysis output from syntax analysis unit 131 includes a recording reservation setting command, the display on display 103 when recording reservation is set is switched to be surrounded by a dashed line L12.

[0155] In particular, by switching the screen display until the recording reservation is set in the manner described above according to the user's intention identified from the content of the utterance, the user can easily set a recording reservation for a program listed as a search result.

[0156] <4-2. Examples of information processing system operations> Here, the operations of the TV 1 and the link server 2 that realize the screen display shown in FIG. 13 will be described with reference to the sequence diagram of FIG.

[0157] The process of Fig. 14 is started when the TV 1 receives audio data transmitted from the remote controller 4. Note that the processes of steps S101 to S105, S121 to S123, and S141 to S143 of the TV 1 shown in Fig. 14 are respectively similar to the processes of steps S12 to S16, S31 to S33, and S41 to 43 of Fig. 10. Also, the processes of steps S151 to S155 of the linking server 2 shown in Fig. 14 are respectively similar to the processes of steps S51 to S55 of Fig. 10. Duplicate descriptions will be omitted as appropriate.

[0158] In step S101 , the character string acquisition unit 129 of the TV 1 transmits to the link server 2 the voice data that has been transmitted from the remote controller 4 and received by the voice data receiving unit 128 .

[0159] In step S 151 , the voice data acquisition unit 221 of the link server 2 receives the voice data transmitted from the TV 1 .

[0160] In step S152, the voice recognition unit 222 performs voice recognition and generates a character string representing the content of the user's utterance.

[0161] In step S153, the voice recognition unit 222 transmits the character string obtained by the voice recognition to the TV 1.

[0162] In step S154, the search unit 223 searches for Web content based on the entire character string obtained by the voice recognition, and in step S155, transmits the search results to the TV 1.

[0163] The character string transmitted from the linked server 2 in step S153 is received by the character string acquisition unit 129 of the TV 1 in step S102. The search result transmitted from the linked server 2 in step S155 is received by the Web content search unit 130 of the TV 1 in step S103.

[0164] In step S 104 , the character string acquiring unit 129 outputs the character string transmitted from the link server 2 to the program searching unit 127 .

[0165] In step S105, the display control unit 132 causes the display 103 to display a search result screen on which card images representing Web contents are arranged, based on the search result supplied from the Web content search unit .

[0166] On the other hand, in step S121, the program search unit 127 receives the character string supplied from the character string acquisition unit 129, and outputs it to the syntax analysis unit 131 in step S122.

[0167] In step S141, the syntax analysis unit 131 receives the character string supplied from the program search unit 127, and performs syntax analysis in step S142. Based on the result of the syntax analysis, the syntax analysis unit 131 detects whether the user utters a word with a specific attribute following the word "recorded," or whether the user utters a word with a specific attribute following a word such as "reserve."

[0168] In step S143, the syntax analysis unit 131 outputs the decomposed character strings acquired as a result of the syntax analysis to the program search unit 127 together with attribute information of each decomposed character string. The syntax analysis result transmitted here includes a recording list display command if it is detected that a word with a specific attribute is uttered following the word "recorded", and also includes a recording reservation setting command if it is detected that a word with a specific attribute is uttered following the word "reserve".

[0169] In step S 123 , the program search unit 127 receives the information supplied from the syntax analysis unit 131 .

[0170] If the received information does not include a recording list display command or a recording reservation setting command, in step S124, the program search unit 127 searches for programs that are currently being broadcast or scheduled to be broadcast and recorded programs based on the resolved character string.

[0171] In step S125, the program search unit 127 outputs information about the programs in the search results to the display control unit 132 together with information specifying the application to be started when each program is selected.

[0172] On the other hand, if the received information includes a recording list display command or a recording reservation setting command, in step S126, the program search unit 127 sets the program search range according to the type of command. If the command supplied from the syntax analysis unit 131 is a recording list display command, the search range is set to recorded programs, and if it is a recording reservation setting command, the search range is set to currently airing / scheduled to air.

[0173] In step S127, the program search unit 127 searches for programs within the set search range based on the resolved character string.

[0174] In step S128, the program search unit 127 outputs information about the programs in the search results to the display control unit 132 together with information specifying the application to be started when each program is selected.

[0175] The search results output in step S125 are received by the display control unit 132 in step S106, and the search results output in step S128 are received by the display control unit 132 in step S107.

[0176] In step S108, the display control unit 132 adds and displays card images of the searched programs on the search result screen. For example, when a recording list display command is output from the syntax analysis unit 131, lines of recorded programs are added and displayed in the program area 22, and when a recording reservation setting command is output from the syntax analysis unit 131, lines of programs currently being broadcast / scheduled to be broadcast are added and displayed in the program area 22. The screen display is then switched as described with reference to FIG.

[0177] As described above, when a user performs a voice search to view a recorded program, only recorded programs are displayed as search results, allowing the user to easily select the program he or she wishes to view.

[0178] In addition, when a user performs a voice search to set up a recording reservation for a program that is currently on air or scheduled to be broadcast, only programs that are currently on air or scheduled to be broadcast are displayed as search results, allowing the user to easily select the program they wish to record. When a user selects a program they wish to record, the recording reservation is set directly without a detailed screen or the like being displayed, allowing the user to easily set up a recording reservation for the program.

[0179] <4-3. Other display examples> If a recording reservation has already been made for another program whose broadcast time overlaps with the program you selected to set a recording reservation for, a dialog box 301 informing you of this will be displayed on the search result screen, as shown in FIG. 15.

[0180] Dialog box 301 shown in FIG. 15 displays a button to be operated when choosing not to set a recording reservation for the selected program, and a button to be operated when setting a recording reservation for the selected program.

[0181] By displaying such a dialog box, even if the program details screen or reservation confirmation screen is not displayed, the user can confirm on the search result screen that a recording reservation has already been set for another program with an overlapping broadcast time.

[0182] FIG. 16 is a diagram showing another display example of the search result screen.

[0183] 16, a card image 311 that is selected when displaying a reservation list is displayed at the right end of the row of programs currently being broadcast or scheduled to be broadcast, alongside card images representing programs in the search results. When the card image 311 is selected, the reservation list is displayed on the display 103.

[0184] The reservation list is a list of programs that have been scheduled for recording. From the reservation list, it is possible to modify or cancel the recording reservation of a program.

[0185] Since the setting of a recording reservation is completed simply by selecting the card image of the program, there is a possibility that the user will often set a recording reservation by mistake. By displaying the card image for displaying the reservation list and providing a path to the reservation list on the search result screen, the user can easily correct the recording reservation setting.

[0186] FIG. 17 is a diagram showing an example of a flow of screen display.

[0187] The search result screen #21 shown in Fig. 17 is the same screen as the screen in Fig. 16. When the card image 311 is selected, as shown at the end of the arrow A21, the reservation list is displayed instead of the search result screen #21. The reservation list may be displayed superimposed on the search result screen #21.

[0188] When only recorded programs are displayed as search results, a path to the recorded programs list is provided on the search result screen #21. The recorded programs list is a list of recorded programs. The recorded programs list is displayed based on information recorded in the recorded program storage unit 122, for example.

[0189] In this case, the card image selected when displaying the recorded program list is displayed at the right end of the row of recorded programs, alongside the card images representing the programs in the search results. When the card image for displaying the recorded program list is selected, the recorded program list is displayed in place of the search result screen #21, as shown by the tip of arrow A22 in FIG.

[0190] In this way, the search result screen may be provided with links to other screens such as a reservation list or a recorded program list.

[0191] <<5. Third search example>> From the words uttered by the user, it is assumed that it is determined whether the user is trying to watch a recorded program or to set up a recording reservation for a program currently being broadcast or scheduled to be broadcast, but it is also possible to specify the program intended by the user. In this case, the information used to specify the program is managed in the linking server 2, and the program intended by the user is specified by the linking server 2.

[0192] For example, when it is determined that the user is about to view a recorded program, the linking server 2 transmits a command to the TV 1 to instruct the TV 1 to start playing the identified program. The TV 1 starts playing the recorded program identified by the linking server 2 without displaying the search result screen.

[0193] Furthermore, when it is determined that the user is attempting to set a recording reservation for a program that is currently being broadcast or is scheduled to be broadcast, the linking server 2 transmits a command to the TV 1 to instruct the TV 1 to set a recording reservation for the identified program. The TV 1 sets a recording reservation for the program identified by the linking server 2 without displaying the search result screen.

[0194] <5-1. Screen transition examples> FIG. 18 is a diagram showing another example of the flow of screen display.

[0195] Screen #31 shown on the left side of Fig. 18 is the screen of the program being viewed. For example, if the user presses the microphone button on the remote controller 4 in this state, the TV 1 goes into a state of waiting for voice input by the user, as indicated by the tip of arrow A31. The display on the display 103 switches to screen #32, which is a voice standby screen.

[0196] The voice data transmitted from the remote controller 4 is transmitted to the linking server 2, and a character string representing the contents of the user's speech is acquired. Based on the acquired character string, the linking server 2 identifies the program intended by the user and the type of processing for that program.

[0197] The program is specified, for example, by detecting the program name included in the character string expressing the content of the user's utterance. The link server 2 manages the program names of various programs.

[0198] The type of processing for a program is specified by detecting that the user utters a word with a specific attribute followed by a word such as "book a program," or by detecting that the user utters a word with a specific attribute followed by the word "recorded." In the linking server 2, syntax analysis is performed as appropriate.

[0199] When the user is unable to identify the intended program but is able to identify the type of processing for a certain program, the link server 2 transmits the recording list display command or recording reservation setting command described above to the TV 1.

[0200] In this case, the screen display is switched in the flow enclosed by the dashed line L12, as indicated by the end of the arrow A32. The screen display enclosed by the dashed line L12 in FIG. 18 is the same as the screen display enclosed by the dashed line L12 in FIG.

[0201] That is, when a user utters a word such as "reserve" after a word of a specific attribute, the search result screen displays programs currently being broadcast or scheduled to be broadcast, which are searched for based on the resolved character string. When a specific program is selected from the search results of programs currently being broadcast or scheduled to be broadcast, a recording reservation is set without displaying the program details screen, as shown at the end of arrow A12.

[0202] Also, if the user utters the word "recorded" followed by a word with a specific attribute, the search result screen displays the recorded programs searched for based on the resolved character string. When a desired program is selected from the search results of recorded programs, playback of the recorded program begins, as indicated by the tip of arrow A14.

[0203] On the other hand, when the program intended by the user and the type of processing for that program that involves setting a recording reservation are identified, as shown at the end of arrow A33, the display on display 103 switches to a reservation details confirmation screen #33.

[0204] The reservation confirmation screen #33 is a screen that presents the contents of the recording reservation of the program identified from the contents of the user's utterance. In addition to the reservation contents, the reservation confirmation screen #33 also displays a confirmation button that is operated to confirm the reservation.

[0205] When the Confirm button is operated, as indicated by the tip of arrow A34, the program recording reservation is completed, and information indicating the details is recorded in program information recording unit 125. After that, the display on display 103 returns to, for example, screen #31. When the program intended by the user and the type of processing for that program that involves setting a recording reservation are identified, the recording reservation may be set without displaying reservation details confirmation screen #33.

[0206] Furthermore, when the user's intended program and the type of processing for that program are identified as viewing a recorded program, the display on display 103 switches to program playback screen #6, as indicated by arrow A35. Data of the recorded program is read from recorded program storage unit 122 and played back by playback control unit 123.

[0207] In this way, when the program intended by the user and the type of processing for that program are identified, the display on the display 103 is switched so as to be surrounded by a dashed line L21.

[0208] This allows the user to directly start playing a recorded program or directly schedule a recording of a program using words similar to those used in a conversation, without having to operate the search result screen.

[0209] <5-2. Examples of operation of information processing system> Here, the operations of the TV 1 and the link server 2 that realize the above-mentioned screen display will be described with reference to the sequence diagram of FIG.

[0210] The process of FIG. 19 also starts when the TV 1 receives the audio data transmitted from the remote controller 4.

[0211] In step S211 , the character string acquisition unit 129 of the TV 1 transmits to the link server 2 the voice data that has been transmitted from the remote controller 4 and received by the voice data receiving unit 128 .

[0212] In step S 231 , the voice data acquisition unit 221 of the link server 2 receives the voice data transmitted from the TV 1 .

[0213] In step S232, the voice recognition unit 222 performs voice recognition based on the voice data to generate a character string representing the content of the user's utterance. The voice recognition unit 222 also performs syntax analysis of the generated character string as appropriate. The voice recognition unit 222 identifies the type of processing for the program based on the character string representing the content of the user's utterance.

[0214] In step S233, the search unit 223 identifies the program intended by the user by using a character string representing the program name obtained by syntax analysis. Here, the description is given assuming that the program intended by the user is identified. If the program cannot be identified, the same process as that described with reference to FIG. 14 is performed.

[0215] When a program currently being broadcast / scheduled to be broadcast is identified as the program intended by the user, and setting a recording reservation is identified as the type of processing for that program, in step S234, the search unit 223 transmits the program information and a recording reservation setting command to the TV 1. The program information includes identification information of the program intended by the user.

[0216] In step S201, the recording reservation management unit 126 of the TV 1 receives information transmitted from the linking server 2. Based on the information transmitted from the linking server 2, the display control unit 132 displays a reservation content confirmation screen. The units in FIG. 7 are also connected by paths (not shown) other than the paths indicated by the arrows in FIG. 7.

[0217] If it is selected to confirm the recording reservation of the program, in step S202, the recording reservation management unit 126 sets the recording reservation of the program identified by the identification information.

[0218] On the other hand, if a recorded program is identified as the program intended by the user and the type of processing for that program is identified as an attempt to view it, in step S235, the search unit 223 transmits the program information and a playback command to TV1.

[0219] In step S203, the recording reservation management unit 126 of the TV1 receives the information transmitted from the linking server 2, and in step S204, inquires of the program search unit 127 whether the program specified by the linking server 2 has been recorded. The inquiry from the recording reservation management unit 126 to the program search unit 127 includes the identification information of the program.

[0220] In step S 221 , the program search unit 127 receives an inquiry from the recording reservation management unit 126 .

[0221] In step S222, the program search unit 127 searches for the program specified by the linking server 2 among the recorded programs recorded in the recorded program recording unit 122, and in step S223 outputs the inquiry result to the recording reservation management unit 126. Here, it is assumed that the program specified by the linking server 2, i.e., the program intended by the user, has already been recorded.

[0222] In step S 205 , the recording reservation management section 126 receives the inquiry result supplied from the program search section 127 .

[0223] In step S206, the recording reservation management section 126 causes the playback control section 123 to start playing back the program specified by the link server 2, and then ends the process.

[0224] Through the above process, the user can directly start playing a recorded program or directly schedule a recording of the program without operating the search result screen.

[0225] In the above, it has been assumed that the program intended by the user and the type of processing to be performed on the program are specified by the link server 2, but they may be specified by the TV 1.

[0226] In addition, the processes that can be performed by the TV 1 through voice are described as setting a recording reservation and playing a recorded program, but other types of processes such as setting a viewing reservation, dubbing a recorded program, etc. may also be performed through voice. In addition, other types of processes such as playing and purchasing Web content may also be performed through voice.

[0227] <<6. Modifications>> In the above, the information processing system is configured by the TV 1 as an information processing device and the link server 2. However, the information processing system may be configured by the link server 2 and another device capable of receiving broadcast waves.

[0228] For example, it is possible to configure an information processing system by using a set-top box that does not have a display for displaying content, a recording device such as a hard disk recorder, or a mobile terminal such as a tablet terminal instead of the TV 1.

[0229] Also, at least some of the functions of the TV 1 described above may be installed in a device external to the TV 1. For example, it is possible to have an external server have the function of the syntax analysis unit 131 among the functions shown in Fig. 7, and have the TV 1 perform each of the above-mentioned processes by cooperating with the external server. It is also possible to have the recording unit 109 and the recording device in an external server. Furthermore, the content may not be provided by broadcast waves, but may be provided from an external server via the Internet.

[0230] Furthermore, a mobile terminal such as a smartphone capable of communicating with the TV 1 may have at least some of the functions shown in FIG. 7, and the above-mentioned processes may be performed by the TV 1 and the mobile terminal.

[0231] In addition, although the information processing system has been described as processing character strings representing what has been spoken by a user, the information processing system may also process character strings input by the user via a keyboard or touch operation, without being limited to what has been spoken by a user.

[0232] In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.

[0233] The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer incorporated in dedicated hardware or a general-purpose personal computer.

[0234] The program to be installed is provided by being recorded on removable medium 211 shown in FIG. 8, which is made up of an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or a semiconductor memory. Alternatively, the program may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be installed in advance in ROM 202 or recording unit 208.

[0235] In addition, the program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.

[0236] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

[0237] For example, the present technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.

[0238] Furthermore, each step described in the above flow chart can be executed by one device, or can be shared and executed by a plurality of devices.

[0239] Furthermore, when a single step includes multiple processes, the multiple processes included in the single step can be executed by a single device, or can be shared and executed by multiple devices.

[0240] <Examples of configuration combinations> The present technology can also be configured as follows. (1) a program search unit that, if a character string representing the content of a user's utterance does not include a first character string representing setting a recording reservation for a program to be provided after the current time, performs a search of recorded programs and programs to be provided after the current time based on the character string to obtain a first search result, and, if the character string represents the content of a user's utterance, performs a search of programs to be provided after the current time based on the character string to obtain a second search result; a display control unit that displays a display screen of the first search result or a display screen of the second search result; a setting unit which, when a predetermined program to be provided from now on is selected as a program for which a recording reservation is to be set from the display screen of the first search result, displays a details screen including information about the predetermined program instead of the display screen of the first search result, and then sets a recording reservation for the predetermined program, and, when a program for which a recording reservation is to be set is selected from the display screen of the second search result, sets a recording reservation for the selected program without displaying the details screen. An information processing device comprising: (2) The method further includes a syntax analysis unit that performs syntax analysis of the character string representing the content of a user's utterance, The program search unit obtains the first search result or the second search result by searching for a program based on a resolved character string that is a result of the syntax analysis. The information processing device according to (1). (3) a content search unit that obtains search results based on the character string from content provided via a network, The display control unit displays the first search result or the second search result in addition to the search result of the content. The information processing device according to (2). (4) The content search unit acquires a result of a search for the content performed on the basis of the character string in a server that provides the content. The information processing device according to (3). (5) when the character string does not include the first character string and includes a second character string indicating playback of a recorded program, the program search unit performs a search for recorded programs based on the character string; The display control unit displays search results for recorded programs. The information processing device according to any one of (1) to (4). (6) The display control unit displays an image to be operated when displaying a list of scheduled recordings alongside an image representing the program of the second search result. The information processing device according to any one of (1) to (5). (7) The voice data of the speech is transmitted to a server, and an acquisition unit is further provided to acquire the character string transmitted from the server. 13. The information processing device according to claim 12, wherein the information processing device is a (8) if a character string representing the content of the user's utterance does not include a predetermined character string representing setting a recording reservation for a program to be provided after the current one, a first search result is obtained by searching recorded programs and programs to be provided after the current one based on the character string; When a predetermined program to be provided from now on is selected as a program for which a recording reservation is to be set from the display screen of the first search result, a details screen including information on the predetermined program is displayed instead of the display screen of the first search result, and then a recording reservation of the predetermined program is set; If the character string representing the content of the user's utterance contains the predetermined character string, a second search result is obtained by performing a search for programs to be provided from now on based on the character string; When a program for which a recording reservation is to be set is selected from the display screen of the second search result, the detailed screen is not displayed and the recording reservation of the selected program is set. An information processing method comprising the steps of: (9) if a character string representing the content of the user's utterance does not include a predetermined character string representing setting a recording reservation for a program to be provided after the current one, a first search result is obtained by searching recorded programs and programs to be provided after the current one based on the character string; When a predetermined program to be provided from now on is selected as a program for which a recording reservation is to be set from the display screen of the first search result, a details screen including information on the predetermined program is displayed instead of the display screen of the first search result, and then a recording reservation of the predetermined program is set; If the character string representing the content of the user's utterance contains the predetermined character string, a second search result is obtained by performing a search for programs to be provided from now on based on the character string; When a program for which a recording reservation is to be set is selected from the display screen of the second search result, the detailed screen is not displayed and the recording reservation of the selected program is set. A program that causes a computer to execute a process including steps. (10) a search unit that identifies a program for which a recording reservation is to be set when a character string representing the content of a user's utterance includes a first character string representing a setting of a recording reservation for a program to be provided from now on; a communication unit that transmits, when the program to be set is specified, first identification information of the specified program and a first command for instructing to set a recording reservation to the information processing device, and, when the program to be set is not specified, transmits a search result of content based on the character string to the information processing device; A server including: a communication unit that transmits voice data of the utterance to the server and receives information transmitted from the server; a program search unit that searches for a program based on the character string transmitted from the server; a display control unit that, when the content search result is transmitted from the server, displays a display screen including the content search result and the program search result; a setting unit that, when the first identification information and the first command are transmitted from the server, sets a recording reservation for a program identified by the first identification information without displaying the display screen; The information processing device comprising: An information processing system comprising: (11) the search unit of the server, when the character string does not include the first character string but includes a second character string indicating that a recorded program is to be played, identifies a program to be played; when the program to be reproduced is specified, the communication unit of the server transmits second identification information of the specified program and a second command for instructing start of reproduction to the information processing device; The information processing device includes: and a playback control unit that, when the second identification information and the second command are transmitted from the server, starts playback of a recorded program identified by the second identification information without displaying the display screen. The information processing system according to (10) above. (12) a communication unit which, when a character string representing the contents of a user's utterance includes a predetermined character string representing setting a recording reservation for a program to be provided from now on, identifies a program for which the recording reservation is to be set, and when the program for which the reservation is to be set is identified, transmits identification information of the identified program and a command for instructing to set a recording reservation, and when the program for which the reservation is to be set is not identified, transmits audio data of the utterance to a server which transmits search results for contents based on the character string, and receives information transmitted from the server; a program search unit that searches for a program based on the character string transmitted from the server; a display control unit that, when the content search result is transmitted from the server, displays a display screen including the content search result and the program search result; a setting unit that, when the identification information and the command are transmitted from the server, sets a recording reservation for the program identified by the identification information without displaying the display screen; An information processing device comprising: [Explanation of symbols]

[0241] 1 Television receiver, 2 Linkage server, 121 Recording control unit, 122 Recorded program recording unit, 123 Playback control unit, 124 Broadcast wave reception control unit, 125 Program information recording unit, 126 Recording reservation management unit, 127 Program search unit, 128 Audio data reception unit, 129 Character string acquisition unit, 130 Web content search unit, 131 Syntax analysis unit, 132 Display control unit, 221 Audio data acquisition unit, 222 Audio recognition unit, 223 Search unit

Claims

1. A circuit for obtaining a first search result by performing a search for programs including content provided via a network and recorded programs or programs to be provided after the current time based on the character string when a character string representing the content of a user's utterance does not include a first character string indicating that a search is to be performed for programs to be provided after the current time based on the character string, and for obtaining a second search result by performing a search for programs to be provided after the current time based on the character string when the first character string is included; The circuit controls to display the first search result or the second search result. Information processing device.

2. The circuit comprises: When a program to be provided from now on is selected from the first search result as a program for which a recording reservation is to be set, control is performed so as to display a details screen including information on the selected program, and a recording reservation for the selected program is set; When a program for which a recording reservation is to be set is selected from the second search result, the detailed screen is not displayed and the recording reservation of the selected program is set. The information processing device according to claim 1 .

3. The circuit comprises: When a program for which a recording reservation is to be set is selected, a display screen showing the details of the recording reservation of the selected program is displayed. The information processing device according to claim 1 .

4. The circuit comprises: parsing the string representing the content of a user utterance; A program search is performed based on the resolved character string resulting from the syntax analysis, thereby obtaining the first search result or the second search result. The information processing device according to claim 1 .

5. The circuit comprises: The result of a search for the content performed based on the character string in the server that provides the content is obtained. The information processing device according to claim 1 .

6. The circuit comprises: if the character string includes a third character string that indicates playback of a recorded program, performing a search for recorded programs based on the character string; Displaying search results for recorded programs The information processing device according to claim 1 .

7. The circuit comprises: if the character string includes a third character string that indicates playback of a recorded program, performing a search for recorded programs based on the character string; If a recorded program is selected for playback, the selected program will be played. The information processing device according to claim 1 .

8. The circuit comprises: if the character string includes a second character string indicating that a search is to be performed for recorded programs, a search is performed for recorded programs based on the character string; Controlling search results to show recorded programs The information processing device according to claim 1 .

9. The circuit comprises: An image to be operated when displaying a list of scheduled recordings is displayed alongside an image representing the program in the second search result. The information processing device according to claim 1 .

10. The circuit comprises: Transmitting the voice data of the utterance to a server, and acquiring the character string transmitted from the server. The information processing device according to claim 1 .

11. More displays The information processing device according to claim 1 .

12. If a character string representing the content of a user's utterance does not include a first character string indicating that a search is to be performed for programs to be provided from now on, a first search result is obtained by performing a search for programs including content provided via a network and recorded programs or programs to be provided from now on, based on the first character string; If the first character string is included, a search is performed based on the character string to obtain a second search result for programs to be provided from now onward; Controlling to display the first search result or the second search result Information processing methods.

13. When a program to be provided from now on is selected from the first search result as a program for which a recording reservation is to be set, control is performed so as to display a details screen including information on the selected program, and a recording reservation for the selected program is set; When a program for which a recording reservation is to be set is selected from the second search result, the detailed screen is not displayed and the recording reservation of the selected program is set. The information processing method according to claim 12.

14. When a program for which a recording reservation is to be set is selected, a display screen showing the details of the recording reservation of the selected program is displayed. The information processing method according to claim 12.

15. If a character string representing the content of a user's utterance does not include a first character string indicating that a search is to be performed for programs to be provided from now on, a first search result is obtained by performing a search for programs including content provided via a network and recorded programs or programs to be provided from now on, based on the first character string; If the first character string is included, a search is performed based on the character string to obtain a second search result for programs to be provided from now onward; Controlling to display the first search result or the second search result A program that causes a computer to execute a process including steps.

Citation Information

Patent Citations

  • Method and device for video recording and reproduction processing, and video recording and reproduction processing system

    JP2001094912A

  • Retrieval device, retrieval method, and program

    JP2011118775A

  • Method, electronic device, and program

    JP2015038710A

  • Electronic apparatus and control method thereof

    JP2016062560A