Receiving device and control method

Abstract

To provide a reception device provided with retrieval processing for retrieving a channel or content on the basis of words and phrases recognized from user's utterance voice, and its control method.SOLUTION: An information processing device 100 being a television device for receiving content data distributed from a content distribution server communicatively connected through the Internet includes a selection control part 164 for selecting one channel or content among a plurality of channels or content acquired in retrieval processing, and a display control part 166 for performing processing for displaying the selected content or content broadcasted by the selected channel in a display part, and processing for displaying each item image showing the plurality of channels or content acquired in the retrieval processing as a choice in the display part.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a receiving device and a control method. [Background technology]

[0002] Conventionally, speech recognition has been used as a technology to assist users in inputting information into information devices. For example, the following Patent Document 1 discloses a technology for a display control device that recognizes the content of speech uttered by a user, identifies a voice command, and executes processing. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-95002 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, when there are multiple options for the user's speech that has been recognized, it has been difficult to determine which option definitely corresponds to the user's desire.

[0005] In the above-mentioned Patent Document 1, a focus option is identified from multiple options in response to voice input according to predetermined criteria, and the other options are identified as alternative options, and the focus option is displayed larger than the other options to indicate that it has been selected.

[0006] However, in Patent Document 1, when executing the option, it is necessary to again input a voice phrase such as "start," and the steps from selection to execution can be cumbersome. [Means for solving the problem]

[0007] According to the present disclosure, a receiving device is proposed that includes a control unit that performs the following processes: a search process for searching for channels or content based on words recognized from a user's speech; a process for selecting one channel or content from multiple channels or content obtained by the search process; a process for displaying the selected content or content being broadcast on the selected channel on a display unit; and a process for displaying, on the display unit, each item image indicating the multiple channels or content obtained by the search process as an option.

[0008] According to the present disclosure, a control method is proposed, which includes a processor searching for channels or content based on words recognized from a user's speech, selecting one channel or content from multiple channels or contents obtained by the search, displaying the selected content or content broadcast on the selected channel on a display unit, and further displaying, as options, item images representing the multiple channels or contents obtained by the search on the display unit. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is an explanatory diagram illustrating an overview of an information processing device according to an embodiment of the present disclosure. [Figure 2] FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment of the present invention. [Figure 3] 3 is a block diagram showing an example of a configuration of logical functions realized by a memory and a processor of the information processing device shown in FIG. 2. FIG. [Figure 4] 10 is a flowchart showing an example of the flow of operation processing of the information processing device when a channel name is input by voice according to the first example of this embodiment. [Figure 5] FIG. 10 is a diagram showing a display example of a UI image when voice input is performed according to the first example of this embodiment. [Figure 6]FIG. 10 is a diagram illustrating a case where currently airing programs and recorded programs are simultaneously displayed as search results according to a second example of this embodiment. [Figure 7] FIG. 11 is a diagram illustrating a display example when a voice input related to the current program is made according to the third example of this embodiment. [Figure 8] FIG. 13 is a diagram illustrating a display example when the title of a content having a sequence, such as a drama, is input by voice according to a sixth example of this embodiment. [Figure 9] 13 is a flowchart showing an example of the flow of operational processing when a voice input specifying an external input is made according to a seventh example of the present embodiment. [Figure 10] FIG. 13 is a diagram showing an example of a screen displaying search results when a voice input specifying an external input is made according to the seventh example of this embodiment. [Figure 11] FIG. 13 is a diagram showing an example of a screen displaying search results when voice input is made for starting an application or the like according to an eighth example of this embodiment. [Figure 12] 13 is a flowchart showing an example of the flow of operation processing for recording reservation or viewing reservation when the power is turned off according to the ninth example of the present embodiment. [Figure 13] 13 is a flowchart showing an example of the flow of an operational process for deleting content when the power is turned off according to the ninth example of this embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0011] The explanation will be given in the following order: 1. Overview 2.Configuration example 2-1. Hardware configuration example 2-2. Functional configuration example 3. Examples 3-1. First Example: Voice Input "Channel Name" 3-2. Second Example: Simultaneous display of currently broadcasting programs and recorded programs 3-3. Third Example: Voice Input "Current Program" 3-4. Fourth Example: Voice Input "Genre" 3-5. Fifth Example: Voice input for asking about recommended content, etc. 3-6. Sixth Example: Display of Content with Order 3-7. Seventh Example: Voice input specifying external input (Example of audio input "HDMI") 3-8. Eighth Example: Voice input for application launch, etc. 3-9. Ninth Example: "Recording / viewing reservation, content deletion" after power off 3-10. Supplementary Information 4. Summary

[0012] <<1. Overview>> In this section, an overview of an information processing device to which the technology according to the present disclosure can be applied will be described using FIG. 1. FIG. 1 is an explanatory diagram for describing an overview of an information processing device 100 according to an embodiment of the present disclosure. Referring to FIG. 1, the information processing device 100 is a receiving device that receives broadcast signals broadcast from radio towers 200 by various broadcast stations and content data distributed from the Internet 220 (specifically, a content distribution server connected for communication via the Internet), and is a so-called television device that includes a display 108. Note that the information processing device 100 (receiving device) is not limited to a television device, and may be an external device such as a smartphone, a projector, a car navigation system, a recorder connected to a television device and having a recording and playback function, or a player having a playback function.

[0013] In the following, an example in which the information processing device 100 is a television device will be described.

[0014] The information processing device 100 includes a microphone 102 and a display 108. The microphone 102 collects sounds emitted by the user. The display 108 displays images generated by the information processing device 100. The images displayed by the display 108 may include user interface (UI) images in addition to content images.

[0015] In the example of FIG. 1, user U utters the phrase "NNN," which is the name of a channel. The information processing device 100 recognizes the user's speech, searches for channels based on the phrase "NNN," and controls switching to a channel selected from the search results, such as "NNN General." The display 108 displays a video of a program currently broadcast on "NNN General." When multiple search results are returned, the selection of a candidate may be determined based on a predetermined priority. For example, when user U voice-inputs "Show me 'NNN' (channel name)," if there are multiple "NNN" channels, such as "NNN General," "NNN First," "NNN AA," and "NNN Premiere," the information processing device 100 selects the channel that user U is most likely to watch based on a predetermined priority and automatically switches the display screen, thereby responding to user U's request as much as possible even when there are multiple selection candidates. The channel name is not limited to "NNN" and may include any name that can identify the channel, including the official name or abbreviation of each broadcasting station.

[0016] For example, when the information processing device 100 can identify the viewing user by user information such as voice recognition, face recognition (image recognition), account information, etc., it may calculate the priority of each search result based on the user's preference information and viewing history, and select the channel with the highest priority.

[0017] Furthermore, after automatically selecting a channel from the search results and switching the channel, the information processing device 100 displays on the screen item images 30 (30a-30d) indicating the names of each channel (selection item) based on the search results. There is no problem if the channel automatically selected by the information processing device 100 matches the user's expectations. However, if the channel is different from the channel the user requested, it is expected that the user will immediately select a different channel. Therefore, the information processing device 100 according to this embodiment displays item images 30a-30d indicating the search results (e.g., the names of each searched channel) in order of priority, enabling support for voice input when the user changes channels. For example, the item images 30a-30d may be displayed for a certain period of time (e.g., several seconds), and after a timeout, the display may disappear without any operation. The user can refer to the read-out items displayed in the item images 30, re-voice input a more accurate name, and switch to the desired channel (e.g., other selection candidates such as "NNN 1st" or "NNN AA" rather than the automatically selected "NNN General").

[0018] Additionally, the information processing device 100 may display, on the display 108, an image (not shown in FIG. 1) that prompts the user to input when selecting another channel, along with the item images 30 (30a to 30d). The image prompting the user to input may, for example, prompt the user to input a cursor using a remote controller or a smartphone, or may prompt the user to input voice using something like a microphone icon. Also, an explanatory text such as "If you want to watch another channel, please speak that item again" may be displayed. Furthermore, by matching the "that item" portion of the explanatory text with the display mode of the read-out item displayed in the item image 30, it becomes possible for the user to intuitively know which item to read out.

[0019] The information processing device 100 records the channels selected by the user as viewing history and preference information together with user information and time information, thereby enabling further improvement in the accuracy of automatic channel selection.

[0020] In the example of Figure 1, it has been explained that a channel search (i.e., a program search) is performed when a channel name is input by voice, but the present disclosure is not limited to this, and content searches for broadcast programs, recorded programs, internet-distributed programs, applications, etc. can be performed when an abstract voice input such as "Show me recommendations" is made in addition to a voice input specifying a program name or genre, an application name, or an external input device name.

[0021] As described above, the information processing device 100 according to the present disclosure searches for content in response to a user's voice input, and when multiple pieces of content are found, automatically selects the content that is most likely to be requested by the user according to predetermined criteria and displays it on the display 108, along with displaying an item image indicating the search result. Note that the item image indicating the search result may be, for example, an item image that displays information consisting only of text on a content image as an overlay.

[0022] This saves the user time by automatically selecting and displaying (i.e., executing) content when there are multiple selection candidates when voice input is performed, and by displaying search results as selection candidate items, voice input is supported when the user selects other candidates, making it possible to meet the user's requests as much as possible. Furthermore, as a UI image to support voice input, an image prompting voice input of a readout item may also be displayed, making it possible to avoid difficult-to-recognize or ambiguous reading.

[0023] Furthermore, when the information processing device 100 recognizes a voice input of a user's request (content search) in a standby state in which at least the microphone 102 can detect voice (i.e., power is being supplied to the processor 112 and the microphone 102) and the display 108 is off (i.e., power is not being supplied to the display 108), the information processing device 100 may automatically turn on the power of the information processing device 100 (turn on at least the display 108). The voice input of the user's request may be recognized by recognizing a predetermined call, such as an agent name, followed by a subsequent phrase (search word, e.g., channel name, program name, genre specification, etc.). The information processing device 100 then performs a content search based on the voice-recognized phrase. If multiple candidates are found, the information processing device 100 displays content selected according to predetermined criteria on the display 108, and also displays an item image indicating the search result on the display 108. In this way, the information processing device 100 can be automatically powered on by a voice input of a content search.

[0024] In this embodiment, as an example, voice recognition processing is performed by the information processing device 100, but the present disclosure is not limited to this, and voice recognition processing may also be performed by an external device connected to the information processing device 100 (a local terminal such as a smart speaker, smartphone, tablet terminal, or PC, or a server on the Internet, etc.).

[0025] Furthermore, in the present embodiment, as an example, the microphone 102 is provided in the information processing device 100. However, the present disclosure is not limited to this. The microphone 102 may be provided in an external device (an audio terminal such as a smart speaker or a mobile terminal such as a smartphone) or a remote controller connected to the information processing device 100. The external device, such as an audio terminal, may detect a user's voice, further perform voice recognition processing, and control the automatic power-on of the information processing device 100. Alternatively, the external device, such as an audio terminal, may transmit the detected user's voice to a server on a network, cause the server to perform voice recognition processing, and control the automatic power-on of the information processing device 100 based on the recognition result. Alternatively, an input device, such as a remote controller, may receive voice input, transmit the received user utterance information to the information processing device 100, and the information processing device 100 may perform voice recognition processing or transmit information to a server. The information processing device 100 may perform a content search based on the voice recognition result. If multiple candidates are found, the information processing device 100 displays content selected according to predetermined criteria on the display 108. Item images indicating the search results may also be displayed on the display 108. The process of starting voice reception and voice recognition may be started using a button or icon arranged on a device such as a remote controller or a smartphone.

[0026] <<2. Configuration Example>> <2-1. Hardware configuration example> 2 is a block diagram showing an example of the hardware configuration of the information processing device 100. Referring to Fig. 2, the information processing device 100 includes a camera 101, a microphone 102, an input device 103, a communication interface (I / F) 104, a memory 105, a tuner 106, a decoder 107, a display 108, a speaker 109, a remote control I / F 110, a bus 111, and a processor 112.

[0027] (1) Camera The camera 101 has an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) and captures an image. The images (frames constituting a moving image) captured by the camera 101 are treated as input images for processing by the information processing device 100.

[0028] (2) Microphone The microphone 102 collects a voice uttered by a user and generates a voice signal. The voice signal generated by the microphone 102 is treated as an input voice for voice recognition by the information processing device 100.

[0029] (3) Input devices The input device 103 is a device used by a user to directly operate the information processing device 100. The input device 103 may include, for example, buttons, switches, dials, and the like arranged on the housing of the information processing device 100. When the input device 103 detects a user input, it generates an input signal corresponding to the detected user input.

[0030] (4) Communication interface The communication I / F 104 mediates communication between the information processing device 100 and other devices (external devices). The communication I / F 104 supports any wireless communication protocol or wired communication protocol and establishes a communication connection with other devices.

[0031] The communication I / F 104 may be, for example, a connection port such as a USB (Universal Serial Bus) terminal, an optical audio terminal, or an HDMI (High-Definition Multimedia Interface) (registered trademark) terminal.

[0032] The communication I / F 104 may also be configured with a communication device for connecting to a network. For example, the communication I / F 104 may be a communication card for a wired or wireless local area network (LAN), Bluetooth (registered trademark), Wi-Fi (registered trademark), or wireless USB (WUSB). The communication I / F 104 may also be a router for optical communication, a router for asymmetric digital subscriber line (ADSL), or a modem for various types of communication. The communication I / F 104 transmits and receives signals between the Internet and other communication devices using a predetermined protocol such as TCP / IP. The network connected to the communication I / F 104 is a wired or wireless network, such as the Internet or a home LAN.

[0033] Furthermore, the communication I / F 104 can receive a content signal from an external device (for example, an Internet distribution server), extract content data from the content signal, and generate a content image based on the content data.

[0034] (5) Memory The memory 105 is configured with a storage medium such as a semiconductor memory or a hard disk, and stores programs and data for processing by the information processing device 100, as well as content data. The data stored in the memory 105 may include, for example, feature data for image recognition and voice recognition, which will be described later. Note that some or all of the programs and data described in this specification may be obtained from an external data source (for example, a data server, network storage, or external memory) without being stored in the memory 105.

[0035] (6) Tuner The tuner 106 extracts and demodulates a content signal of a desired channel from a broadcast signal received via an antenna (not shown), and outputs the demodulated content signal to the decoder 107.

[0036] (7) Decoder The decoder 107 decodes content data from a content signal input from the tuner 106. The decoder 107 may decode content data from a content signal received via the communication I / F 104. A content image can be generated based on the content data decoded by the decoder 107.

[0037] (8) Display Display 108 has a screen configured by an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), a CRT (Cathode Ray Tube), or the like, and displays images generated by information processing device 100. For example, the content image and UI image (item image 30, etc.) described with reference to FIG. 1 may be displayed on the screen of display 108.

[0038] (9) Speaker The speaker 109 has circuit elements such as a diaphragm and an amplifier, and outputs sound based on an output sound signal generated by the information processing device 100. The volume of the speaker 109 is changeable.

[0039] (10) Remote control interface The remote control I / F 110 is an interface that receives a remote control signal (an infrared signal or other wireless signal) transmitted from a remote controller used by a user. When the remote control I / F 110 detects the remote control signal, it generates an input signal corresponding to the detected remote control signal.

[0040] (11) Bus The bus 111 interconnects the camera 101, microphone 102, input device 103, communication I / F 104, memory 105, tuner 106, decoder 107, display 108, speaker 109, remote control I / F 110, and processor 112.

[0041] (12) Processor The processor 112 may be, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal Processor), etc. The processor 112 executes programs stored in the memory 105 or other storage media to operate various functions of the information processing device 100, which will be described later.

[0042] The hardware configuration of the information processing device 100 according to this embodiment has been described above. Note that the hardware configuration shown in Fig. 2 is an example, and the present disclosure is not limited to this. For example, the information processing device 100 may not have the camera 101, and an external device such as a smartphone may be used instead of a remote controller.

[0043] <2-2. Example of functional configuration> FIG. 3 is a block diagram showing an example of a configuration of logical functions realized by the memory 105 and the processor 112 of the information processing device 100 shown in FIG. 2. This block diagram shows an example of a configuration of logical functions. Referring to FIG. 3, the information processing device 100 includes a speech acquisition unit 120, a speech recognition unit 130, an application unit 150, a feature database (DB) 140, and a control unit 160. The control unit 160 includes a search control unit 162, a selection control unit 164, and a display control unit 166. Note that some of the functional blocks shown in FIG. 3 may be implemented in a device external to the information processing device 100 (e.g., in a cloud computing environment). For example, instead of executing the control process described below by itself, the control unit 160 may cause an external control function to execute the process. Similarly, instead of executing the speech recognition process described below by itself, the speech recognition unit 130 may cause an external speech recognition function to execute the process.

[0044] (1) Voice acquisition unit The voice acquisition unit 120 acquires, as input voice, a voice signal generated by the microphone 102. Then, the voice acquisition unit 120 outputs the acquired input voice to the voice recognition unit .

[0045] (2) Voice recognition unit The speech recognition unit 130 recognizes the user's speech based on the input speech input from the speech acquisition unit 120. The speech recognition unit 130 converts the input speech into text indicating its content, and outputs the text to the control unit 160 or the application unit 150.

[0046] Furthermore, the speech recognition unit 130 may identify a speaker (user) by using speech feature data stored in the feature DB 140 in recognizing the input speech input from the speech acquisition unit 120. The speech recognition unit 130 outputs the speaker identification result to the control unit 160 and the application unit 150.

[0047] (3) Feature database The feature DB 140 stores in advance voice feature data to be used for voice recognition by the voice recognition unit 130. The voice feature data may include, for example, voice feature amounts that indicate the characteristics of the speech of each user.

[0048] Furthermore, the feature DB 140 may store image feature data used by the application unit 150 for image recognition. The image feature data may include, for example, known image feature amounts of a predetermined part of the user's hand or face. The image feature data may also include facial image data for each user. The feature DB may also be referenced or acquired from an external device such as an external server, or may include feature data of other people.

[0049] (4) Application section The application unit 150 executes various application functions of the information processing device 100. For example, a program playback function, an electronic program guide (EPG) display function, a recording setting function, an external input switching function, a photo playback function, a video playback function, a music playback function, an internet browsing function, etc. may be executed by the application unit 150. The application unit 150 outputs application images and sounds (which may include content images) generated through the application functions to the control unit 160.

[0050] At least some of the application functions executed by the application unit 150 cooperate with the voice recognition unit 130 to accept voice input from the user. For example, the program playback function may change settings such as the channel and volume of a television program or an internet-distributed program, or play back a recorded program, according to the voice content recognized by the voice recognition unit 130. The electronic program guide display function may change the channel and time period of the electronic program guide to be displayed according to the voice content recognized by the voice recognition unit 130. The recording setting function may set the recording date and time and channel according to the voice content recognized by the voice recognition unit 130. Data of the recorded programs may be stored in the memory 105 of the information processing device 100.

[0051] The external input switching function can switch external inputs according to the voice content recognized by the voice recognition unit 130. The photo playback function can play back photos taken on a specified date recognized by the voice recognition unit 130. The internet browsing function can perform internet searches using keywords recognized by the voice recognition unit 130.

[0052] Furthermore, an image captured by the camera 101 may be input to the application unit 150. The application unit 150 may recognize the input image. In image recognition, for example, image features extracted from the input image are compared with image features of a predetermined part of the user's body that are pre-stored in the feature DB 140, thereby recognizing the predetermined part. The predetermined part may include, for example, at least one of the user's hands and face. In this way, the application unit 150 identifies the user through facial recognition, for example. Furthermore, the application unit 150 may recognize a predetermined gesture from hand movements. That is, at least a part of the application functions executed by the application unit 150 receives gesture input from the user.

[0053] (5) Search control section The search control unit 162 controls the process in which at least a part of the application functions executed by the application unit 150 accepts voice input from the user in cooperation with the voice recognition unit 130 and searches for content desired by the user. For example, in the program playback function, when accepting voice input from the user to display a program, the search control unit 162 searches for a channel (channel number or channel name), a program name currently being broadcast or distributed over the Internet, a recorded program, an application, etc., corresponding to a name that includes (partially matches) at least a phrase (search word) recognized by the voice recognition unit 130. The recorded program may be stored in the memory 105 or may be stored in an external device such as a recorder connected via the communication I / F 104.

[0054] In addition, in the external input switching function, when voice input from the user is received to switch external devices, the search control unit 162 searches for external input devices corresponding to names that at least include (partially match) the phrase (search word) recognized by the voice recognition unit 130.

[0055] (6) Selection control section The selection control unit 164 controls the selection of one piece of content to be executed from the search results of the search control unit 162. If there is one search result, the selection control unit 164 selects that content, but if there are multiple search results, the selection control unit 164 selects one piece of content according to a predetermined criterion in order to select the content that is most likely to be requested by the user.

[0056] The predetermined criteria are, for example, priorities calculated based on a person (specifically, a viewing user) or time (specifically, a viewing time). The selection control unit 164 can calculate the priorities of the searched content according to at least either the viewing user or the current time, by referring to, for example, the viewing history information acquired from the viewing history DB 172 or the user preference information acquired from the preference DB 174. The viewing user can be identified by voice recognition, image recognition (face recognition), or by referring to user information.

[0057] More specifically, for example, the selection control unit 164 increases the priority of channels / programs / genres that the viewing user frequently views (for example, channels / programs / genres that have been viewed frequently in a recent predetermined period) or increases the priority of programs, genres, etc. that the viewing user frequently records, based on the viewing history or preference information of the viewing user identified by voice recognition, etc. Genres are classifications according to the content, and examples include news, music, dramas, movies, variety shows, etc.

[0058] Also, for example, the selection control unit 164 increases the priority of channels / programs / genres that the viewing user often watches at the current time, programs / genres that the viewing user often records, and the like.

[0059] Furthermore, for example, the selection control unit 164 may obtain information on the viewing user's favorite entertainers, singers, characters, etc. from the preference information, and may give a higher priority to content in which these appear in the search results.

[0060] Furthermore, the selection control unit 164 may calculate the priority according to the combination and number of viewing users. For example, based on the viewing history, the selection control unit 164 may identify channels / programs / genres that are often viewed by parents alone, channels / programs / genres that are often viewed by children alone, channels / programs / genres that are often viewed by the whole family, and the like, and calculate the priority as appropriate.

[0061] Furthermore, even if the selection control unit 164 cannot acquire the identification information of the viewing user, it may increase the priority of, for example, channels / programs / genres that are frequently viewed in the current time period, programs / genres that are frequently recorded, etc. Furthermore, the priority may be determined by combining the viewing history information or preference information of the viewing user himself / herself with the viewing history information or preference information of others, or the priority may be determined solely from the viewing history information or preference information of others. Specifically, for example, among the search results, those determined to satisfy a predetermined standard based on the viewing history information of users throughout Japan may be further prioritized based on the viewing history information or preference information of the viewing user himself / herself.

[0062] Furthermore, the selection control unit 164 may assign a higher priority to, for example, the most recently selected channel, program, or genre based only on the viewing history, regardless of the person or time.

[0063] Furthermore, when the search results include recorded programs, the selection control unit 164 may assign a higher priority to unviewed programs than to viewed programs.

[0064] (7) Viewing history database The viewing history DB 172 stores the viewing history of content (broadcast programs, recorded programs, internet-distributed programs, applications, etc.). The viewing history may include the time when the content was viewed, the number of times an application was used, information about the viewing user, the user's search history and selection history for search results, etc. The viewing history DB 172 may also store recording reservation information. The viewing history DB 172 may be constructed within the information processing device 100, or may be referenced or acquired from one on an external device such as an external server. The viewing history DB 172 may also include information other than that of the user of the information processing device 100.

[0065] (8) Preference database The preference DB 174 stores user preference information. The preference information may be acquired from responses obtained by conducting a questionnaire or the like in advance with the user, or may be acquired from the user's viewing history, program search history, recording reservation information, or the like. For example, the information processing device 100 or an external device may determine the user's preference information by voice recognition or image recognition using a camera. Furthermore, the preference information DB 174 may be constructed within the information processing device 100, or may be referenced or acquired from information on an external device such as an external server. Furthermore, the preference information DB 174 may include information other than that of the user of the information processing device 100.

[0066] (9) Display control unit The display control unit 166 controls the display of images via the display 108. For example, the display control unit 166 causes the display 108 to display an application image input from the application unit 150. Furthermore, when search control unit 162 performs search control and selection control unit 164 performs selection control, the display control unit 166 generates an output image according to the search result and the selection result, and causes the display 108 to display the output image.

[0067] Specifically, for example, when a program playback application is started in the application unit 150, and the search control unit 162 controls a content search and the selection control unit 164 controls the selection of content to be played (executed) from the search results in response to a voice input by the user, the display control unit 166 controls the display of the selected content on the display 108 (i.e., executes the selected content). The display control unit 166 also generates an item image indicating the search results (the name of the content may be displayed as a read-out item) and displays it on the display 108. The item image may be configured to automatically disappear if there is no input from the user for a certain period of time after being displayed, or the display time may be determined based on user settings, information in the preference information DB, or the like. The item image indicating the name of content automatically selected from the search results may be highlighted, or the content selected by the selection control unit 164 may not be displayed in the item image. The display control unit 166 may also display an image prompting input when switching content.

[0068] (10) Control unit The control unit 160 controls the search control unit 162, the selection control unit 164, and the display control unit 166, as well as the entire information processing device 100. For example, the control unit 160 according to this embodiment controls the information processing device 100 to continue accepting voice input from the user in a standby state in which at least voice detection by the microphone 102 and voice recognition by the voice recognition unit 130 are ON. When the content of the voice input by the user is related to a program playback function (for example, the content of the voice input is "XX [a predetermined call such as a system name], with 'NNN (channel name)' attached"), the control unit 160 turns ON the power of the entire information processing device 100, including the display 108. The control unit 160 then starts a program playback application using the application unit 150, and controls the display 108 to display an image of a content selected by the selection control unit 164 from one or more pieces of content searched for by the search control unit 162 based on the voice input. At this time, as described above, the control unit 160 can also perform control to superimpose item images showing the names of each searched content and images prompting input when switching to other content on the content image.

[0069] In this way, even when the power of the information processing device 100 is turned off, the information processing device 100 can accept voice input from the user, and when voice input requesting content playback is detected, the information processing device 100 can turn on the power and display the content requested by the user.

[0070] As described above, voice input can also be received by an audio device (e.g., a smart speaker) connected to the information processing device 100. The audio device may transmit the detected user voice to a voice recognition server on the cloud. In this case, the information processing device 100 is automatically powered on by a control signal transmitted from the audio device or the server on the cloud, and displays content requested by the user based on the voice recognition result.

[0071] The functional configuration of the information processing device 100 according to this embodiment has been specifically described above. Note that the functional configuration of the information processing device 100 shown in FIG. 3 is an example, and this embodiment is not limited to this. For example, at least a part of the functional configuration of the information processing device 100 shown in FIG. 3 may be in an external device (a local terminal or a server on the cloud) that is communicatively connected to the information processing device 100. Furthermore, the information processing device 100 in a standby state may be automatically powered on by operating any button arranged on a remote controller or the like, or may be configured without a function to automatically power on based on voice recognition.

[0072] <<3. Examples>> Next, several examples of voice input that can be performed in the information processing device 100 according to this embodiment will be specifically described with reference to FIGS.

[0073] <3-1. First Example: Voice Input "Channel Name"> First, as a first embodiment, a case where a channel name is input by voice as an example of voice input by a user requesting content playback will be described.

[0074] FIG. 4 is a flowchart showing an example of the flow of operation processing of the information processing device 100 when a channel name is input by voice according to the first embodiment.

[0075] 4, first, when the information processing device 100 detects a user's speech (for example, "XX [a predetermined call such as a system name], with 'NNN (channel name)' attached) via the microphone 102, the information processing device 100 performs speech recognition via the speech recognition unit 130 (step S103). Here, it is assumed that the power state of the information processing device 100 is a standby state in which the display 108 is turned off but speech input can be accepted.

[0076] Next, the control unit 160 of the information processing device 100 turns on the power of the information processing device 100 (step S106). This lights up the display 108. Note that if the power of the information processing device 100 is already on and the display 108 is already on, the process of step S106 is skipped.

[0077] Next, the search control unit 162 searches for a channel corresponding to the voice-input channel name based on the voice recognition result (step S109).

[0078] Next, if the search control unit 162 finds multiple channels, the selection control unit 164 selects one channel based on the priority (step S112). For example, the selection control unit 164 may select a channel that is frequently viewed during the current time period, based on the current time and viewing history, by assigning a higher priority to the channel. The selection control unit 164 may also identify the speaker (i.e., the viewing user) using voice recognition and calculate the priority of each searched channel based on the viewing history and preference information of the viewing user. The priority may also be calculated based on the selection history of past users or selection data by other users using similar functions. In this way, content is selected according to priorities based on people and time, making it possible to automatically select content that is likely to be requested by the user. The priority may also be determined taking into account settings made by the user for channels and content. Specifically, for example, the user may specify the priority of channels and content themselves, or a process may be performed in which a higher priority is assigned to programs included in a viewing schedule, content added to favorites, or programs scheduled for recording.

[0079] Next, the display control unit 166 performs control (channel selection) to display on the display 108 the video of the program currently being broadcast on the channel selected by the selection control unit 164 (step S115).

[0080] Next, the display control unit 166 generates an item image showing the search result and controls to display it on the display 108 (step S118). In step S118, an image that prompts voice input or remote controller operation to switch channels may be generated and controlled to be displayed on the display 108. Here, Fig. 5 shows an example of a UI image displayed when voice input is performed according to this embodiment.

[0081] As shown in the upper part of FIG. 5, for example, when a user is watching some content (assuming the information processing device 100 is powered on), if the user utters, "XX (a predetermined call such as an agent's name), show me 'NNN (channel name)'," the search control unit 162 searches for a channel corresponding to "NNN." It is also possible that there are multiple channels that include the term "NNN" in their names, such as "NNN General," "NNN 1," "NNN AA," and "NNN Premiere" (which may include terrestrial broadcasting, satellite broadcasting, cable television (wired broadcasting), and Internet-distributed content). In this case, the selection control unit 164 selects the channel that is most likely to be requested by the user from the multiple channels (selection candidates) according to priorities based on the user's viewing history, etc. Furthermore, the user's speech may be accepted by operating a button on a remote controller without a predetermined call, or by operating a mobile terminal such as a smartphone. Furthermore, the voice acceptance may be performed on the remote controller or smartphone, or on the information processing device 100.

[0082] Then, the display control unit 166 performs control to switch the display screen of the display 108 to the selected channel, as shown in the lower part of Fig. 5. Furthermore, the display control unit 166 displays, for example, a fixed time, an item image 30 (30a to 30e) indicating the search result on the switched screen. This makes it possible to support voice input when the user changes the channel again if the automatically selected channel does not match the user's request. Here, the item image 30 may continue to be displayed until some kind of instruction is given by the user, or the display time may not be fixed but may change dynamically based on the user's state.

[0083] Specifically, as shown in the lower part of FIG. 5, the display control unit 166 displays, on the display 108, item images 30 (30a to 30e) indicating each channel in the search results and an image 33 prompting the user to input voice when changing channels. The display control unit 166 may display the item images 30a to 30e in order of priority from left to right or from top to bottom, or may display them randomly across the entire screen of the display 108. Instead of the image 33 prompting the user to input voice, an image prompting the user to input voice via a button on a remote controller or smartphone, a touch panel, or a user gesture may be displayed instead, or nothing may be displayed. The item image 30 may display the channel name as a read-out item in a predetermined display format, and may also display information related to the channel or broadcast program, such as the title information of the program currently broadcasting on that channel, the channel number, a channel mark, and an electronic program guide (EPG). The item image 30 may also display a broadcast status indicating how far the currently broadcast program has progressed relative to its total broadcast time. Furthermore, the display control unit 166 may highlight the item image 30a indicating the currently selected channel among the item images in a manner different from the other item images, or may display an icon such as "selected" to clearly indicate that the channel is currently selected.

[0084] A "read-aloud item" is a phrase recommended for reading aloud, which makes it possible to avoid reading that is difficult to recognize or ambiguous. In this embodiment, the read-aloud item is the channel name of the item image 30. However, the read-aloud item may be any text information displayed in the item image 30 (including text information displayed as image data). The display style of the read-aloud item in the item image 30 may be made different from that of other text, or an illustration of a speaker, mouth, or person speaking may be added to make it easier for the user to recognize the read-aloud item. Furthermore, as shown in FIG. 5, the display style of the read-aloud item 301 may be made to correspond to the display style of the demonstrative portion 331 in the text explaining the read-aloud item in the image 33 prompting voice input (for example, by using the same text color, background color, or font). This makes it even easier for the user to recognize the read-aloud item.

[0085] Alternatively, image 33 that prompts voice input may display an explanatory text such as "Please read out the item in XX color (display color of the read-out item)." Also, image 33 that prompts voice input may display image 332 such as an illustration of a microphone, an illustration of a mouth, or an illustration of a person speaking, in order to prompt voice input more intuitively.

[0086] Next, if the name of another channel is uttered (step S121 / Yes), the information processing device 100 causes the selection control unit 164 to select the channel with the uttered name, and causes the display control unit 166 to control the display 108 to display the video of the selected channel (step S115). In this case, too, the item image showing the search result may be displayed again (step S118).

[0087] The display of the UI images supporting voice input, such as the item images and images prompting voice input described above, may be continued for a certain period of time (e.g., several seconds). In this case, for example, if a certain period of time has elapsed since the channel was changed and a timeout occurs (step S127 / Yes), the display control unit 166 terminates the display of the item images (step S130). Note that, if the display control unit 166 has also displayed images prompting voice input or remote controller operation for changing the channel, the display control unit 166 also terminates the display of such images prompting voice input or controller operation in step S130. Furthermore, the display times of these images may be determined based on user settings, user information, etc., or may be dynamically determined based on the user's past selection information, current behavior, etc.

[0088] The final channel selection result, together with time information and user identification information, is stored in the viewing history DB 172 as a viewing history, and is used when the selection control unit 164 calculates the priority the next time the channel is selected. Repeating this process makes it possible to more reliably select content that is likely to be requested by the user. Furthermore, the information stored in the viewing history DB 172 may be used to determine, for example, the display time of the item image or the display content of the image prompting input, and information regarding the process of determining these may also be saved in the viewing history DB 172.

[0089] <3-2. Second Example: Simultaneous display of currently broadcasting programs and recorded programs> In the first embodiment described above, a channel is selected in response to a voice input of a channel name, and the program currently being broadcast on that channel is displayed on the display 108. However, the present disclosure is not limited to this, and the information processing device 100 may select recorded programs on the selected channel. That is, the selection targets may include not only currently broadcast programs on the searched channel but also recorded programs, and the currently broadcast programs and recorded programs may be displayed simultaneously in the item image showing the search results. Furthermore, in addition to the voice input of a channel name, currently broadcast programs and recorded programs may be searched in response to a voice input of a program name, and may be displayed as selection targets and item images showing the search results. Below, a specific description will be given of a case where a currently broadcast program and a recorded program are displayed simultaneously.

[0090] The operational processing of this embodiment is mainly similar to the operational processing of the first embodiment described with reference to FIG. 4. The difference in this embodiment is that in step S109, the search targets include recorded programs as well as currently airing programs. For example, if the user inputs the name of a channel by voice, the search control unit 162 outputs the search results including the recorded programs of the searched channel. Here, the search targets, search results, and item images can be set to include only recorded programs and not currently airing programs.

[0091] FIG. 6 is a diagram illustrating a case in which currently airing programs and recorded programs are simultaneously displayed as search results according to this embodiment. As shown in FIG. 6, for example, when a user voice-inputs "Show me 'NNN (channel name)'," the search control unit 162 searches for one or more channels that include "NNN" and at least a portion of the landmarks, and then searches for recorded programs on each of the searched channels. The recorded programs may be stored in the memory 105 or in an external device (e.g., a recorder) connected to the information processing device 100. Furthermore, the recorded programs to be searched may be limited to unviewed programs, or unviewed recorded programs may be given a higher priority, as described below, or viewed programs may be given a lower priority.

[0092] The selection control unit 164 selects the content with the highest predetermined priority (for example, priority based on the user's viewing history, preference information, time, etc.) from the search results. For example, if the user performs voice input while watching a currently broadcast program, the selection control unit 164 selects the currently broadcast program on a channel that the user frequently watches, and switches the display on the display 108.

[0093] Furthermore, the display control unit 166 displays item images 30 (30a, 30f, 30g, 30b, 30c) indicating the search results in order of priority, for example, as shown in Fig. 6. Since the search results also include recorded programs, the display control unit 166 may display a "recording mark" on the target item image 30 (see item images 30f and 30g in Fig. 6) or may display item images indicating recorded programs in a different manner from the others to clearly indicate that the program is a recorded program rather than a program currently being broadcast on the same channel, even if the program is on the same channel.

[0094] Furthermore, as in the first embodiment, the display of the read-out items may be clearly indicated by changing the display mode or by adding an illustrated image of a speaker or the like. Here, if the channel names are duplicated among the item images 30, they cannot be distinguished by the read-out of the channel names, so the user may be prompted to input the program title or the identification number (not shown) attached to the item image 30 as the read-out item by voice. For example, in the example shown in Fig. 6, the display mode of the program title 302 is changed in the item images 30f and 30g of the duplicated channel names to clearly indicate that they are read-out items.

[0095] <3-3. Third Example: Voice Input "Current Program"> In addition, when a voice input is made specifying all or part of the currently receivable content rather than the name of a channel, the information processing device 100 can automatically select and display a channel based on priorities according to the person and time.

[0096] The operational processing of this embodiment is mainly similar to the operational processing of the first embodiment described with reference to Fig. 4. When a voice input is made specifying all or part of currently receivable content, such as "current program," instead of the name of a channel, the search control unit 162 searches for currently receivable content (terrestrial broadcasting, satellite broadcasting, cable television (wired broadcasting), internet distribution content, etc.) in step S109, and the selection control unit 164 selects a channel (program) in accordance with the priority of the channel (or program) calculated based on, for example, the viewing history and preference information of the recognized viewing user, user information, user settings, information of other users, etc.

[0097] Fig. 7 is a diagram illustrating a display example when a voice input related to the current program is made according to this embodiment. As shown in Fig. 7, in response to a voice input from a viewing user such as "Show me the current program," the information processing device 100 automatically switches the display screen of the display 108 to a channel selected according to priority (if the power is off, it may be automatically turned on before displaying), and displays item images 30 indicating other candidate channels arranged in order of priority. The information processing device 100 may also display an image 35 prompting input when selecting another channel.

[0098] Note that a voice input specifying all or part of currently receivable content, such as "current programs," is not limited to broadcast programs and may also be Internet-distributed content. Also, in other embodiments described herein, Internet-distributed content may also be included in the search targets of the search control unit 162. The voice input may also specify a transmission means, such as "terrestrial broadcasting" or "satellite broadcasting" (more specifically, for example, a voice input such as "programs currently being broadcast on terrestrial broadcasting" or "search for satellite broadcasting programs"). In this case, programs currently receivable via the corresponding transmission means are searched for.

[0099] <3-4. Fourth Example: Voice Input "Genre"> In addition, even when the genre of a program (an example of content) is input by voice, the information processing device 100 can automatically select and display a program that is likely to be requested by the user, according to priorities based on people and time.

[0100] Examples of program genres include movies, dramas, variety shows, music, news, and documentaries. The information processing device 100 searches for programs corresponding to the genre input by voice by the user, and, as in the above-described embodiments, plays the programs selected based on priorities corresponding to the user's viewing history, preference information, and the like (if the power is off, the program may be automatically turned on and displayed). Also, item images indicating the search results may be displayed in order of priority. The user may set their preferred genres in advance, enabling searches for more specific genres or searches for content with multiple genre attributes, such as music documentaries. Similarly to the above-described embodiments, the information processing device 100 may also display an image prompting the user to select another program. While the program genre has been specifically mentioned here as an example, the content genre is not limited to this example and may include, for example, videos, music, images, applications, and the like, as well as content genres other than video content, such as jazz, rock, and ballads.

[0101] The search targets are not limited to currently broadcast programs, but also a wide range of currently available content, such as recorded programs (which may be limited to unwatched programs, or watched recorded programs may be given a lower priority), internet-streamed programs, VOD (Video On Demand) items, and live streaming videos.

[0102] Each item image showing the search results displayed as a selection candidate displays whether the content is a recorded program or an internet-distributed program, as well as the channel number, channel name, program title, etc.

[0103] <3-5. Fifth Example: Voice input for asking about recommended content, etc.> Furthermore, even when an abstract voice input is made, such as a request for recommended content, the information processing device 100 can automatically select and display a program according to priorities based on the person, time, etc. Search targets include a wide range of currently available content, such as currently broadcast programs, recorded programs, and internet distribution content.

[0104] Specifically, when the user voice-inputs "Show me recommendations," for example, the information processing device 100 searches for recommended content from currently viewable content based on the user's viewing history, preference information, etc., as in the above-described embodiments, and plays the selected content according to priority (for example, priority based on person or time. Also, for example, the priority of a recorded program that has already been viewed may be lowered) (if the power is turned off, the power may be automatically turned on and then played). Then, as in the above-described embodiments, the information processing device 100 may display item images showing the search results in order of priority (indicating items to be read out), and may also perform an operation of displaying an image prompting input when switching to other content.

[0105] <3-6. Sixth Example: Display of Content with Order> Furthermore, when searching for content that has a sequence, such as a TV drama series or a movie series, based on a voice input by the user, the information processing device 100 can automatically select content according to the viewing state of the content.

[0106] For example, when a user inputs the name of a piece of content that has a sequence by voice, the information processing device 100 searches for the target content from among currently viewable content (broadcast programs, recorded programs, internet-distributed content, etc.). Next, if the searched content contains multiple pieces of content that have a sequence (multiple pieces of content with the same title are searched), the information processing device 100 lists them, for example, in ascending order of number, and selects the content with the lowest number (an example of priority), excluding content that has already been viewed or that is judged to have been almost completely viewed, such as up to the credits roll, and controls playback on the display 108. By including not only unviewed content but also content that has been interrupted midway as the execution selection target, it is possible to resume playback from the beginning or continue playback of content that has been partially viewed without excluding it. Furthermore, the information processing device 100 may prioritize the selection of content that has been partially viewed. Furthermore, when the information processing device 100 can identify a viewing user using voice recognition or the like, it can also realize personalized playback control by referencing the viewing history of the viewing user and the viewing state of the viewing user with respect to the searched content.

[0107] 8 is a diagram illustrating a display example when the title of a content having a sequence such as a drama is input by voice according to this embodiment. As shown in FIG. 8, for example, when the user inputs a voice such as "Show me XX (drama title)," the search control unit 162 of the information processing device 100 searches for content with the title "XX" from among the programs that are currently available for viewing.

[0108] Next, the selection control unit 164 lists the searched content, for example, in ascending order of number (such as episode number or series number), and selects the content with the lowest number (for example, "Drama Episode 10" in the example shown in FIG. 8 ), excluding programs that have already been viewed or that can be determined to have been almost completely viewed, such as up to the credits. Then, the display control unit 166 controls the display 108 to automatically play (i.e., execute) the selected program (if the display 108 is turned off, it may be automatically turned on and displayed). Also, for example, if there are multiple drama series that include a keyword "XX" in their titles, the content with the highest priority may be selected, and each drama series may be displayed as an item image. In this case, if the user specifies another drama series, the content with the highest priority within that drama series may be selected and played, and other episodes in the series may be displayed as item images.

[0109] 8, the display control unit 166 may perform processing to display, on the playback screen of the selected content, item images 40 (40a to 40e) indicating the names of the content searched in response to the user's voice input and an image 42 prompting the viewing user to input voice when selecting other searched content. This makes it possible to provide a voice input UI that meets the user's requests as much as possible.

[0110] The information processing device 100 may clearly indicate, among the item images 40a to 40e shown in FIG. 8, the item images indicating the currently executed content by highlighting them, for example by changing the color. Furthermore, the information processing device 100 may also display information indicating the viewing status of each content, such as a bar indicating the last playback position (viewed position), on the item images 40a to 40e. This allows the viewing user to intuitively grasp the viewing status of each content. Furthermore, together with the bar display, icons or the like indicating commands that can be accepted regarding playback control, such as "Continue playback / Restart playback," may be displayed. Furthermore, the information processing device 100 may display a "NEW" mark or the like for unviewed content, as shown in FIG. 8.

[0111] The item image 40 may also display channel information, the name of the content (such as a program title), a summary of the content, information indicating whether the content is a currently broadcast program, a recorded program, a VOD item, or Internet-distributed content, or may display a still image or a video thumbnail. The channel and content-related information, still images, and video thumbnails may be obtained from the distribution source of each content, or from a different source such as a program information transmission server. The video thumbnail of the content displayed in the item image 40 may be obtained and played from a video distribution server, memory 105, or the like before the user selects the content. For example, a video thumbnail of a broadcast program may be obtained from a VOD server, and a video recorded from the broadcast program may be played in the item image 40 as the video thumbnail of the broadcast program. The still image and video thumbnail may be from the beginning of the content, or any position within the content may be used, or a video image dedicated to the thumbnail may be used.

[0112] In addition, when all episodes are available for viewing through VOD items or internet-distributed content, or depending on the content that has already been recorded, an icon indicating voice-acceptable commands such as "play the latest episode" or "play from episode 1" may be displayed.

[0113] Note that displaying information indicating the viewing status, such as a bar indicating the playback position, displaying a still image or video thumbnail, or displaying an icon indicating a voice-acceptable command on an item image is not limited to this embodiment, and can be similarly applied to the above-mentioned first to fifth embodiments. Also, displaying information indicating the elapsed broadcast time of content (broadcast status) on an item image, as explained in the first embodiment, can be applied to each embodiment.

[0114] <3-7. Seventh Example: Voice input specifying external input> In each of the embodiments described above, we have described the case where content is searched for and selected in response to voice input by the user, but the present disclosure is not limited to this, and the information processing device 100 can also search for external input in response to voice input by the user.

[0115] The information processing device 100 can receive video and audio data from external devices such as recorders, game consoles, PCs, digital cameras, and smartphones connected via the communication I / F 104, and output and play the data from the display 108 and speakers 109. Multiple external devices can be connected to the information processing device 100 (or the information processing device 100 can be connected to multiple external devices via a distributor). When one or more external devices are connected to the information processing device 100, the user can select or switch between the external devices by voice input. The search process and display of a voice input UI image by the information processing device 100 in this case will be described below with reference to FIGS. 9 and 10.

[0116] (Operation processing) 9 is a flowchart showing an example of the flow of operation processing when a voice input specifying an external input is made according to this example. Here, the operation processing will be described when the information processing device 100 recognizes a predetermined call from the user (calling an agent) and a predetermined search term (here, for example, "external input") in a standby state where at least the microphone 102 can detect voice and the display 108 is turned off.

[0117] As shown in FIG. 9, first, when the information processing device 100 detects a user's speech (speech input) (step S303), if the information processing device 100 is powered off, it may perform an operation to turn it on (step S306). At this time, the display 108 may remain off (not displayed because it has not been selected). Note that, if the user's speech input is performed by an external device such as a voice terminal, when the external device such as the voice terminal detects a predetermined speech input by the user (for example, a call to an agent and the utterance of a search term), it may perform control to turn on the power of the connected information processing device 100. Also, if the information processing device 100 is already powered on or if some content is already displayed on the display 108, the power state, etc., is left as is.

[0118] Next, if the phrase speech-recognized from the detected speech is "external input", the search control unit 162 of the information processing device 100 searches for external devices connected to the information processing device 100 (step S309).

[0119] Next, the display control unit 166 of the information processing device 100 lists item images 45 (45a to 45e) indicating the names of external devices (or names of external inputs) searched for by the search control unit 162 in accordance with priorities based on the user's viewing history, etc., and displays them on the display 108 (step S312), as shown in Fig. 10. Fig. 10 is a diagram showing an example of a screen displaying search results when a voice input specifying an external input is made according to this embodiment.

[0120] As shown in FIG. 10 , in response to, for example, a user's voice input of "external input," search results are displayed on the display 108. The search results may be sorted in descending order of priority, or may be displayed randomly across the entire screen. The priority may be calculated by the display control unit 166 based on, for example, at least one of a person and a time. More specifically, for example, the display control unit 166 may refer to the viewing history and calculate a higher priority for an external device that is frequently used at the current time, or, if the viewing user can be recognized, calculate a higher priority for an external device that the viewing user frequently uses.

[0121] Here, in the case of an external input device search, unlike the above-described embodiments of content search, the control unit 160 may not perform a series of steps from the search results to automatic selection and execution of an external input (such as starting up an external device), but may first display the search results on the display 108 and allow the user to select an external input to be selected and executed. Therefore, for example, if the external device has not been started up, nothing is displayed on the background screen when the item image 45 is displayed, as shown in Fig. 10. Also, if some content is already being played on the display 108, the item image 45 may be displayed while continuing to display that content.

[0122] The names displayed in the item images 45 are preferably read-out items recommended for voice recognition, easy to recognize, and as unambiguous as possible. For example, the standard name of the external input ("HDMI1 / 2 / 3") or names corresponding to the device types of the external devices (such as Recorder 1 / 2 / 3, Player 1 / 2 / 3, Tuner 1 / 2 / 3, and Device 1 / 2 / 3) are conceivable. These names may be determined by the communication I / F 104 or the control unit 160. The display control unit 166 may also display the name of a CEC (Consumer Electronics Control) device (such as a product name) in the item images 45 together with the read-out items as detailed information about the external devices. The display control unit 166 may also clearly indicate the read-out items by changing the display mode, such as highlighting the items in the item images 45, or may display an icon image indicating the attributes of the external devices (such as an icon indicating a recorder). In addition, the display control unit 166 can display icons representing a speaker, a mouth, or a person speaking near the item to be read aloud, allowing the user to intuitively understand which description is the item to be read aloud.

[0123] Furthermore, the display control unit 166 may display on the display 108 an image that prompts the user to select an external device from the displayed search results (item images) (step S315). Specifically, for example, as shown in FIG. 10, an image 47 showing a guidance message such as "Please speak the item you want to select" is displayed. Here, as shown in FIG. 10, for example, by making the text portion of the guidance message, such as "item" or "item you want to select," the same as the display format of the read-out items displayed in the item image 45 (for example, by using the same font, text color, text background color, etc.), the read-out items can be made even clearer, making it possible to avoid reading out names that are difficult to recognize or ambiguous voice input.

[0124] Then, when the name of an external device is spoken (step S318 / Yes), the display control unit 166 of the information processing device 100 displays the content input from the spoken external device on the display 108 (step S321). That is, the control unit 160 performs control to switch the external input to the external device (external input) selected by the user. At this time, if the power supply of the target external device is turned off, the control unit 160 performs control to turn on the power supply of the external device (start-up control).

[0125] Note that even after the user selects an external device and the content input from the external device is displayed on the display 108, the item image 45 showing the search results and the image 47 prompting voice input may be displayed on the display 108. This can provide support when switching the external device again by voice input.

[0126] (Example of audio input "HDMI") The above has described the selection of an external input by a user's voice input. Note that even when the user's voice input is a more specific specification of an external device or external input path, such as "HDMI" or "recorder," and there are multiple options (when there are multiple HDMI inputs or recorders), the information processing device 100 displays an item image showing the search results (multiple HDMI inputs or recorders) on the display 108, similar to the case of the external input device described with reference to Fig. 10. Also, an image prompting the user to select an external device may be displayed on the display 108.

[0127] Specifically, for example, if the user inputs voice to specify an HDMI input and the search control unit 162 searches to find multiple HDMI inputs (e.g., "HDMI1," "HDMI2," "HDMI3," and "HDMI4"), the display control unit 166 lists these in order of priority based on, for example, the person (viewing user) or the time (current time), and displays item images indicating these (e.g., item images indicating read-out items such as "HDMI1," "HDMI2," "HDMI3," and "HDMI4") on the display 108. To clearly indicate the read-out items, the display mode may be changed, or an icon such as a speaker may also be displayed. At this point, the HDMI may not be selected and executed (the external device connected via HDMI may be started), and the content that was already displayed at the time of the voice input may continue to be displayed as a background image on the display 108. Alternatively, the HDMI may be selected and executed based on the priority, and the content being played on the external device or a menu screen (home screen) of the external device may be displayed on the display 108. If the external device is not running when the voice is input, the selected external device may be started, or may not be started and no background image may be displayed when the item images of the search results are displayed on the display 108.

[0128] The display control unit 166 may also display an image prompting the user to make a selection, such as "Please speak the item you want to select," as in the example shown in Fig. 10. Here, as in the example shown in Fig. 10, by matching the display mode of the text prompting voice input with the items to be read aloud, or by displaying a microphone icon or the like near the text prompting voice input, it is possible to more reliably prompt the user to input voice using the items to be read aloud.

[0129] Then, when the user performs audio input (selection of external input) such as "HDMI1," "HDMI2," "HDMI3," or "HDMI4" based on the item image 45, the display control unit 166 switches to the selected external input. Specifically, the display control unit 166 controls the display of content transmitted from the selected external input destination on the display 108. At this time, if the power of the external device of the external input destination is turned off, the information processing device 100 turns on the power of the target external device (startup control) and then acquires content from the external device. Here, the content acquired from the external device may be a menu screen of the external device, etc.

[0130] <3-8. Eighth Example: Voice input for application launch, etc.> Next, a description will be given of voice input when starting an application that has been installed on the information processing device 100. For example, assume that various applications (including applications provided by content distribution companies) used to enjoy Internet-distributed content are installed on the information processing device 100. In this specification, "application" will be abbreviated to "app" in some places below.

[0131] For example, when a user performs a voice input requesting the launch of an application or processing by an application, or a voice input of the name of an application, the information processing device 100 searches for launchable applications using the search control unit 162, and the display control unit 166 displays the search results on the display 108. The voice input may not only be the name of a specific application, but also a function name such as "photo app," or simply "app." Fig. 11 is a diagram showing an example of a screen displaying search results when a voice input is performed regarding the launch of an application, etc., according to this embodiment.

[0132] As shown in FIG. 11 , in response to a user's voice input, such as "Show apps," search results (item images 50a to 50e) searched by the search control unit 162 are displayed on the display 108 under the control of the display control unit 166. The search results may be sorted in descending order of priority, or may be displayed randomly across the entire screen. The priority may be calculated by the display control unit 166 based on at least one of a person and a time. More specifically, for example, the display control unit 166 may refer to the viewing history and calculate a higher priority for an application that is frequently used at the current time, or, if the viewing user recognizes the application, calculate a higher priority for an application that the viewing user frequently uses. Furthermore, the item images 50a to 50e may display, in addition to the name of the application, an icon indicating a command (option) that can be accepted by the application, an icon of the application itself (for example, an icon indicating the application on the menu screen of the information processing device 100), or an icon indicating an attribute of the application (for example, a headphone mark in the case of a music playback application).

[0133] Here, in the case of an application search according to this embodiment, unlike the above-described embodiments of content search, the control unit 160 does not automatically select and execute an application (launch the application, etc.) from the search results in a series of steps. Instead, the control unit 160 may first display the search results on the display 108 and allow the user to select an application to select and execute. Alternatively, as in the previous embodiments, a series of steps may be performed in which one application is automatically selected and executed based on priority. Therefore, for example, if the display 108 is turned off (power is not supplied), as shown in FIG. 11, when the item image 50 is displayed, nothing may be displayed on the background screen. On the other hand, if some content is already being played on the display 108, the item image 50 may be displayed while the content continues to be displayed.

[0134] 11, the display control unit 166 may also display on the display 108 an image 52 that prompts the user to select an application, such as "Please speak the item you want to select." Here, as shown in FIG. 11, by matching the display mode of the characters prompting voice input shown in the image 52 with the read-aloud items (for example, application names) shown in the item image 50, or by displaying a microphone icon or the like near the characters prompting voice input shown in the image 52, it is possible to more reliably prompt the user to input voice using the read-aloud items.

[0135] Then, when the user inputs (selects) the name of an application by voice (selects an application), the control unit 160 starts (executes) the selected application and performs control to display the application screen on the display 108. Here, if an application has been automatically selected and executed previously, the application that is not being executed is displayed in the item image 50, and a different application may be selected by the user based on this.

[0136] Note that even after the user selects an application, the application is launched, and the application screen (content) is displayed on the display 108, an item image 50 showing the search results and an image 52 prompting voice input may be displayed on the display 108. This can provide support when switching applications again by voice input.

[0137] <3-9. Ninth Example: "Recording / viewing reservation, content deletion" after power off> The information processing device 100 according to this embodiment can schedule recording, schedule viewing, and delete content in accordance with user voice input even when the display 108 is turned off. This will be described in detail below with reference to Figs. 12 and 13.

[0138] (Recording / viewing reservation) 12 is a flowchart showing an example of the flow of operation processing for recording reservation or viewing reservation when the power is off according to this embodiment. Here, "when the power is off" refers to a standby state in which at least the microphone 102 is capable of detecting voice and the voice recognition unit 130 is capable of recognizing voice (a state in which power is being supplied to the processor 112 and the microphone 102), and the display 108 is off (a state in which power is not being supplied to the display 108).

[0139] 12, first, the information processing device 100 detects a speech related to recording / viewing reservation, such as "Make a recording reservation for XX (title of the program)" or "Make a viewing reservation for XX (title of the program)" (step S503). When a predetermined call is made by the user, such as calling an agent, the speech recognition unit 130 of the information processing device 100 may recognize the subsequent speech and identify a command such as a recording reservation or a viewing reservation.

[0140] Next, the control unit 160 controls the power of the information processing device 100 to be in the ON state except for the display 108 (step S506).

[0141] Next, the application unit 150 executes a recording reservation or a viewing reservation based on the voice recognition result by the voice recognition unit 130 (step S509). The recording / viewing reservation information is stored, for example, in the memory 105. Furthermore, when the application unit 150 can identify the speaker (user) by voice recognition or the like, it may execute a recording / viewing reservation for that user (by associating the information of that user as the reserving user).

[0142] As described above, in this embodiment, it is possible to execute a recording / viewing reservation by voice input without turning on the power of the display 108 or performing any operation using the display screen, and the user can quickly execute a recording / viewing reservation without waiting for the display 108 to light up. When the information processing device 100 accepts a recording / viewing reservation, it may provide feedback to the user by voice using the speaker 109 (for example, by playing a response voice such as "Recording / viewing reservation has been made"). Furthermore, the recording / viewing reservation may be executed so that the actual recording or viewing process is performed by an external device connected to the information processing device 100.

[0143] Then, the control unit 160 turns off the power of the information processing device 100 (step S512). Here, the power being turned off means that at least the functions of executing recording / viewing reservation and the voice recognition function are possible (that is, power is being supplied to the extent that these functions can be executed).

[0144] (Content deleted) FIG. 13 is a flowchart showing an example of the flow of the operation process for deleting content when the power is turned off according to this embodiment.

[0145] 13, first, the information processing device 100 detects a speech related to deleting a recorded program, such as "Please delete XX (title of the recorded program)" (step S603). When a predetermined call is made by the user, such as calling an agent, the speech recognition unit 130 of the information processing device 100 may recognize the subsequent speech and identify a command such as deleting content.

[0146] Next, the control unit 160 controls the power of the information processing device 100 to be in the ON state except for the display 108 (step S606).

[0147] Next, the application unit 150 executes deletion of the specified recorded program based on the voice recognition result by the voice recognition unit 130 (step S609). The recorded program data is stored, for example, in the memory 105. Note that even if the recorded program data is stored in an external device connected to the information processing device 100, the application unit 150 can also control deletion of the recorded program stored in the external device.

[0148] In this way, in this embodiment, it is possible to delete a recorded program by voice input without turning on the display 108 or performing operations using a display screen, and the user can quickly delete a recorded program (content) without waiting for the display 108 to light up. Note that when the information processing device 100 accepts a request to delete a recorded program, it may provide feedback to the user by voice using the speaker 109 (for example, by playing a response voice such as "XX (title of the recorded program) has been deleted").

[0149] Then, the control unit 160 turns off the power of the information processing device 100 (step S612). Here, the power being off means a power state in which at least the voice recognition function is possible (that is, power is being supplied to an extent that the function can be executed).

[0150] <3-10. Supplementary Information> The above-described embodiments may be combined and implemented.

[0151] For example, when a channel is automatically selected by voice input of a channel name as described in the first embodiment and an item image 30 is displayed as a search result as shown in FIG. 5 , a voice input of a program name displayed in the item image 30 may be accepted. In this case, the information processing device 100 searches for content matching the voice-input program name from among the currently viewable content. If the searched content is a plurality of ordered contents, the information processing device 100 may, for example, list the contents in ascending order of number, as described in the sixth embodiment, and select and automatically play the content with the lowest number, excluding programs that have already been viewed or that are determined to have been viewed almost to the end, such as up to the credits. Furthermore, by combining the search and selection process for currently broadcast programs and recorded programs in response to the voice input of program names as described in the second embodiment and the search and selection process for currently available content, including Internet-distributed content, in response to a voice input specifying all or part of currently available content as described in the third embodiment, a search and selection process for currently broadcast programs, recorded programs, and currently available content, including Internet-distributed content, in response to an input of a program name may be performed.

[0152] Although the content searched and executed here has been described primarily with reference to video content such as broadcast programs, any type of content may be executed by the device or apparatus realized by the present invention. For example, the content to be played may be audio content (e.g., music), and the music may be played by an application executable on the information processing device 100. Furthermore, the target of a search based on priority may be audio content or an application that plays audio content. In such cases, one song or application is selected based on a procedure similar to one of the above embodiments or a combination thereof, and an item image including the unselected songs or applications as options is displayed on the display 108. The display 108 may display, as the selected content, an album art image (jacket image) of the song, a UI image of the application, or the like. The channel described in the above embodiment may be a radio or music distribution station channel that broadcasts audio content such as music. Similar procedures can also be used for other types of content, such as still image content or web pages.

[0153] <<4. Summary>> Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the present technology is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0154] For example, a computer program can be created to cause hardware such as a CPU, ROM, and RAM built into the information processing device 100 to perform the functions of the information processing device 100. Also provided is a computer-readable storage medium storing the computer program.

[0155] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0156] The present technology can also be configured as follows. (1) A search process for searching for channels or content based on words recognized from the user's speech; A process of selecting one channel or content from the plurality of channels or content obtained by the search process; a process of displaying the selected content or the content being broadcast on the selected channel on a display unit; The receiving device further comprises a control unit that performs a process of displaying, on the display unit, item images indicating the plurality of channels or contents obtained by the search process as options. (2) The receiving device according to (1), wherein the control unit displays an image on the display unit that prompts the user to input voice when selecting the plurality of channels or content. (3) The receiving device according to (2), wherein the image prompting voice input includes an explanatory text prompting voice input of the readout item displayed in the item image. (4) The receiving device according to (3), wherein the explanatory text of the image prompting the voice input includes characters whose display style matches the display style of the readout item displayed in the item image. (5) The control unit The receiving device according to any one of (1) to (4), wherein the channel or content is selected according to priority based on at least one of the viewing history and preference information of the user, or time information. (6) The control unit The receiving device according to (5) performs processing to display item images indicating the plurality of channels or contents obtained by the search processing in descending order of priority. (7) The receiving device according to any one of (1) to (6), wherein the content is a broadcast program, a recorded program, or distributed content distributed via the Internet. (8) The receiving device a receiving unit that receives a broadcast program transmitted from a broadcast station; a communication unit that receives content distributed via the Internet; The receiving device according to (7) above, further comprising: (9) The receiving device according to (3) or (4), wherein the item to be read out is a channel name or a content name. (10) The control unit If the phrase is related to an external input or an application, the receiving device described in any one of (1) to (9) displays item images indicating the standard name of the searched external input, the name of the external device to which the external input is to be sent, or the name of the application as options on the display unit, and then performs processing to display an image of the external input or application selected by the user's voice input on the display unit. (11) The control unit The receiving device according to any one of (1) to (10), wherein, when the power supply of the display unit is turned off, the receiving device turns on the power supply of the display unit and performs a process of displaying the selected content or the content being broadcast on the selected channel. (12) The control unit If the phrase is related to the name of a channel or program, the receiving device described in any one of (1) to (11) searches for the channel or program, selects the program with the highest priority based on person or time from the broadcast programs and recorded programs corresponding to the searched channel or program, and displays the selected program on the display unit. (13) The control unit The receiving device according to (12) above, wherein a program that has been viewed by the user is given a lower priority than a content that has not been viewed by the user. (14) The control unit The voice reception process is started by a signal from the external operation terminal, The receiving device according to any one of (1) to (13), wherein the voice reception process is performed by a microphone included in an external operation terminal. (15) The receiving device according to (14), wherein the external operation terminal is a remote controller or a mobile terminal having a physical key or a virtual key for performing an operation to start the voice reception process. (16) The control unit The receiving device according to any one of (1) to (15), wherein, if the phrase specifies an external device that is not running, the receiving device starts up the external device and displays a home screen of the external device on the display unit. (17) The receiving device described in any one of (1) to (16), wherein the content is audio content, and the process of displaying the selected content on a display unit is a process of displaying an image representing the audio content on the display unit. (18) The control unit The receiving device according to any one of (1) to (17), wherein the receiving device performs processing to display the item image on the display unit for a certain period of time. (19) The control unit The receiving device according to any one of (1) to (18), wherein information indicating a broadcast status or a viewing status of each content is displayed in the item image. (20) The processor: Searching for channels or content based on words recognized from a user's speech; selecting one channel or content from the plurality of channels or content obtained by the search; displaying the selected content or the content being broadcast on the selected channel on a display unit; Furthermore, displaying, on the display unit, item images representing the plurality of channels or contents obtained by the search as options; A control method comprising: [Explanation of symbols]

[0157] 100 Information processing device 101 Camera 102 microphones 103 Input Devices 104 Communication Interface (I / F) 105 memory 106 Tuner 107 Decoder 108 Display 109 Speaker 111 Bus 112 processors 120 Audio acquisition unit 130 Voice Recognition Unit 140 feature database 150 Application Section 160 control section 162 Search control section 164 Selection control section 166 Display control unit 172 Viewing History Database 174 Preference Database

Claims

1. a search process for searching for channels or content based on words recognized from the speech; a process of displaying, on a display unit, as options, item images representing a plurality of channels or contents obtained by the search process, each of the item images including a readout item in the form of character information displayed on the display unit for voice input corresponding to one of the plurality of channels or contents, and the readout item including identification information assigned to each of the item images; a process of displaying on a display unit an image prompting the user to input the identification information by voice in order to select from the plurality of channels or contents; a process of displaying content corresponding to one of the plurality of channels or content on the display unit based on an utterance corresponding to the identification information; a control unit that performs a process of displaying an image prompting voice input on the display unit, the image prompting for voice input includes an explanatory sentence prompting for voice input of the identification information included in the read-out item displayed in the item image, Receiving device.

2. A search process for searching for channels or content based on words recognized from speech; a process of displaying, on a display unit, as options, item images representing a plurality of channels or contents obtained by the search process, each of the item images including a readout item in the form of character information displayed on the display unit for voice input corresponding to one of the plurality of channels or contents, and the readout item including identification information assigned to each of the item images; a process of displaying on a display unit an image prompting the user to input the identification information by voice in order to select from the plurality of channels or contents; a process of displaying content corresponding to one of the plurality of channels or content on the display unit based on an utterance corresponding to the identification information; a control unit that performs a process of displaying an image prompting voice input on the display unit, the image prompting for voice input includes an explanatory sentence prompting for voice input of the read-out item displayed on the item image, The explanatory text of the image prompting the user to input voice includes characters in a display format that matches the display format of the read-out item displayed in the item image. Receiving device.

3. The control unit The receiving device of claim 1, configured to select one channel or content from the plurality of channels or contents obtained by the search process according to at least one of the user's viewing history or preference information, or priority based on time information.

4. The control unit 4. The receiving device according to claim 3, wherein the receiving device is configured to perform processing for displaying item images indicating the plurality of channels or contents obtained by the search processing in descending order of priority.

5. The receiving device according to claim 1 , wherein the content is a broadcast program, a recorded program, or distributed content distributed via the Internet.

6. The receiving device a receiving unit that receives a broadcast program transmitted from a broadcast station; a communication unit that receives content distributed via the Internet; The receiving device of claim 5 further comprising:

7. The receiving device according to claim 1 , wherein the read-out item is a channel name or a content name.

8. The control unit 2. The receiving device of claim 1, wherein when the phrase is related to an external input or an application, the receiving device is configured to display, on the display unit as options, item images indicating the standard name of the searched external input, the name of the external device to which the external input is to be sent, or the name of the application, and then to display, on the display unit, an image of the external input or application selected by the user's voice input.

9. The control unit 2. The receiving device according to claim 1, wherein, when the power of the display unit is OFF, the receiving device is configured to turn ON the power of the display unit and then display the selected content or the content being broadcast on the selected channel.

10. The control unit The receiving device of claim 1 is configured to perform a process in which, if the phrase is related to the name of a channel or program, the channel or program is searched for, and from the broadcast programs and recorded programs corresponding to the searched channel or program, a program with the highest priority based on person or time is selected, and the selected program is displayed on the display unit.

11. The control unit 11. The receiving device according to claim 10, wherein a program that has been viewed by the user is given a lower priority than unviewed content.

12. The control unit The voice reception process is started by a signal from the external operation terminal, 2. The receiving device according to claim 1, wherein the voice reception process is performed by a microphone provided in an external operation terminal.

13. The receiving device according to claim 12, wherein the external operation terminal is a remote controller or a mobile terminal having a physical key or a virtual key for performing an operation to start the voice reception process.

14. The control unit 2. The receiving device according to claim 1, wherein, when the phrase specifies an external device that is not activated, the receiving device is activated and a home screen of the external device is displayed on the display unit.

15. The receiving device according to claim 1 , wherein the content is audio content, and the process of displaying the selected content on the display unit is a process of displaying an image representing the audio content on the display unit.

16. The control unit The receiving device according to claim 1 , wherein the receiving device is configured to perform processing for displaying the item image on the display unit for a certain period of time.

17. The control unit The receiving device according to claim 1 , wherein the item image is configured to display information indicating a broadcast status or a viewing status of each content.

18. The processor: Searching for channels or content based on words recognized from the speech; Displaying, on a display unit, as options, item images representing a plurality of channels or contents obtained by the search, each of the item images including a read-aloud item in the form of character information displayed on the display unit for voice input corresponding to one of the plurality of channels or contents, and the read-aloud item including identification information assigned to each of the item images; displaying on a display unit an image prompting the user to input the identification information by voice in order to select from the plurality of channels or contents; displaying content corresponding to one of the plurality of channels or content on the display unit based on the utterance corresponding to the identification information; displaying an image on the display unit to prompt voice input, the image prompting for voice input includes an explanatory sentence prompting for voice input of the identification information included in the read-out item displayed in the item image, Control method.

19. A processor comprising: Searching for channels or content based on words recognized from the speech; Displaying, on a display unit, as options, item images representing a plurality of channels or contents obtained by the search, each of the item images including a read-aloud item in the form of character information displayed on the display unit for voice input corresponding to one of the plurality of channels or contents, and the read-aloud item including identification information assigned to each of the item images; displaying on a display unit an image prompting the user to input the identification information by voice in order to select from the plurality of channels or contents; displaying content corresponding to one of the plurality of channels or content on the display unit based on the utterance corresponding to the identification information; displaying an image on the display unit to prompt voice input, the image prompting for voice input includes an explanatory sentence prompting for voice input of the read-out item displayed on the item image, The explanatory text of the image prompting the user to input voice includes characters in a display format that matches the display format of the read-out item displayed in the item image. Control method.

Images