Receiving device and method

Abstract

The present invention provides a receiving device and method equipped with a search process that searches for channels or content based on words or phrases recognized from the user's spoken voice. [Solution] The information processing device 100 performs a search process to search for one of the channels or contents based on words recognized from spoken speech, selects one from among the multiple channels or contents obtained by the search according to priority based on viewing history, user preference information, or time information, and displays an item image representing the multiple channels or contents obtained by the search on the display. The item image includes a read-aloud item that is displayed on the display as text information for voice input corresponding to one of the multiple channels or contents, and includes at least one of a thumbnail image, a progress bar, and information indicating the broadcast status or viewing status.

Description

Technical Field

[0001] This disclosure relates to a receiving apparatus and method.

Background Art

[0002] Conventionally, speech recognition has been used as a technology to assist a user in inputting information to an information device. For example, in Patent Document 1 below, a technology of a display control device that performs speech recognition on the content of speech uttered by a user to identify a voice command and execute processing is disclosed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, when there are a plurality of options for the speech recognition result of the user's uttered content, it has been difficult to determine which option surely corresponds to the user's desire.

[0005] In Patent Document 1 above, from a plurality of options corresponding to a speech input, a target option is specified according to a predetermined criterion, the other is specified as an alternative option, and the target option is displayed larger than the other options, so that it can be indicated that the target option is selected.

[0006] However, in Patent Document 1 above, when executing the option, a speech input representing a phrase such as "start" is required again, and the steps from selection to execution may be troublesome in some cases.

Means for Solving the Problems

[0007] The present disclosure proposes a receiving device comprising a circuit that performs a search process to search for one of the channels or contents based on words recognized from spoken speech, selects one from a plurality of the channels or contents obtained by the search according to priority based on viewing history, user preference information, or time information, and displays an item image representing the plurality of channels or contents obtained by the search on a display, wherein the item image includes a read-aloud item displayed on the display as text information for voice input corresponding to any of the plurality of channels or contents, and the item image includes at least one of a thumbnail image, a progress bar, and information indicating broadcast status or viewing status.

[0008] The present disclosure proposes a method for operating a receiving device, comprising: performing a search process to search for one of the channels or contents based on a phrase recognized from spoken speech; selecting one from a plurality of the channels or contents obtained by the search according to a priority based on viewing history, user preference information, or time information; and displaying item images representing the plurality of channels or contents obtained by the search on a display, wherein the item image includes a read-aloud item displayed on the display as text information for voice input corresponding to any of the plurality of channels or contents, and the item image includes at least one of a thumbnail image, a progress bar, and information indicating broadcast status or viewing status. [Brief explanation of the drawing]

[0009] [Figure 1] This is an explanatory diagram illustrating the outline of an information processing device according to one embodiment of the present disclosure. [Figure 2] This block diagram shows an example of the hardware configuration of the information processing device according to this embodiment. [Figure 3]Figure 2 is a block diagram showing an example of the configuration of the logical functions realized by the memory and processor of the information processing device. [Figure 4] This flowchart shows an example of the operation flow of the information processing device when a channel name is input via voice according to the first embodiment of this invention. [Figure 5] This figure shows an example of the display of a UI image during voice input according to the first embodiment of this present invention. [Figure 6] This diagram illustrates a case in which currently airing programs and recorded programs are displayed simultaneously as search results according to a second embodiment of this present invention. [Figure 7] This figure illustrates an example of a display when audio input regarding the current program is received according to the third embodiment of this present invention. [Figure 8] This figure illustrates an example of how the title of a sequence of content, such as a drama, is displayed when it is entered via voice input, according to the sixth embodiment of this present invention. [Figure 9] This flowchart shows an example of the operation process flow when an audio input specifying an external input is received according to the seventh embodiment of this present invention. [Figure 10] This figure shows an example screen displaying search results when an external input is specified by voice input according to the seventh embodiment of this embodiment. [Figure 11] This figure shows an example screen displaying search results when voice input is received regarding the launch of an application according to the eighth embodiment of this present invention. [Figure 12] This flowchart shows an example of the operation flow for recording or viewing reservation when the power is turned off, according to the ninth embodiment of this model. [Figure 13] This flowchart shows an example of the operation flow for deleting content when the power is turned off, according to the ninth embodiment of this present invention. [Modes for carrying out the invention]

[0010] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

[0011] Also, the description will be made in the following order. 1. Overview 2. Configuration examples 2-1. Hardware configuration example 2-2. Functional configuration example 3. Each embodiment 3-1. First embodiment: Voice input "channel name" 3-2. Second embodiment: Simultaneous display of current broadcast program and recorded program 3-3. Third embodiment: Voice input "current program" 3-4. Fourth embodiment: Voice input "genre" 3-5. Fifth embodiment: Voice input asking for recommended content, etc. 3-6. Sixth embodiment: Display of content with an order 3-7. Seventh embodiment: Voice input specifying external input (Example of voice input "HDMI") 3-8. Eighth embodiment: Voice input related to starting an application, etc. 3-9. Ninth embodiment: "Recording / Viewing reservation, content deletion" from power OFF 3-10. Supplementary 4. Summary

[0012] <<1. Overview>> This section describes an overview of an information processing device to which the technology relating to this disclosure may be applied, using Figure 1. Figure 1 is an explanatory diagram illustrating the overview of an information processing device 100 according to one embodiment of this disclosure. Referring to Figure 1, the information processing device 100 is a receiving device that receives broadcast signals broadcast from radio towers 200 by each broadcasting station and content data distributed from the Internet 220 (specifically, content distribution servers connected via the Internet), and is a so-called television device equipped with a display 108. Note that the information processing device 100 (receiving device) is not limited to a television device, but may also be an external device such as a smartphone, projector, car navigation system, or a recorder with recording and playback functions or a player with playback functions connected to a television device.

[0013] In the following explanation, we will use the case where the information processing device 100 is a television device as an example.

[0014] The information processing device 100 includes a microphone 102 and a display 108. The microphone 102 collects the voice emitted by the user. The display 108 displays images generated by the information processing device 100. The images displayed by the display 108 may include content images as well as user interface (UI) images.

[0015] In the example in Figure 1, user U utters the phrase "NNN," which is the name of a channel. The information processing device 100 recognizes the user's voice, searches for channels based on the phrase "NNN," and controls the system to switch to one of the selected channels from the search results, for example, "NNN General." The display 108 shows the video of the program currently being broadcast on "NNN General." When there are multiple search results, the selection of candidates may be determined according to a predetermined priority. For example, if user U voice inputs "Show me 'NNN' (channel name)," and there are multiple channels with "NNN," such as "NNN General," "NNN 1," "NNN AA," and "NNN Premier," the information processing device 100 will select the channel that user U is most likely to watch based on a predetermined priority and automatically switch the display screen, enabling the system to respond to user U's request as much as possible, even when there are multiple selection candidates. The channel name is not limited to the example of "NNN," but may include all names that can identify a channel, including the official name and abbreviation of each broadcasting station.

[0016] The information processing device 100 may, for example, if it can identify the user who is watching the content using voice recognition, facial recognition (image recognition), or user information such as account information, calculate the priority of each search result based on the user's preference information and viewing history, and select the channel with the highest priority.

[0017] Furthermore, after the information processing device 100 automatically selects a channel from the search results and switches channels, it displays item images 30 (30a to 30d) on the screen that show the names of each channel (selected item) based on the search results. There is no problem if the channel automatically selected by the information processing device 100 is as the user expects, but it is expected that the user will immediately select a different channel if it is different from the channel they requested. Therefore, the information processing device 100 according to this embodiment displays item images 30a to 30d showing the search results (for example, the names of each searched channel) in order of priority, etc., to support the user's voice input when changing channels. For example, item images 30a to 30d may be displayed for a certain period of time (for example, a few seconds), and if a timeout occurs after that period, the display may disappear without any operation. The user can refer to the read-aloud items displayed in item image 30, make another voice input with a more accurate name, and switch to the desired channel (for example, "NNN 1" or "NNN AA," which are other selection candidates, instead of the automatically selected "NNN General").

[0018] Furthermore, the information processing device 100 may display on the display 108, along with the item images 30 (30a to 30d), an image (not shown in Figure 1) that prompts the user to input when selecting another channel. The input prompting image may, for example, prompt the user to use a remote controller or smartphone for cursor input, or it may prompt voice input with something like a microphone icon. In addition, explanatory text such as "If you want to watch another channel, please say that item again." may be displayed. Furthermore, by matching the "that item" part of the explanatory text with the display format of the item to be read aloud displayed in the item image 30, it becomes possible to help the user intuitively understand which item to read aloud.

[0019] The information processing device 100 records the channels selected by the user as viewing history and preference information, along with user information and time information, thereby improving the accuracy of automatic channel selection.

[0020] In the example in Figure 1, it was explained that a channel search (i.e., program search) is performed when a channel name is entered by voice. However, this disclosure is not limited to this. In addition to voice input specifying program names or genres, application names or external input device names, abstract voice input such as "show me recommendations" can also be used to search for content such as broadcast programs, recorded programs, internet-distributed programs, and applications.

[0021] As described above, the information processing device 100 according to this disclosure searches for content in response to the user's voice input, and if multiple content items are found, it automatically selects the content that is most likely to be requested by the user according to predetermined criteria and displays it on the display 108, as well as displaying an item image indicating the search result. The item image indicating the search result may, for example, be an overlay display of information consisting only of text on the content image.

[0022] This allows the system to automatically select and display (i.e., execute) content even when multiple options are available during voice input, saving the user time. Furthermore, by displaying search results as selection options, it assists the user in selecting other options through voice input, thus meeting user requests as closely as possible. Additionally, UI images that prompt voice input for the text-to-speech items may be displayed alongside the voice input support images, helping to avoid difficult-to-recognize or ambiguous readings.

[0023] Furthermore, the information processing device 100 may automatically turn on its power (at least turn on the display 108) when it recognizes a voice input request from a user (content search) while in a standby state where voice detection by the microphone 102 is possible (i.e., power is supplied to the processor 112 and microphone 102) and the display 108 is OFF (i.e., power is not supplied to the display 108). The recognition of the voice input request from the user may be configured to recognize the following words (search words, such as channel name, program name, genre specification, etc.) when a predetermined call such as an agent name is made. The information processing device 100 then performs a content search based on the voice-recognized words, and if multiple candidates are found, it displays the selected content on the display 108 according to predetermined criteria, and also displays item images indicating the search results on the display 108. In this way, it is possible to automatically turn on the power of the information processing device 100 in response to a voice input request for content search.

[0024] In this embodiment, as an example, speech recognition processing is performed on the information processing device 100, but the disclosure is not limited thereto, and speech recognition processing may be performed on an external device connected to the information processing device 100 (a local terminal such as a smart speaker, smartphone, tablet terminal, or PC, or a server on the internet, etc.).

[0025] Furthermore, in this embodiment, as an example, the microphone 102 is provided on the information processing device 100, but the disclosure is not limited thereto, and the microphone 102 may be provided on an external device connected to the information processing device 100 (such as a voice terminal like a smart speaker or a mobile terminal like a smartphone) or a remote controller. The external device, such as a voice terminal, may detect user voice, perform voice recognition processing, and control the information processing device 100 to automatically turn on its power, or it may transmit the detected user voice to a server on the network, have the server perform voice recognition processing, and then control the information processing device 100 to automatically turn on its power based on the recognition result. Alternatively, an input device such as a remote controller may receive voice input, transmit the received user utterance information to the information processing device 100, and the information processing device 100 may perform voice recognition processing or transmit information to a server. Based on the voice recognition result, the information processing device 100 performs a content search, and if multiple candidates are found, it displays the selected content on the display 108 according to predetermined criteria, and also displays item images indicating the search results on the display 108. The voice reception and voice recognition initiation processes may be initiated using buttons or icons located on devices such as remote controllers or smartphones.

[0026] <<2. Example Configuration>> <2-1. Hardware Configuration Example> Figure 2 is a block diagram showing an example of the hardware configuration of the information processing device 100. Referring to Figure 2, the information processing device 100 includes a camera 101, a microphone 102, an input device 103, a communication interface (I / F) 104, a memory 105, a tuner 106, a decoder 107, a display 108, a speaker 109, a remote control I / F 110, a bus 111, and a processor 112.

[0027] (1) Camera Camera 101 has an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) and captures images. The images captured by camera 101 (each frame that makes up the video) are treated as input images for processing by the information processing device 100.

[0028] (2) Microphone Microphone 102 collects the voice emitted by the user and generates an audio signal. The audio signal generated by microphone 102 is treated as input audio for speech recognition by the information processing device 100.

[0029] (3) Input devices The input device 103 is a device used by a user to directly operate the information processing device 100. The input device 103 may include, for example, buttons, switches, and dials that are installed on the housing of the information processing device 100. When the input device 103 detects user input, it generates an input signal corresponding to the detected user input.

[0030] (4) Communication Interface The communication interface 104 mediates communication between the information processing device 100 and other devices (external devices). The communication interface 104 supports any wireless or wired communication protocol and establishes a communication connection with other devices.

[0031] The communication interface 104 may be, for example, a connection port such as a USB (Universal Serial Bus) terminal, an optical audio terminal, or an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal.

[0032] Furthermore, the communication interface 104 may consist of communication devices for connecting to a network. For example, the communication interface 104 may be a communication card for wired or wireless LAN (Local Area Network), Bluetooth®, Wi-Fi®, or WUSB (Wireless USB). Alternatively, the communication interface 104 may be a router for optical communication, an ADSL (Asymmetric Digital Subscriber Line) router, or a modem for various types of communication. The communication interface 104 sends and receives signals, for example, to the Internet or other communication devices using a predetermined protocol such as TCP / IP. The network connected to the communication interface 104 is a network connected by wired or wireless means, such as the Internet or a home LAN.

[0033] Furthermore, the communication interface 104 can receive content signals from external devices (e.g., an internet distribution server), extract content data from the content signals, and generate content images based on the content data.

[0034] (5) Memory Memory 105 is composed of a storage medium such as semiconductor memory or a hard disk, and stores programs and data for processing by the information processing device 100, as well as content data. The data stored in memory 105 may include, for example, feature data for image recognition and speech recognition, which will be described later. Some or all of the programs and data described herein may be obtained from an external data source (for example, a data server, network storage, or external memory) without being stored in memory 105.

[0035] (6) Tuner The tuner 106 extracts and demodulates the content signal of the desired channel from the broadcast signal received via the antenna (not shown). The tuner 106 then outputs the demodulated content signal to the decoder 107.

[0036] (7) Decoder The decoder 107 decodes content data from the content signal input from the tuner 106. The decoder 107 may also decode content data from the content signal received via the communication I / F 104. A content image may be generated based on the content data decoded by the decoder 107.

[0037] (8) Display The display 108 has a screen made up of an LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), or CRT (Cathode Ray Tube), and displays images generated by the information processing device 100. For example, content images and UI images (item images 30, etc.) as described using Figure 1 can be displayed on the screen of the display 108.

[0038] (9) Speaker The speaker 109 has circuit elements such as a diaphragm and an amplifier, and outputs sound based on the output audio signal generated by the information processing device 100. The volume of the speaker 109 is adjustable.

[0039] (10) Remote control interface The remote control interface 110 is an interface that receives remote control signals (infrared signals or other radio signals) transmitted from a remote controller used by the user. When the remote control interface 110 detects a remote control signal, it generates an input signal corresponding to the detected remote control signal.

[0040] (11) Bus Bus 111 interconnects the camera 101, microphone 102, input device 103, communication interface 104, memory 105, tuner 106, decoder 107, display 108, speaker 109, remote control interface 110, and processor 112.

[0041] (12) Processor The processor 112 may be, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The processor 112 operates various functions of the information processing device 100, which will be described later, by executing programs stored in the memory 105 or other storage medium.

[0042] The hardware configuration of the information processing device 100 according to this embodiment has been described above. Note that the hardware configuration shown in Figure 2 is just one example, and this disclosure is not limited thereto. For example, the information processing device 100 does not have to have a camera 101, and an external device such as a smartphone may be used instead of a remote controller.

[0043] <2-2. Example of Functional Configuration> Figure 3 is a block diagram showing an example of the configuration of logical functions realized by the memory 105 and processor 112 of the information processing device 100 shown in Figure 2. Referring to Figure 3, the information processing device 100 includes a voice acquisition unit 120, a voice recognition unit 130, an application unit 150, a feature database (DB) 140, and a control unit 160. The control unit 160 includes a search control unit 162, a selection control unit 164, and a display control unit 166. Note that some of the functional blocks shown in Figure 3 may be realized in devices outside the information processing device 100 (for example, in a cloud computing environment). For example, the control unit 160 may have an external control function perform the control processing described below instead of performing it itself. Similarly, the voice recognition unit 130 may have an external voice recognition function perform the voice recognition processing described below instead of performing it itself.

[0044] (1) Audio acquisition unit The voice acquisition unit 120 acquires the audio signal generated by the microphone 102 as input audio. The voice acquisition unit 120 then outputs the acquired input audio to the voice recognition unit 130.

[0045] (2) Voice recognition unit The speech recognition unit 130 recognizes the user's voice based on the input voice received from the voice acquisition unit 120. The speech recognition unit 130 converts the input voice into text that represents its content and outputs the text to the control unit 160 or the application unit 150.

[0046] Furthermore, the speech recognition unit 130 may use the speech feature data stored in the feature DB 140 to identify the speaker (user) when recognizing the input speech received from the speech acquisition unit 120. The speech recognition unit 130 outputs the speaker identification result to the control unit 160 and the application unit 150.

[0047] (3) Feature Database The feature database 140 pre-stores speech feature data used for speech recognition by the speech recognition unit 130. The speech feature data may include, for example, speech feature quantities that represent the characteristics of each user's utterance.

[0048] Furthermore, the feature database 140 may store image feature data used for image recognition by the application unit 150. The image feature data may include, for example, known image feature quantities of a predetermined part, such as the user's hand or face. The image feature data may also include user-specific face image data. In addition, the feature database may be referenced or acquired from an external device, such as an external server, and may include feature data of other people.

[0049] (4) Application Department The application unit 150 executes various application functions of the information processing device 100. For example, the application unit 150 may execute functions such as program playback, electronic program guide (EPG) display, recording setting, external input switching, photo playback, video playback, music playback, and internet browsing. The application unit 150 outputs application images (which may include content images) and audio generated through the application functions to the control unit 160.

[0050] At least a portion of the application functions performed by the application unit 150 cooperate with the voice recognition unit 130 to accept voice input from the user. For example, the program playback function can change settings such as the channel and volume of television programs or internet-distributed programs, or play recorded programs, according to the voice content recognized by the voice recognition unit 130. The electronic program guide display function can change the channel and time slot of the electronic program guide to be displayed according to the voice content recognized by the voice recognition unit 130. The recording setting function can set the recording date and time and channel according to the voice content recognized by the voice recognition unit 130. The data of recorded programs can be stored in the memory 105 of the information processing device 100.

[0051] The external input switching function can switch external inputs according to the voice content recognized by the voice recognition unit 130. The photo playback function can play back photos taken on a specified date recognized by the voice recognition unit 130. The internet browsing function can perform internet searches using keywords recognized by the voice recognition unit 130.

[0052] Furthermore, the application unit 150 may receive images captured by the camera 101 as input. The application unit 150 can perform image recognition of the input image. In image recognition, for example, the application unit recognizes a predetermined part of the user's body by comparing image features extracted from the input image with image features pre-stored in the feature DB 140 for that predetermined part of the user's body. The predetermined part may include, for example, at least one of the user's hands and face. As a result, the application unit 150 can identify the user by facial recognition. The application unit 150 can also recognize predetermined gestures from hand movements. That is, at least a portion of the application functions performed by the application unit 150 accept gesture input from the user.

[0053] (5) Search Control Unit The search control unit 162 controls the process by which at least a portion of the application functions executed by the application unit 150 receive voice input from the user in cooperation with the voice recognition unit 130 and search for content desired by the user. For example, in the program playback function, when receiving voice input from the user and displaying a program, the search control unit 162 searches for channels (channel numbers or channel names), program names currently being broadcast or distributed on the internet, recorded programs, applications, etc., that at least include (partially match) the words (search words) recognized by the voice recognition unit 130. Recorded programs may be stored in memory 105 or in an external device such as a recorder connected via the communication I / F 104.

[0054] Furthermore, in the external input switching function, when receiving voice input from the user and switching to an external input, the search control unit 162 searches for an external input device whose name contains at least the word (search term) recognized by the voice recognition unit 130 (partially matching).

[0055] (6) Selection control unit The selection control unit 164 controls the selection of one piece of content to be executed from the search results of the search control unit 162. If there is only one search result, the selection control unit 164 simply selects that item. However, if there are multiple search results, it selects one piece of content according to predetermined criteria in order to select the content that is most likely to be requested by the user.

[0056] The predetermined criteria are priorities calculated based on, for example, a person (specifically, the viewing user) or time (specifically, the viewing time). The selection control unit 164 can calculate the priority of each searched content according to at least one of the viewing user or the current time, by referring to, for example, viewing history information obtained from the viewing history DB 172 or user preference information obtained from the preference DB 174. The viewing user can be identified by speech recognition, image recognition (face recognition), or by referring to user information.

[0057] More specifically, for example, the selection control unit 164 prioritizes channels / programs / genres that the viewer frequently watches (for example, channels / programs / genres that have been watched frequently in the most recent predetermined period) or programs and genres that the viewer frequently records, based on the viewer's viewing history or preference information identified by voice recognition or the like. Genres are classifications according to content, and examples include news, music, dramas, movies, variety shows, etc.

[0058] Furthermore, for example, the selection control unit 164 prioritizes channels / programs / genres that the viewer frequently watches or records at the current time.

[0059] Furthermore, for example, the selection control unit 164 may obtain information such as the viewer's favorite celebrities, singers, or characters from the preference information and prioritize content featuring these in the search results.

[0060] Furthermore, the selection control unit 164 may calculate priorities according to the combination and number of viewing users. For example, based on viewing history, it may identify channels / programs / genres that are frequently watched when only parents are present, channels / programs / genres that are frequently watched when only children are present, channels / programs / genres that are frequently watched when the whole family is together, etc., and calculate priorities accordingly.

[0061] Furthermore, even if the user identification information cannot be obtained, the selection control unit 164 may prioritize channels / programs / genres that are frequently watched at the current time, or programs / genres that are frequently recorded. Alternatively, the priority may be determined by combining the user's own viewing history information or preference information with the viewing history information and preference information of others, or by using only the viewing history information and preference information of others. Specifically, for example, among the search results, those that are judged to meet predetermined criteria based on the viewing history information of users throughout Japan may be further prioritized based on the user's own viewing history information and preference information.

[0062] Furthermore, the selection control unit 164 may prioritize channels, programs, or genres that were recently selected, based solely on viewing history, regardless of the person or time.

[0063] Furthermore, if the search results include recorded programs, the selection control unit 164 may set the priority of unviewed programs to be higher than the priority of programs that have already been viewed.

[0064] (7) Viewing history database The viewing history database 172 stores the viewing history of content (broadcast programs, recorded programs, internet-distributed programs, applications, etc.). The viewing history may include the viewing time of the content, the number of times the application has been used, information about the viewing user, the user's search history, and the selection history of search results. The viewing history database 172 may also store recording reservation information. Furthermore, the viewing history database 172 may be built within the information processing device 100, or it may be accessed or retrieved from an external device such as an external server. In addition, the viewing history database 172 may include information other than that of the information processing device 100 user.

[0065] (8) Preference Database The preference database 174 stores the user's preference information. This preference information may be obtained from responses to questionnaires or other surveys conducted with the user beforehand, or from the user's viewing history, program search history, recording reservation information, etc. For example, the information processing device 100 or an external device may determine the user's preference information using voice recognition or image recognition using a camera. The preference information database 174 may be built within the information processing device 100, or it may be accessed or retrieved from an external device such as an external server. Furthermore, the preference information database 174 may also contain information other than that of the user of the information processing device 100.

[0066] (9) Display Control Unit The display control unit 166 controls the display of images via the display 108. For example, the display control unit 166 displays application images input from the application unit 150 on the display 108. In addition, when search control is performed by the search control unit 162 and selection control is performed by the selection control unit 164, the display control unit 166 generates output images corresponding to the search results and selection results and displays them on the display 108.

[0067] Specifically, for example, when a program playback application is launched in the application unit 150, and in response to voice input from the user, the search control unit 162 controls the search for content, and the selection control unit 164 controls the selection of content to be played (executed) from the search results, the display control unit 166 controls the display of the selected content on the display 108 (i.e., executes the selected content). The display control unit 166 also generates an item image indicating the search results (the content name may be displayed as a read-aloud item) and displays it on the display 108. The item image may automatically disappear if there is no input from the user for a certain period of time after it is displayed, or the display time may be determined based on user settings or information from the preference information DB. The item image showing the name of the automatically selected content from the search results may be highlighted, or the content selected by the selection control unit 164 may not be displayed in the item image. The display control unit 166 may also display an image prompting input when switching content.

[0068] (10) Control Unit The control unit 160 can control the entire information processing device 100, in addition to controlling the search control unit 162, selection control unit 164, and display control unit 166 as described above. For example, in this embodiment, the control unit 160 controls the system to continue accepting voice input from the user when at least the voice detection by the microphone 102 and the voice recognition by the voice recognition unit 130 are ON in standby mode. If the content of the voice input from the user is related to the program playback function (for example, the content of the voice input is, "○○ [a predetermined call such as a system name], add 'NNN (channel name)'"), the control unit 160 turns on the power to the entire information processing device 100, including the display 108. The control unit 160 then starts the program playback application via the application unit 150 and controls the system to display the image of the content selected by the selection control unit 164 from one or more contents searched by the search control unit 162 based on the voice input on the display 108. In this case, as described above, the control unit 160 can also perform control to overlay item images showing the names of each searched content, and images prompting input when switching to other content, onto the content images.

[0069] Thus, even when the power to the information processing device 100 is turned off, the information processing device 100 can accept voice input from the user, and when voice input requesting content playback is detected, it can turn on the power and display the content requested by the user.

[0070] As mentioned above, voice input can also be received by a voice device (such as a smart speaker) connected to the information processing device 100. The voice device may transmit the detected user voice to a voice recognition server in the cloud. In this case, the information processing device 100 will automatically turn on in response to a control signal transmitted from the voice device or the server in the cloud, and will display the content requested by the user based on the voice recognition result.

[0071] The functional configuration of the information processing device 100 according to this embodiment has been described in detail above. Note that the functional configuration of the information processing device 100 shown in Figure 3 is just one example, and this embodiment is not limited thereto. For example, at least some of the functional configurations of the information processing device 100 shown in Figure 3 may be present in an external device (local terminal or server on the cloud) that communicates with the information processing device 100. In addition, the information processing device 100 in standby mode may be automatically powered on by the operation of any button located on a remote controller or the like, or it may be configured not to have a function to automatically power on based on voice recognition.

[0072] <<3. Examples>> Next, several examples of voice input that can be performed in the information processing device 100 according to this embodiment will be specifically described with reference to Figures 4 to 13.

[0073] <3-1. First Example: Voice Input "Channel Name"> First, as the first embodiment, we will describe an example of voice input where a channel name is entered as a voice command to request content playback by the user.

[0074] Figure 4 is a flowchart showing an example of the operation flow of the information processing device 100 when a channel name is input via voice according to the first embodiment.

[0075] As shown in Figure 4, first, when the information processing device 100 detects the user's voice (for example, "○○ [a predetermined call such as a system name], add 'NNN (channel name)'") via the microphone 102, the voice recognition unit 130 performs voice recognition (step S103). Here, we assume that the power state of the information processing device 100 is in a standby state where the display 108 is OFF but voice input can be received.

[0076] Next, the control unit 160 of the information processing device 100 turns on the power to the information processing device 100 (step S106). This causes the display 108 to light up. If the power to the information processing device 100 is already turned on and the display 108 is lit, the process in step S106 is skipped.

[0077] Next, the search control unit 162 searches for a channel corresponding to the channel name that was input by voice, based on the voice recognition result (step S109).

[0078] Next, if the search control unit 162 finds multiple channels, the selection control unit 164 selects one channel based on priority (step S112). For example, the selection control unit 164 may prioritize and select channels that are frequently viewed during the current time period based on the current time and viewing history. The selection control unit 164 may also identify the speaker (i.e., the viewing user) through speech recognition and calculate the priority of each searched channel based on the viewing user's viewing history and preference information. Alternatively, priority may be calculated based on the past user selection history or selection data from other users using similar functions. In this way, by selecting content according to priority based on people and time, it is possible to automatically select content that is likely to be requested by the user. Priority may also be determined considering settings made by the user for channels and content. Specifically, for example, the user may be able to specify the priority of channels and content, or processes may be performed to give higher priority to programs included in the viewing schedule list, content added to favorites, or programs scheduled for recording.

[0079] Next, the display control unit 166 performs control (channel selection) to display the video of the program currently being broadcast on the channel selected by the selection control unit 164 on the display 108 (step S115).

[0080] Next, the display control unit 166 generates an item image showing the search results and controls it to display on the display 108 (step S118). In step S118, it is also possible to generate an image prompting voice input or remote controller operation to switch channels and control it to display on the display 108. Figure 5 shows an example of the UI image display during voice input according to this embodiment.

[0081] As shown in the upper part of Figure 5, for example, when viewing some content (here, assuming the power of the information processing device 100 is ON), if the user says, "○○ (a predetermined call such as an agent name), show me 'NNN (channel name)'", the search control unit 162 searches for a channel corresponding to "NNN". It is also assumed that there are multiple channels that include the phrase "NNN" in their name, such as "NNN General", "NNN 1", "NNN AA", and "NNN Premier" (this may include terrestrial broadcasting, satellite broadcasting, cable television (wired broadcasting), and internet distribution content, etc.). In this case, the selection control unit 164 selects the channel that is most likely to be requested by the user from among the multiple channels (selection candidates) according to the priority based on the user's viewing history, etc. Furthermore, the user's utterance may be started without a predetermined call by operating a button located on the remote controller, or it may be started by operating a mobile terminal such as a smartphone. In addition, voice reception may be performed on the remote controller or smartphone side, or on the information processing device 100 side.

[0082] The display control unit 166 then controls the display screen of the display 108 to switch to the selected channel, as shown in the lower part of Figure 5. The display control unit 166 also displays item images 30 (30a to 30e) indicating the search results on the switched screen for a certain period of time. This makes it possible to assist the user with voice input when changing channels again if the automatically selected channel does not match the user's request. Here, the item images 30 may continue to be displayed until there is some instruction from the user, and the display time may not be fixed but may change dynamically based on the user's state.

[0083] Specifically, as shown in the lower part of Figure 5, the display control unit 166 displays item images 30 (30a to 30e) representing each channel in the search results, and an image 33 prompting voice input when changing channels, on the display 108. The display control unit 166 may display the item images 30a to 30e in order of priority, either from left to right or from top to bottom, or randomly across the entire screen of the display 108. In addition, instead of the image 33 prompting voice input, an image prompting input via a remote controller, smartphone buttons, touch panel, or user gestures may be displayed, or nothing may be displayed at all. The item image 30 may display the channel name in a predetermined display manner as a read-aloud item, or it may also display information related to the channel and broadcast program, such as the title information of the program currently being broadcast on that channel, the channel number, the channel mark, and the electronic program guide (EPG). The item image 30 may also display the broadcast status, showing how far the currently broadcasting program has been broadcast in relation to its total broadcast time. Furthermore, the display control unit 166 may clearly indicate that the currently selected channel is highlighted in a way that differs from other item images, or by displaying an icon such as "Selected," among the item images.

[0084] A "read-aloud item" is a phrase recommended for reading aloud, which helps to avoid difficult-to-recognize or ambiguous readings. In this embodiment, the channel name of item image 30 is the read-aloud item, but the read-aloud item can be any text information displayed in item image 30 (including text information displayed as image data). In item image 30, the display manner of the read-aloud item may be made different from other text, or illustrations of a speaker, mouth, or person speaking may be added to make it easier for the user to recognize that it is a read-aloud item. Furthermore, as shown in Figure 5, the display manner of the read-aloud item 301 and the display manner of the demonstrative pronoun portion 331 in the text explaining the read-aloud item in image 33 which prompts voice input can be made to correspond (for example, by making the text color, background color, or font the same), making it even easier for the user to recognize the read-aloud item.

[0085] Alternatively, image 33, which prompts voice input, may display explanatory text such as, "Please read aloud the item in the color ○○ (the display color of the item to be read aloud)." In addition, to make voice input more intuitive, image 332, such as an illustration of a microphone, an illustration of a mouth, or an illustration of a person speaking, may be displayed in image 333.

[0086] Next, if the name of another channel is spoken (step S121 / Yes), the information processing device 100 uses the selection control unit 164 to select the channel of the spoken name, and the display control unit 166 controls the display 108 to display the video of the selected channel (step S115). In this case as well, the item image showing the search results may be displayed again (step S118).

[0087] The display of UI images that support voice input, such as item images and images that prompt voice input as described above, may be displayed for a certain period of time (for example, a few seconds). In that case, for example, if a certain period of time has elapsed since channel switching and a timeout occurs (step S127 / Yes), the display control unit 166 will terminate the display of the item image (step S130). If the display control unit 166 was also displaying images that prompt voice input or remote controller operation to switch channels, the display of such images that prompt voice input or controller operation will also terminate in step S130. Furthermore, the display time of these images may be determined based on user settings or user information, or it may be determined dynamically based on the user's past selection information or current actions.

[0088] The final channel selection result, along with time information and user identification information, is stored in the viewing history DB 172 as viewing history and is used when the selection control unit 164 calculates priority during the next channel selection. By repeating this process, it becomes possible to more reliably select content that is likely to be requested by the user. Furthermore, the information stored in the viewing history DB 172 may be used, for example, to determine the display time of item images or the content of images prompting input, and information regarding the processes that determine these may also be stored in the viewing history DB 172.

[0089] <3-2. Second Implementation Example: Simultaneous Display of Currently Broadcasting Programs and Recorded Programs> In the first embodiment described above, the system selects a channel in response to a voice input of a channel name and displays the program currently being broadcast on that channel on the display 108. However, the disclosure is not limited to this, and the information processing device 100 may also select a recorded program of the selected channel. That is, the selection targets may include not only the currently broadcast program of the searched channel but also recorded programs, and the item image showing the search results may display both the currently broadcast program and the recorded program simultaneously. Furthermore, in addition to voice input of a channel name, the system may also search for both the currently broadcast program and the recorded program in response to a voice input of a program name, and these may be selected and displayed as item images showing the search results. The following will specifically describe the case in which the currently broadcast program and the recorded program are displayed simultaneously.

[0090] The operation process of this embodiment is similar to that of the first embodiment, which was mainly described with reference to Figure 4. In this embodiment, the difference is that in step S109, the search target includes not only currently airing programs but also recorded programs. For example, if a user voice-inputs the name of a channel, the search control unit 162 outputs the search results including recorded programs of the searched channel. Here, it is also possible to make the search target, search results, and item images include only recorded programs and exclude currently airing programs.

[0091] Figure 6 illustrates the case in this embodiment where currently airing programs and recorded programs are displayed simultaneously as search results. As shown in Figure 6, for example, when the user voice inputs "Show me 'NNN (channel name)'", the search control unit 162 searches for one or more channels that contain "NNN" as at least part of their name, and then searches for recorded programs for each of the searched channels. Recorded programs may be stored in memory 105, or in an external device (e.g., a recorder) connected to the information processing device 100. Furthermore, the recorded programs to be searched may be limited to those that have not been viewed, and unviewed recorded programs may be given a higher priority, or viewed programs may be given a lower priority.

[0092] The selection control unit 164 selects the content with the highest predetermined priority (for example, priority based on the user's viewing history, preference information, time, etc.) from the search results. For example, if the user makes a voice input while watching a currently airing program, the selection control unit 164 selects the currently airing program on a channel that the user frequently watches and switches the display on the display 108.

[0093] Furthermore, as shown in Figure 6, the display control unit 166 displays the item images 30 (30a, 30f, 30g, 30b, 30c) indicating the search results, for example, in order of priority. Since the search results also include recorded programs, the display control unit 166 may display a "recording mark" on the target item image 30 (see item images 30f and 30g in Figure 6) or make the display of the item image indicating a recorded program different from the others, in order to clearly indicate that it is a recorded program and not a program currently being broadcast, even if it is on the same channel.

[0094] Furthermore, the display of items to be read aloud may be made clearer by changing the display manner or by adding illustrations of speakers, etc., as in the first embodiment. In this case, if channel names are duplicated among the item images 30, it is not possible to distinguish them by reading the channel names aloud, so the user may be prompted to input the program title or the identification number (not shown) attached to the item image 30 as the item to be read aloud. For example, in the example shown in Figure 6, the display manner of the program title 302 is changed in the item images 30f and 30g with duplicate channel names to clearly indicate that they are items to be read aloud.

[0095] <3-3. Third Example: Voice Input "Current Program"> Furthermore, even when voice input specifies not the channel name, but the entire or a part of the currently receivable content, the information processing device 100 can automatically select and display channels based on priority according to the person and time.

[0096] The operation process of this embodiment is similar to that of the first embodiment, which was mainly described with reference to Figure 4. When an audio input is made that specifies all or part of the currently receivable content, such as "current program," rather than the name of a channel, in step S109, the search control unit 162 searches for currently receivable content (terrestrial broadcasting, satellite broadcasting, cable television (wired broadcasting), and internet distribution content, etc.), and in step S112, the selection control unit 164 selects a channel (program) according to the priority of the channel (or program) calculated based on, for example, the viewing history and preference information of the recognized viewer, user information, user settings, and information of other users.

[0097] Figure 7 illustrates an example of the display when voice input regarding the current program is received according to this embodiment. As shown in Figure 7, for example, in response to voice input from a viewer such as "Show me the current program," the information processing device 100 automatically switches the display screen of the display 108 to the selected channel according to priority (or automatically turns on the power if it is off) and displays item images 30 indicating other candidate channels in order of priority. The information processing device 100 may also display an image 35 prompting input when selecting another channel.

[0098] Furthermore, a voice input specifying all or part of currently receivable content, such as "the current program," is not limited to broadcast programs but may also include internet-distributed content. In other embodiments described herein, internet-distributed content may also be included in the search targets of the search control unit 162. The voice input may also specify a transmission means, such as "terrestrial broadcasting" or "satellite broadcasting" (more specifically, a voice input such as "a program currently being broadcast on terrestrial broadcasting" or "a satellite broadcasting program"), in which case currently receivable programs will be searched through the corresponding transmission means.

[0099] <3-4. Fourth Example: Voice Input "Genre"> Furthermore, even when the genre of a program (an example of content) is input by voice, the information processing device 100 can automatically select and display a program that is likely to be requested by the user, according to priority based on the person and time.

[0100] Program genres include, for example, movies, dramas, variety shows, music, news, and documentaries. The information processing device 100 searches for programs corresponding to the genre entered by the user via voice input and, as in the above embodiments, plays the selected programs based on priority according to the user's viewing history and preference information (it may also automatically turn on the power if it is off before displaying the program). It may also display the search result items in order of priority. Users may set their preferred genres in advance to perform more detailed genre searches or search for content with multiple genre attributes, such as a documentary about music. The information processing device 100 may also display images prompting input when selecting other programs, as in the above embodiments. In addition, while program genres have been given as an example here, content genres are not limited to this example and may include, for example, videos, music, images, applications, or content genres other than video content, such as jazz, rock, and ballads.

[0101] The search scope is not limited to currently aired programs, but also includes a wide range of currently viewable content such as recorded programs (which can be limited to those not yet watched, or recorded programs that have already been watched can be given lower priority), internet streaming programs, VOD (Video On Demand) items, and live streaming videos.

[0102] Each item image displayed as a search result includes information such as whether the content is a recorded program or an internet-streamed program, as well as the channel number, channel name, and program title.

[0103] <3-5. Fifth Example: Voice Input for Recommended Content, etc.> Furthermore, even when abstract voice input such as asking for recommended content is received, the information processing device 100 can automatically select and display programs according to priorities based on the person, time, etc. The search targets include a wide range of currently viewable content, such as programs currently being broadcast, recorded programs, and internet-distributed content.

[0104] Specifically, if the user voice-inputs "Show me recommendations," the information processing device 100 will, in the same manner as in each of the embodiments described above, search for recommended content from the currently viewable content based on the user's viewing history and preference information (for example, programs featuring the user's favorite actors, programs in the user's favorite genre, etc.), and play the selected content according to priority (for example, priority based on people or time; for example, recorded programs that have already been viewed may be given a lower priority). (If the power was off, the device may automatically turn on the power before playing.) The information processing device 100 will then, in the same manner as in each of the embodiments described above, display the item images showing the search results in order of priority (indicating the items to be read aloud), and may also display an image prompting the user to input when switching to other content.

[0105] <3-6. Sixth Example: Displaying Sequential Content> Furthermore, the information processing device 100 can automatically select sequential content, such as TV dramas or movie series, based on voice input from the user, according to the viewing status of the content.

[0106] For example, if a user voice-inputs the name of a sequentially ordered piece of content, the information processing device 100 searches for the target content from currently viewable content (broadcast programs, recorded programs, and internet-distributed content, etc.). If the searched content consists of multiple sequentially ordered pieces of content (multiple pieces of content with the same title are found), the information processing device 100 lists them in ascending order of their numbers, selects the piece with the lowest number (an example of priority) excluding content that has already been viewed or is considered nearly finished (e.g., up to the end credits), and controls playback on the display 108. By including not only unviewed content but also content that was interrupted during viewing in the selection of content to be executed, it becomes possible to continue playback from where it left off or from the beginning without excluding content that was partially viewed. The information processing device 100 may also prioritize the selection of content that was partially viewed. Furthermore, if the information processing device 100 can identify a viewing user through voice recognition or the like, it can refer to the viewing history of that viewing user and refer to the viewing status of that viewing user regarding the searched content to realize personalized playback control.

[0107] Figure 8 illustrates an example of display when the title of sequential content, such as a drama, is entered via voice input according to this embodiment. As shown in Figure 8, for example, when a user makes a voice input such as "Show me ○○ (drama title)", the search control unit 162 of the information processing device 100 searches for content with the title "○○" from the currently available programs.

[0108] Next, the selection control unit 164 lists the searched content in ascending order, for example, by number (episode number, series number, etc.), and selects the content with the lowest number (for example, "Drama Episode 10" in the example shown in Figure 8), excluding programs that have already been watched or that are almost finished, such as up to the end credits. Then, the display control unit 166 controls the automatic playback (i.e., execution) of the selected program on the display 108 (if the display on the display 108 is OFF, it may be automatically turned ON and then displayed). Also, for example, if there are multiple drama series whose titles contain the keyword "○○", the content with the highest priority may be selected, and the series of each drama may be displayed as the item image. In that case, if the user specifies another drama series, the content with the highest priority within that drama series may be selected and played, and then other episodes within the series may be displayed as item images.

[0109] Furthermore, as shown in Figure 8, the display control unit 166 may also display item images 40 (40a to 40e) indicating the name of the searched content in response to the user's voice input, and an image 42 prompting the viewer to use voice input when selecting other searched content, on the playback screen of the selected content. This makes it possible to provide a voice input UI that responds to user requests as much as possible.

[0110] The information processing device 100 may highlight the item image representing the currently running content from the item images 40a to 40e shown in Figure 8 by changing its color or other means. The information processing device 100 may also display information indicating the viewing status of each content, such as a bar showing the last playback position (viewed position), along with the item images 40a to 40e. This allows the viewing user to intuitively understand the viewing status of each content. In addition, along with the bar display, icons indicating commands that can be accepted regarding playback control, such as "Continue playback / Start playback," may be displayed. Furthermore, the information processing device 100 may display a "NEW" mark or the like for unviewed content, as shown in Figure 8.

[0111] Furthermore, item image 40 may display channel information, the name of the content (program title, etc.), a summary of the content, information indicating whether the content is a currently airing program, a recorded program, a VOD item, or internet-distributed content, etc., or it may display a still image or a video thumbnail. Channel and content information, as well as still images and video thumbnails, may be obtained from the distribution source of each content, or from a different source such as a program information transmission server. In addition, the video thumbnail of the content displayed in item image 40 may be obtained and played from a video distribution server or memory 105, etc., before the user selects the content. That is, for example, a video thumbnail of a broadcast program may be obtained from a VOD server, and a video recorded from the broadcast program may be played within item image 40 as the video thumbnail of the broadcast program. The still image or video thumbnail may use the beginning of the content, any position within the content may be used, or a video image or other image specifically for thumbnails may be used.

[0112] Additionally, if all episodes are available for viewing via VOD items or internet streaming content, or depending on the recorded content, icons indicating voice-activated commands such as "Play latest episode" or "Play from episode 1" may be displayed.

[0113] Furthermore, displaying information indicating the viewing status, such as a bar showing the playback position, displaying a still image or video thumbnail, and displaying an icon indicating a voice-enabled command, as described above, is not limited to this embodiment but can also be applied to the first to fifth embodiments described above. In addition, displaying information indicating the elapsed broadcast time of the content (broadcast status), as explained in the first embodiment, can also be applied to each embodiment.

[0114] <3-7. Seventh Embodiment: Voice Input Specifying External Input> In the embodiments described above, we have described cases in which content is searched and selected in response to voice input by the user. However, this disclosure is not limited thereto, and the information processing device 100 can also search for external input in response to voice input by the user.

[0115] The information processing device 100 can receive video and audio data from external devices such as recorders, game consoles, PCs, digital cameras, and smartphones connected via the communication interface 104, and output and play it back through the display 108 and speaker 109. Multiple external devices can be connected to the information processing device 100 (or the information processing device 100 can be connected to multiple external devices via a distributor). When one or more external devices are connected to the information processing device 100, the user can select or switch between external devices using voice input. The search process and display of the voice input UI image by the information processing device 100 in this case will be explained below with reference to Figures 9 and 10.

[0116] (Action processing) Figure 9 is a flowchart illustrating an example of the operation process when an external input is specified by voice input in this example. Here, we will explain the operation process when the information processing device 100 is in a standby state in which voice detection by at least the microphone 102 is possible and the display 108 is OFF, and recognizes a predetermined call from the user (calling an agent) and a predetermined search term (here, for example, "external input").

[0117] As shown in Figure 9, first, when the information processing device 100 detects the user's voice (voice input) (step S303), it may turn on the power of the information processing device 100 if it was OFF (step S306). At this time, the display 108 may remain OFF (not selected, therefore hidden). If the user's voice input is performed by an external device such as a voice terminal, the external device such as the voice terminal may be configured to turn on the power of the connected information processing device 100 when it detects a predetermined voice input from the user (for example, calling an agent and uttering a search term). If the power of the information processing device 100 is already ON, or if any content is already displayed on the display 108, the power status will remain as is.

[0118] Next, if the word recognized from the detected speech is "external input", the search control unit 162 of the information processing device 100 searches for an external device connected to the information processing device 100 (step S309).

[0119] Next, the display control unit 166 of the information processing device 100 lists item images 45 (45a to 45e) indicating the names of external devices (or external inputs) searched by the search control unit 162, according to priority based on the user's viewing history, etc., and displays them on the display 108 (step S312), as shown in Figure 10. Figure 10 is a diagram showing an example of a screen displaying search results when an external input is specified by voice input according to this embodiment.

[0120] As shown in Figure 10, search results are displayed on the display 108 in response to, for example, a voice input from the user such as "external input". The search results may be sorted in descending order of priority, or they may be displayed randomly across the entire screen. Priority may be calculated by the display control unit 166 based on, for example, a person or time. More specifically, for example, the display control unit 166 may refer to the viewing history and calculate a higher priority for external devices that are frequently used at the current time, or, if a viewing user is recognized, calculate a higher priority for external devices that are frequently used by that viewing user.

[0121] In the case of external input device search, unlike the content search embodiments described above, the control unit 160 does not perform the automatic selection and execution of the external input (such as starting the external device) from the search results in a single sequence. Instead, it may first display the search results on the display 108 and allow the user to select the external input to be selected and executed. Therefore, for example, if the external device is not started, as shown in Figure 10, nothing will be displayed on the background screen when the item image 45 is displayed. Also, if some content is already being played on the display 108, the item image 45 may be displayed while continuing to display that content.

[0122] Furthermore, the names displayed in item image 45 are recommended reading items for voice recognition, and it is desirable that they be easy to recognize and eliminate ambiguity as much as possible. For example, the standard name of the external input ("HDMI1 / 2 / 3") or a name corresponding to the device type of the external device (recorder1 / 2 / 3, player1 / 2 / 3, tuner1 / 2 / 3, device1 / 2 / 3, etc.) are expected. These names may be determined by the communication I / F 104 or by the control unit 160. In addition, the display control unit 166 may display the name of the CEC (Consumer Electronics Control) device (product name, etc.) along with the reading items as detailed information of the external device in item image 45. The display control unit 166 may also clarify the reading items in item image 45 by changing the display manner, such as highlighting the reading items, or it may display an icon image that indicates the attribute of the external device (for example, an icon indicating a recorder). Furthermore, the display control unit 166 can also display icons such as a speaker, a mouth, or a person speaking near the items to be read aloud, allowing the user to intuitively understand which entries are items to be read aloud.

[0123] Furthermore, the display control unit 166 may display an image on the display 108 prompting the user to select an external device from the displayed search results (item images) (step S315). Specifically, for example, as shown in Figure 10, an image 47 is displayed showing a guidance message such as "Please say the item you wish to select." Here, as shown in Figure 10, for example, by making the text parts of the guidance message, such as "item" and "item to select," the same as the display style of the read-aloud item displayed in the item image 45 (for example, using the same font, text color, background color, etc.), the read-aloud item is further clarified, making it possible to avoid reading aloud names that are difficult to recognize or ambiguous voice input.

[0124] Then, if the name of the external device is spoken (step S318 / Yes), the display control unit 166 of the information processing device 100 displays the content input from the spoken external device on the display 108 (step S321). In other words, the control unit 160 controls the external input to switch to the external device (external input) selected by the user. Also, if the power of the target external device is OFF at this time, the control unit 160 controls the power of the external device to ON (startup control).

[0125] Furthermore, even after the user has selected an external device and the content input from that external device has been displayed on the display 108, the item image 45 showing the search results and the image 47 prompting voice input may also be displayed on the display 108. This can assist the user when switching external devices again using voice input.

[0126] (Example of audio input "HDMI") The above describes the selection of external inputs by user voice input. Even when the user's voice input is a more specific specification of an external device or external input path, such as "HDMI" or "recorder," and there are multiple options (e.g., multiple HDMI inputs or recorders exist), the information processing device 100 displays item images showing the search results (multiple HDMI inputs or recorders) on the display 108, similar to the case of external input devices described with reference to Figure 10. Additionally, an image prompting the user to select an external device may be displayed on the display 108.

[0127] Specifically, for example, if a user provides voice input specifying an HDMI input, and the search control unit 162 searches and finds multiple HDMI inputs (e.g., "HDMI1", "HDMI2", "HDMI3", and "HDMI4"), the display control unit 166 lists these in order of priority according to, for example, the person (viewing user) or time (current time), and displays item images representing these (e.g., item images representing the read-aloud items such as "HDMI1", "HDMI2", "HDMI3", and "HDMI4") on the display 108. To clearly indicate the read-aloud items, the display mode may be changed, or icons such as speakers may be displayed as well. At this point, if HDMI selection and execution (startup of the HDMI-connected external device) have not yet occurred, the content that was already displayed at the time of voice input may continue to be displayed on the display 108 as a background image, or HDMI selection and execution may be performed based on priority, and the content being played on the external device or the menu screen (home screen) of the external device may be displayed on the display 108. If an external device is not activated during voice input, the selected external device may be activated, or it may not be activated, and when the search result item images are displayed on display 108, no background image may be displayed.

[0128] Furthermore, the display control unit 166 may also display an image prompting selection, such as "Please speak the item you wish to select," similar to the example shown in Figure 10. Here, similar to the example shown in Figure 10, matching the display of the text prompting voice input with the items to be read aloud, or displaying a microphone icon or the like near the text prompting voice input, makes it possible to more reliably prompt voice input using the items to be read aloud.

[0129] Then, when the user makes an audio input (selection of an external input) such as "HDMI1", "HDMI2", "HDMI3", or "HDMI4" based on the item image 45, the display control unit 166 switches to the selected external input. Specifically, the display control unit 166 controls the display 108 to display the content transmitted from the selected external input destination. In this case, if the power of the external device that is the external input destination is OFF, the information processing device 100 turns on the power of the target external device (startup control) and then acquires the content from the external device. The content acquired from the external device here may be the menu screen of the external device, etc.

[0130] <3-8. Eighth Example: Voice Input for Application Startup, etc.> Next, we will describe voice input when launching an application installed on the information processing device 100. For example, we will assume that various applications used to enjoy internet-distributed content (including applications provided by content distribution companies) are installed on the information processing device 100. In this specification, "application" will be abbreviated as "app" in some places below.

[0131] For example, when a user makes a voice input requesting the launch of an application or processing by an application, or by providing the name of an application, the information processing device 100 uses the search control unit 162 to search for a launchable application, and the display control unit 166 displays the search results on the display 108. The voice input may be not only the name of a specific application, but also a function name such as "photo app," or simply "app." Figure 11 shows an example screen displaying the search results when voice input is made regarding the launch of an application, etc., according to this embodiment.

[0132] As shown in Figure 11, in response to voice input from the user, such as "Show apps," the search results (item images 50a to 50e) retrieved by the search control unit 162 are displayed on the display 108 under the control of the display control unit 166. The search results may be sorted in order of priority, or they may be displayed randomly across the entire screen. Priority may be calculated by the display control unit 166 based on, for example, a person or time. More specifically, for example, the display control unit 166 may refer to the viewing history and calculate a higher priority for applications that are frequently used at the current time, or, if a viewing user is recognized, calculate a higher priority for applications that are frequently used by that viewing user. In addition, item images 50a to 50e may display the name of the application, an icon indicating the commands (options) that the application can accept, an icon of the application itself (for example, an icon indicating the application on the menu screen of the information processing device 100), or an icon indicating the attributes of the application (for example, a headphone icon in the case of a music playback application).

[0133] In this embodiment of application search, unlike the content search embodiments described above, the control unit 160 does not perform the automatic selection and execution of an application (such as launching an application) from the search results in a single continuous process. Instead, it may first display the search results on the display 108 and allow the user to select and execute the application, or, as in the embodiments, it may perform a series of processes to automatically select and execute one application based on priority. Therefore, for example, if the display 108 is OFF (no power is supplied), as shown in Figure 11, nothing may be displayed on the background screen when the item image 50 is displayed. On the other hand, if some content is already being played on the display 108, the item image 50 may be displayed while continuing to display that content.

[0134] Furthermore, the display control unit 166 may also display an image 52 on the display 108 prompting the user to select an application, such as "Please speak the item you wish to select," as shown in Figure 11. Here, as shown in Figure 11, by matching the display style of the text prompting voice input shown in image 52 with the text to be read aloud (e.g., application name) shown in item image 50, or by displaying a microphone icon or the like near the text prompting voice input shown in image 52, it becomes possible to more reliably prompt voice input using the text to be read aloud.

[0135] Then, when the user voice-inputs an application name (selects an application) (selects), the control unit 160 launches (executes) the selected application and displays the application screen on the display 108. If an application has already been automatically selected and executed, the item image 50 will display an application that is not currently running, and the user may select a different application based on this.

[0136] Furthermore, even after the user has selected an application, launched the application, and the application screen (content) has been displayed on the display 108, the item image 50 showing the search results and the image 52 prompting voice input may also be displayed on the display 108. This can assist the user when switching applications again using voice input.

[0137] <3-9. 9th Example: "Recording / Viewing Reservation, Content Deletion" from Power Off> The information processing device 100 according to this embodiment can perform recording reservations, viewing reservations, and content deletions according to the user's voice input, even when the display 108 is OFF. This will be explained in detail below with reference to Figures 12 and 13.

[0138] (Recording / Viewing Reservation) Figure 12 is a flowchart showing an example of the operation flow for recording or viewing reservation when the power is off according to this embodiment. Here, "when the power is off" refers to a standby state in which at least voice detection by the microphone 102 and voice recognition by the voice recognition unit 130 are possible (power is supplied to the processor 112 and microphone 102), and the display 108 is OFF (no power is supplied to the display 108).

[0139] As shown in Figure 12, first, the information processing device 100 detects spoken language related to recording / viewing reservations, such as "Please record ○○ (program title)" or "Please schedule viewing of ○○ (program title)" (step S503). The speech recognition unit 130 of the information processing device 100 may recognize subsequent spoken language when a predetermined call is made by the user, such as calling an agent, and identify commands such as recording reservations and viewing reservations.

[0140] Next, the control unit 160 controls the power supply of the information processing device 100 to the ON state, except for the display 108 (step S506).

[0141] Next, the application unit 150 executes a recording or viewing reservation based on the speech recognition result from the speech recognition unit 130 (step S509). The recording / viewing reservation information is stored, for example, in memory 105. The application unit 150 may also make a recording / viewing reservation for a user (associating the user's information as the reservation holder) if it can determine the speaker (user) through speech recognition or the like.

[0142] Thus, in this embodiment, it is possible to perform recording / viewing reservations by voice input without turning on the power to the display 108 or performing operations using the display screen, allowing the user to quickly perform recording / viewing reservations without waiting for the display 108 to light up. The information processing device 100 may also provide voice feedback to the user using the speaker 109 when it receives a recording / viewing reservation (for example, playing a response voice such as "Recording / viewing reservation has been made"). Furthermore, recording / viewing reservations may be made so that the actual recording or viewing process is performed by an external device connected to the information processing device 100.

[0143] Then, the control unit 160 turns off the power to the information processing device 100 (step S512). Here, turning off the power means that the power supply is in a state where at least the functions for executing recording / viewing reservations and voice recognition functions are possible (i.e., sufficient power is supplied to execute these functions).

[0144] (Content removed) Figure 13 is a flowchart showing an example of the content deletion process when the power is turned off according to this embodiment.

[0145] As shown in Figure 13, first, the information processing device 100 detects spoken language related to deleting a recorded program, such as "Delete ○○ (title of the recorded program)" (step S603). The speech recognition unit 130 of the information processing device 100 may recognize subsequent spoken language when a predetermined call is made by the user, such as calling an agent, and identify a command such as deleting content.

[0146] Next, the control unit 160 controls the power supply of the information processing device 100 to the ON state, except for the display 108 (step S606).

[0147] Next, the application unit 150 executes the deletion of the specified recorded program based on the voice recognition result from the voice recognition unit 130 (step S609). The recorded program data is stored in memory 105, for example. The application unit 150 can also control the deletion of recorded programs stored in an external device connected to the information processing device 100 if the recorded program data is stored in the external device.

[0148] Thus, in this embodiment, it is possible to delete recorded programs by voice input without using the display 108 or performing operations using the display screen, and the user can quickly delete recorded programs (content) without waiting for the display 108 to light up. The information processing device 100 may also provide voice feedback to the user using the speaker 109 when it receives a request to delete a recorded program (for example, playing a response voice such as "○○ (title of the recorded program) has been deleted").

[0149] Then, the control unit 160 turns off the power to the information processing device 100 (step S612). Here, turning off the power means that the power supply is in a state where at least the voice recognition function is possible (i.e., sufficient power is supplied to perform such a function).

[0150] <3-10. Supplement> Each of the embodiments described above may be implemented in combination.

[0151] For example, when a channel is automatically selected by voice input of a channel name as described in the first embodiment, and an item image 30 is displayed as a search result as shown in Figure 5, voice input of the program name displayed in the item image 30 may also be accepted. In this case, the information processing device 100 searches for content that matches the voice-inputted program name from the currently viewable content. If the searched content consists of multiple sequential contents, the information processing device 100 lists them in ascending order, for example, as described in the sixth embodiment, and selects the content with the lowest number to automatically play, excluding programs that have been viewed or that are judged to be almost finished, such as up to the end credits. Furthermore, by combining the search and selection process for currently broadcast programs and recorded programs in response to voice input of a program name, as described in the second embodiment, with the search and selection process for currently receiveable content, including internet-distributed content, in response to voice input specifying all or part of the currently receiveable content, as described in the third embodiment, a search and selection process for currently receiveable content, including currently broadcast programs, recorded programs, and internet-distributed content, may be performed in response to program name input.

[0152] Furthermore, while the content searched and executed in this description has primarily been based on video content such as broadcast programs, the type of content is not limited as long as it can be executed by the equipment and devices realized by the present invention. For example, the content to be played may be audio content (e.g., music), and the music may be played by an application executable on the information processing device 100. Also, the target of the search based on priority may be audio content or an application that plays audio content. In those cases, one music or application is selected based on the same procedure as in any of the above embodiments or a combination thereof, and an item image including the music or applications that were not selected as options is displayed on the display 108. The display 108 may display the selected content, such as the album art image (jacket image) of the music or the UI image of the application. The channel described in the above embodiment may be a channel such as a radio or music distribution station that broadcasts audio content such as music. In the case of other types of content such as still image content or web pages, processing can be done using the same procedure.

[0153] <<4. Summary>> While preferred embodiments of the present disclosure have been described in detail above with reference to the attached drawings, the present technology is not limited to such examples. It is clear to any person with ordinary skill in the art of the present disclosure that various modifications or alterations may be conceived within the scope of the technical idea described in the claims, and these will naturally be understood to fall within the technical scope of the present disclosure.

[0154] For example, a computer program can be created to enable the information processing device 100 to perform its functions, using hardware such as the CPU, ROM, and RAM built into the information processing device 100. A computer-readable storage medium containing this computer program is also provided.

[0155] Furthermore, the effects described herein are merely descriptive or illustrative and not limiting. In other words, the technology relating to this disclosure may produce other effects that will be apparent to those skilled in the art from the description herein, in addition to or in lieu of the effects described herein.

[0156] Furthermore, this technology can also be configured as follows. (1) A search process that searches for channels or content based on words recognized from the user's spoken audio, A process to select one channel or content from among multiple channels or content obtained by the aforementioned search process, A process of displaying the selected content or content broadcast on the selected channel on the display unit, Furthermore, the receiving device includes a control unit that performs a process of displaying item images representing multiple channels or content obtained by the search process as options on the display unit. (2) The receiving device according to (1), wherein the control unit displays an image on the display unit prompting voice input when selecting the plurality of channels or content. (3) The receiving device according to (2), wherein the image prompting voice input includes an explanatory text prompting voice input for the item to be read aloud displayed in the item image. (4) The receiving device according to (3), wherein the explanatory text of the image prompting voice input includes characters in a display format that matches the display format of the read-aloud item displayed in the item image. (5) The control unit, A receiving device according to any one of items (1) to (4) above, which selects the channel or content according to at least one of the user's viewing history or preference information, or priority based on time information. (6) The control unit, The receiving device according to (5), which performs a process of displaying item images representing multiple channels or content obtained by the search process in order of the highest priority. (7) The content is a broadcast program, a recorded program, or content distributed via the Internet, as described in any one of items (1) to (6) above, and is a receiving device. (8) The receiving device is, A receiving unit that receives broadcast programs transmitted from a broadcasting station, A communications unit that receives content distributed via the internet, The receiving device described in (7) above, further comprising the above. (9) The receiving device described in (3) or (4) above, wherein the item to be read aloud is a channel name or a content name. (10) The control unit, The receiving device according to any one of items (1) to (9) above, wherein if the aforementioned term is related to an external input or application, the device displays item images representing the standard name of the searched external input, the name of the external device to which the external input is received, or the name of the application as options on the display unit, and then displays the image of the external input or application selected by the user's voice input on the display unit. (11) The control unit, The receiving device according to any one of items (1) to (10) above, which, if the power to the display unit is OFF, turns on the power to the display unit and then performs the process of displaying the selected content or the content being broadcast on the selected channel. (12) The control unit, The receiving device according to any one of items (1) to (11) above, wherein if the aforementioned phrase is a phrase related to the name of a channel or program, it searches for a channel or program, selects the program with the highest priority based on person or time from the broadcast programs and recorded programs corresponding to the searched channel or program, and displays the selected program on the display unit. (13) The control unit, The receiving device according to (12), wherein the priority of programs already viewed by the user is set lower than the priority of unviewed content. (14) The control unit, The voice reception process is initiated by a signal from an external control terminal. The voice reception processing is performed by a microphone on an external operating terminal, as described in any one of items (1) to (13) above. (15) The receiving device according to (14), wherein the external operating terminal is a remote controller or mobile terminal having a physical or virtual key for performing the operation to initiate the voice reception process. (16) The control unit, The receiving device according to any one of items (1) to (15) above, which, if the aforementioned phrase specifies an external device that is not currently running, performs the process of starting the external device and displaying the home screen of the external device on the display unit. (17) The receiving device according to any one of items (1) to (16) above, wherein the content is audio content, and the process of displaying the selected content on the display unit is the process of displaying an image representing the audio content on the display unit. (18) The control unit, A receiving device according to any one of items (1) to (17) above, which performs the process of displaying the item image on the display unit for a certain period of time. (19) The control unit, A receiving device according to any one of items (1) to (18) above, which displays information indicating the broadcast status or viewing status of each content in the aforementioned item image. (20) The processor, Searching for channels or content based on words recognized from the user's spoken language, Select one channel or content from among the multiple channels or content obtained through the aforementioned search, The selected content or content broadcast on the selected channel is displayed on the display unit, Furthermore, the display unit will display item images representing multiple channels or content obtained through the search as options, A control method including [Explanation of Symbols]

[0157] 100 Information Processing Devices 101 Camera 102 Microphone 103 Input Devices 104 Communication Interface (I / F) 105 memory 106 Tuner 107 Decoder 108 displays 109 Speakers 111 Bus 112 processors 120 Voice acquisition unit 130 Voice Recognition Unit 140 Feature Database 150 Application Department 160 Control Unit 162 Search Control Unit 164 Selection Control Unit 166 Display Control Unit 172 Viewing History Database 174 Preference Database

Claims

1. A search process is performed to find one of the channels or contents based on the words recognized from the spoken audio. From among the multiple channels or multiple contents obtained through the search, one is selected according to priority based on viewing history, user preference information, or time information. The circuit includes a display that shows item images representing multiple channels or multiple contents obtained by a search, The item image includes a text item displayed on the display as text information for voice input corresponding to any of the multiple channels or multiple contents, The aforementioned item image includes at least one of a thumbnail image, a progress bar, and information indicating the broadcast status or viewing status. Receiving device.

2. The receiving device according to claim 1, wherein the circuit displays on the display an image prompting voice input of identification information associated with the item image.

3. The receiving device according to claim 2, wherein the image prompting voice input includes explanatory text displayed in the same display manner as the corresponding read-aloud item.

4. The circuit displays on the display content corresponding to one selected from a plurality of channels or a plurality of contents. The aforementioned content includes at least one of broadcast programs, recorded programs, VOD (Video On Demand) items, and live internet streaming channels. The receiving device according to claim 3.

5. The circuit processes data obtained from the VOD item or the content distribution server associated with the live internet streaming channel. The aforementioned data includes at least one of the following: program title, thumbnail, category, or user recommendation information. The receiving device according to claim 4.

6. The receiving device according to claim 5, wherein the circuit displays the data on the item image.

7. The aforementioned circuit is The system detects spoken audio while the display is in standby mode with its power off. Turn on the power to the aforementioned display. The receiving device according to claim 1.

8. The receiving device according to claim 7, wherein, after detecting the voice spoken in the standby state, the circuit displays the content corresponding to the selected content, or the content being broadcast on the selected channel.

9. The receiving device according to claim 8, wherein if a command identified by speech can be executed without using the display, the circuit executes the command without turning on the power to the display.

10. The receiving device according to claim 1, wherein the circuit highlights the item image representing the currently selected channel or content so as to distinguish it from other item images.

11. Search for channels or content based on words recognized from spoken speech. Multiple item images representing the aforementioned channels or content, including an item image for voice input to be read aloud, are displayed on the display as options. The display is equipped with a circuit that displays an image prompting voice input of the items to be read aloud, The explanatory text for the image prompting voice input includes characters displayed in the same font type as the corresponding text-to-speech item. The aforementioned text-to-speech items are distinguished by a different font style from the non-text-to-speech information within the item image. Receiving device.

12. The receiving device according to claim 11, wherein the circuit selects one or more of the contents from a plurality of channels according to priority based on viewing history.

13. The receiving device according to claim 11, wherein the circuit selects one or more of the contents from a plurality of channels according to a priority based on user preference information and time information.

14. The receiving device according to claim 12, wherein the circuit displays the item images representing a plurality of channels or a plurality of contents obtained through the search in ascending order of priority.

15. The receiving device according to claim 13, wherein the circuit displays the item images representing a plurality of channels or a plurality of contents obtained through the search in ascending order of priority.

16. The receiving device according to claim 11, wherein the content is one of a broadcast program, a recorded program, or content distributed via the Internet.

17. The aforementioned items to be read aloud include the channel name, If the channel names of the aforementioned item images are the same, an identification number is assigned to each of the aforementioned item images. The receiving device according to claim 11.

18. The aforementioned circuit is The system detects spoken audio while the display is in standby mode with its power off. Turn on the power to the aforementioned display. The receiving device according to claim 11.

19. The receiving device according to claim 18, wherein, after the power supply is turned on, the circuit displays the content corresponding to the selected content, or the content being broadcast on the selected channel.

20. A method for operating a receiving device, This involves performing a search process to find one of the channels or contents based on words recognized from spoken audio, and From among the multiple channels or multiple contents obtained through the search, one is selected according to priority based on viewing history, user preference information, or time information. The process includes displaying item images representing multiple channels or multiple contents obtained through a search on a display, The item image includes a text item displayed on the display as text information for voice input corresponding to any of the multiple channels or multiple contents, The aforementioned item image includes at least one of a thumbnail image, a progress bar, and information indicating the broadcast status or viewing status. method.

Images