Receiver

Abstract

This system enables users to issue commands to the receiving device and select content through free voice interaction between the user and the receiving device. [Solution] In a receiving device comprising a transmitting / receiving unit, a speech search processing unit, a data processing unit, a broadcast receiving unit, an operation reception unit, a live viewing processing unit, a recording processing unit, a playback processing unit, and a storage unit, the speech search processing unit comprises a speech signal processing unit that acquires a speech signal including the user's speech, a language processing unit that analyzes the speech signal to interpret the content of the user's speech and collects information in a dialogue format that generates response content to the user according to the content of the user's speech, a chat storage unit that stores the content of the user's speech and the response content to the user, and a content processing unit that searches for content based on the content of the user's speech and the response content to the user stored in the chat storage unit.

Description

Technical Field

[0006] ,

[0001] The embodiment relates to a receiving device.

Background Art

[0002] Receiving devices that receive television broadcast programs, Internet-distributed videos, etc. have a function of allowing users to select programs, videos, etc. desired by the users based on an electronic program guide or the like. Further, a technology for allowing a user to select a favorite genre such as drama, music, sports, etc. and search for programs and videos is known. In order for a user to select a favorite genre and search for programs and videos, generally, inputs and instructions are given using a remote control, a touch panel, or the like.

[0003] With the development of recent voice processing technologies, it is becoming increasingly widespread to provide information to users from receiving devices and give commands from users to receiving devices by voice. With such technologies, users can easily give commands to receiving devices.

[0004] However, in conventional receiving devices, it has remained just replacing commands performed using a remote control or a touch panel with voice, and the convenience has not necessarily been improved.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] Thus, conventional receiving devices merely replaced commands given via remote control or touch panel with voice commands. The receiving device of this embodiment was created to solve this problem, and aims to provide a receiving device that enables the user to give commands to the receiving device and select content through free voice dialogue between the user and the receiving device. [Means for solving the problem]

[0007] The receiving device of the embodiment includes an audio signal processing unit that acquires an audio signal including the user's utterance; a language processing unit that analyzes the audio signal to interpret the content of the user's utterance and collects information in a dialogue format that generates response content to the user according to the content of the user's utterance; a chat storage unit that stores the content of the user's utterance and the response content to the user; and a content processing unit that searches for content based on the content of the user's utterance and the response content to the user stored in the chat storage unit. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing the hardware configuration of the receiving device according to the embodiment. [Figure 2] This is a block diagram showing the functional configuration of the receiving device according to the embodiment. [Figure 3] This is a block diagram showing the functional configuration of the speech retrieval processing unit in the receiving device of the embodiment. [Figure 4] This flowchart shows an example of the operation of the receiving device according to the embodiment. [Figure 5] This is a flowchart showing an example of speech content analysis processing in the receiving device of the embodiment. [Figure 6] This flowchart shows an example of the interaction operation in the receiving device of the embodiment. [Figure 7] This flowchart shows another example of the interactive operation in the receiving device of the embodiment. [Figure 8] This figure shows an example of a display in the receiving device of the embodiment. [Modes for carrying out the invention]

[0009] (Summary of the embodiment) The receiving device of this embodiment has the function of displaying broadcast programs, distributed programs, and other content received or recorded in real time to the user. Content can be selected directly based on the user's speech (voice), as well as through keyword searches and determination of search targets through dialogue.

[0010] The content of user speech can be analyzed using language models, search engines, and speech-to-text services. These services can be accessed via a network. Alternatively, the receiving device itself may also incorporate these services.

[0011] The receiving device of this embodiment can determine the user's intended command (function) by repeatedly exchanging user utterances with corresponding responses from the receiving device (hereinafter also referred to as "chat" or "dialogue"). The chat may be repeated multiple times to determine the user's intention (command). The chat is configured to be memorizable and can be used to determine the user's intended command. In other words, the receiving device of this embodiment can learn the chat and use it to determine the user's intended command without relying on language models or search engines.

[0012] Chat includes casual chat, which contains utterances of surrounding information necessary to confirm the user's intent, and functional chat, which directly indicates the function of the receiving device the user intends to use. These are stored, and past chats can be reused, for example, in the analysis of new chats. Casual chat often contains the user's preferences, and reusing this information makes it possible to quickly confirm the user's intent.

[0013] Thus, the receiving device according to the embodiment stores the conversations exchanged between the user and the receiving device, so that the user's intention can be quickly determined. Further, since analysis using a language model, a search engine, and a speech-to-text conversion service can be utilized, the user's intention can be accurately determined even when the user makes a free-form utterance.

[0014] When the user's intention is determined, the receiving device according to the embodiment keywordizes the user's intention and searches for content. If the content intended by the user is present in the search results, that content is played back. The function of the receiving device according to the embodiment to determine through the user's dialogue is not limited to content search and playback. It may also be applied to content recording and the like.

[0015] (Configuration of Embodiment) Hereinafter, the embodiment will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing the hardware configuration of the receiving device according to the embodiment. FIG. 2 is a block diagram showing the functional configuration of the receiving device according to the embodiment. In the following description, common configurations are denoted by common reference numerals, and duplicate descriptions are omitted.

[0016] The receiving device 20 shown in FIG. 1 is, for example, a television device. The receiving device 20 includes input terminals 202a to 202c, a tuner 203, a demodulator 204, a demultiplexer 205, an A / D (analog / digital) converter 206, a selector 207, a signal processing unit 208, a speaker 209, a display panel 210, an operation unit 211, a light receiving unit 212, an IP communication unit 213, a CPU 214, a memory 215, and a storage 216.

[0017] An antenna 201 is connected to the input terminal 202a. The antenna 201 receives a broadcast signal of digital broadcasting and supplies the received broadcast signal to the tuner 203 via the input terminal 202a.

[0018] The tuner 203 selects a broadcast signal of a desired channel from the broadcast signals supplied from the antenna 201 and supplies the selected broadcast signal to the demodulator 204.

[0019] The demodulator 204 demodulates the broadcast signal supplied from the tuner 203 and supplies the demodulated broadcast signal to the demultiplexer 205.

[0020] The demultiplexer 205 separates the broadcast signal supplied from the demodulator 204 to generate a video signal and an audio signal, and supplies the generated video signal and audio signal to the selector 207.

[0021] The selector 207 selects one from a plurality of signals supplied from the demultiplexer 205, the A / D converter 206, and the input terminal 202c, and supplies the selected one signal to the signal processing unit 208.

[0022] The signal processing unit 208 performs predetermined signal processing on the video signal supplied from the selector 207 and supplies the processed video signal to the display panel 210. Also, the signal processing unit 208 performs predetermined signal processing on the audio signal supplied from the selector 207 and supplies the processed audio signal to the speaker 209.

[0023] The speaker 209 outputs sound or various sounds based on the audio signal supplied from the signal processing unit 208. Also, the speaker 209 changes the volume of the output sound or various sounds based on the control by the CPU 214.

[0024] The display panel 210 displays videos such as still images and moving images, other images, and character information, etc., based on the video signal supplied from the signal processing unit 208 or the control by the CPU 214.

[0025] Input terminal 202b accepts analog signals such as video and audio signals input from an external source. Input terminal 202c accepts digital signals such as video and audio signals input from an external source. For example, input terminal 202c can receive digital signals from a recorder equipped with a drive device that drives recording and playback recording media such as BD (Blu-ray Disc) (registered trademark) for recording and playback.

[0026] The A / D converter 206 supplies the digital signal generated by performing A / D conversion on the analog signal supplied from the input terminal 202b to the selector 207.

[0027] The control unit 211 receives user input. Examples of the control unit 211 include switches and touch panels.

[0028] The light-receiving unit 212 receives infrared light from the remote controller 219. The infrared signals received by the light-receiving unit 212 include command signals (operation signals) received by the remote controller 219 from the user, as well as audio signals received from the user. The light-receiving unit 212 may also have a transmission function to send display data and the like from the receiving device 20 to the remote controller 219.

[0029] The remote controller 219 is a transmitting and receiving device that transmits signals related to commands (operations) received from the user to the receiving device 20 via infrared light. The remote controller 219 is equipped with switches, dials, display devices, etc., and receives operations from the user and transmits them to the receiving device 20, and displays display data received from the receiving device 20 on the display device. The remote controller 219 is equipped with a microphone that can receive voice commands (operations) from the user and can transmit them to the receiving device 20 via infrared light through the light receiving unit 212. The remote controller 219 may be equipped with a speaker (not shown) and configured to output a response signal from the receiving device 20 to the user as voice. Instead of equipping the remote controller 219 with a microphone, the receiving device 20 may be equipped with a microphone.

[0030] The IP communication unit 213 is a communication interface for performing IP (Internet Protocol) communication over the network 30. However, the receiving device 20 may be connected to a network other than the internet, such as a LAN.

[0031] The IP communication unit 213 can communicate with a language model 31, a search engine 32, a speech-to-text conversion service 33, and an online video service 34 via the network 30. The language model 31 is an engine for analyzing the user's voice signal sent from the remote controller 219. The language model 31 is a pre-trained AI engine that, in response to an inquiry from the receiving device 20, organizes Japanese sentences by part of speech and converts them into interpretable sentences as responses. The search engine 32 is a so-called internet search engine that, in response to a search inquiry from the receiving device 20, provides information from the internet as answers. The speech-to-text conversion service 33 is a service that converts the content spoken by the user through a microphone provided in the remote controller 219, etc., into text data that can be easily processed by the AI. The online video service 34 is a group of providers and sites that distribute videos via the network 30. The language model 31, the search engine 32, and the speech-to-text conversion service 33 may be provided in the receiving device 20.

[0032] The CPU 214 is a processing unit that controls the entire receiving device 20. The CPU 214 implements the functional elements of the receiving device 20, which will be described later.

[0033] Memory 215 includes ROM, which stores various computer programs executed by the CPU 214, and RAM, which provides a work area for the CPU 214. For example, the ROM stores control programs and application programs for realizing various functions of the receiving device 20.

[0034] The storage device 216 is a storage medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage device 216 can record, for example, the signal selected by the selector 207 as recorded data.

[0035] Figure 2 is a block diagram showing an example of the functional configuration of a receiving device 20 according to an embodiment. As shown in Figure 2, the receiving device 20 comprises a transmitting / receiving unit 21, a speech search processing unit 22, a data processing unit 23, a broadcast receiving unit 24, an operation reception unit 25, a live viewing processing unit 26, a recording processing unit 27, a playback processing unit 28, and a storage unit 29.

[0036] The functional configuration of the receiving device 20 shown in Figure 2 is realized, for example, by the CPU 214 executing a control program, or by the hardware configuration of the receiving device 20 operating under the control of the CPU 214.

[0037] The broadcast receiving unit 24 receives broadcast signals of broadcast programs sent from broadcasting stations. The broadcast signals include video and audio information, and also multiplexed with program arrangement information (SI: Service Information) that indicates the content of the broadcast program, taking into consideration the convenience of program selection. An example of program arrangement information is information related to an electronic program guide (EPG: Electronic Program Guide) that includes information equivalent to the television listings in a newspaper.

[0038] The video information, audio information, and associated transmission control information described above are compressed in MPEG2 format and constitute a multiplexed transport stream (TS).

[0039] The broadcast receiving unit 24 is capable of receiving video information, audio information, and program arrangement information, etc., which are multiplexed into the broadcast signal.

[0040] The transmitting / receiving unit 21 receives distribution signals, such as streamed videos, from the internet video service 34 via the IP communication unit 213 and the network 30. The transmitting / receiving unit 21 can also send a selection signal to the source internet video service 34 via the IP communication unit 213 and the network 30 to select the distribution signal to be received.

[0041] The operation reception unit 25 receives various operations from the user, such as live viewing operations, recording operations, recording reservation operations, and playback operations. The operation reception unit 25 can also receive the user's voice signal sent from the remote controller 219.

[0042] The live viewing processing unit 26 processes live viewing of broadcast programs and streamed videos. Live viewing means, for example, receiving broadcast programs that are currently being broadcast or streamed videos that are currently being streamed in real time and displaying them through the display panel 210.

[0043] The recording processing unit 27 processes the recording of broadcast programs and streamed videos in accordance with recording operations and recording reservation operations from the user. The recording processing unit 27 stores the recorded programs and recorded videos in the storage unit 29.

[0044] The playback processing unit 28 reads recorded programs and videos from the storage unit 29 and performs playback processing in accordance with the user's playback operation.

[0045] The memory unit 29 stores various parameters and control programs necessary for the operation of the receiving device 20. The memory unit 29 can also store content such as recorded programs and recorded videos.

[0046] The data processing unit 23 is a calculation unit that processes data necessary to operate the entire receiving device 20.

[0047] The speech search processing unit 22 is a computing unit that performs tasks such as searching for and playing back content, including recorded programs and videos, based on command signals and operation signals from the user via voice sent from the remote controller 219. The speech search processing unit 22 performs various functions such as searching for and selecting content that matches the user's preferences through a dialogue format using voice (signals), analyzing the user's voice command (operation) signals using AI functions, and analyzing voice signals and searching for information via the network 30.

[0048] (Speech retrieval processing unit) Next, with reference to Figure 3, the functional configuration of the speech search processing unit 22 in the receiving device 20 of the embodiment will be described. As shown in Figure 3, the speech search processing unit 22 includes a display processing unit 41, a data control unit 42, a voice signal processing unit 43, a content processing unit 44, a language processing unit 45, a chat storage unit 46, and a search processing unit 47.

[0049] The display processing unit 41 is a calculation block that generates display information for displaying a menu screen on the display panel 210 that shows content search results based on user commands. The display information may include chat content between the user and the receiving device.

[0050] The voice signal processing unit 43 is a calculation block that converts the voice signal related to the user's speech sent from the remote controller 219 into a digital signal.

[0051] The language processing unit 45 is an operation block that analyzes the audio signal converted by the audio signal processing unit 43 and generates user commands (for example, content search content). The language processing unit 45 can generate content search content using the language model 31, the search engine 32, and the speech-to-text conversion service 33. The language processing unit 45 has functions such as analyzing the audio signal and interpreting the content of the user's utterance, generating responses to the user according to the content of the user's utterance, continuing the dialogue until the information collected through the interaction between the content of the user's utterance and the responses to the user reaches a searchable amount of information for content, and generating keywords for searching content.

[0052] The chat memory unit 46 is a storage medium that stores received information and response information sent and received through dialogue with the user as chat information during the process in which the language processing unit 45 generates response content.

[0053] The search processing unit 47 is a computational block that accesses the language model 31, search engine 32, and speech-to-text conversion service 33 via the network in order to analyze the user's command content and collect information during the process in which the language processing unit 45 generates search content. The search processing unit 47 accesses the language model 31, search engine 32, and speech-to-text conversion service 33 via the IP communication unit 213.

[0054] The data control unit 42 is an arithmetic block that transmits digital signals converted by the voice signal processing unit 43, information transmitted and received by the language processing unit 45 in a conversational format with the user, and search results generated by the language processing unit 45 between functional blocks.

[0055] The content processing unit 44 is an operation block that receives the search content generated by the language processing unit 45 from the data control unit 42 and searches for content related to the user's spoken content. The content processing unit 44 searches for content such as recorded programs and recorded videos stored in the storage 216, and content currently being received or streamed and processed by the live viewing processing unit 26, and generates search candidates for content that matches the search content. The content processing unit 44 can issue a playback instruction to the playback processing unit 28 for the content selected by the user from the search candidates.

[0056] (Example of operation of the embodiment) Next, the operation of the receiving device of the embodiment will be described with reference to Figure 4. The operation reception unit 25 waits for the approach of the remote controller 219, i.e., the approach of a user, via the light receiving unit 212 (S100). The receiving device 20 detects the approach of a user via the remote controller 219. The detection of user approach by the receiving device 20 is not limited to that by the remote controller 219. The receiving device 20 may also be equipped with detection means such as a camera to detect the approach of a user.

[0057] The operation reception unit 25 detects user speech based on the audio signal from the remote controller 219 sent via the light receiving unit 212 (S105). If no speech is detected (No. in S105), the receiving device 20 maintains a standby state for user approach (S100).

[0058] If speech is detected (Yes in S105), the operation reception unit 25 sends the received voice signal to the voice search processing unit 22, and the voice signal processing unit 43 receives the user's voice signal (S110).

[0059] The speech retrieval processing unit 22 analyzes the user's voice signal (S115). The speech retrieval processing unit 22 analyzes the user's voice signal and recognizes the user's command (operation).

[0060] The speech retrieval processing unit 22 generates a response (response signal) corresponding to the received voice signal from the user (S120). Examples of this response include asking for clarification when the user's command is unclear, and asking for additional information when there is insufficient information to perform the function (execute the search).

[0061] The speech search processing unit 22 transmits the generated response content to the operation reception unit 25, which displays the response content on the display panel 210 (S125). The response content may be displayed in a dialogue format, associated with the user's utterance. The speech search processing unit 22 may also generate the response content as an audio signal. In this case, the operation reception unit 25 transmits it to the remote controller 219 via the light receiving unit 212. The remote controller 219 can output the audio signal.

[0062] The operation reception unit 25 receives an audio signal from the remote controller 219 via the light receiving unit 212 (S130). The audio signal received here is the user's response to the response transmitted by the operation reception unit 25.

[0063] The speech retrieval processing unit 22 analyzes the user's voice signal (S135). The speech retrieval processing unit 22 analyzes the user's voice signal to recognize and interpret the user's command (operation).

[0064] The speech search processing unit 22 determines whether or not a function corresponding to the recognized user command has been determined (S140). If the user's command can be determined through the transmission and reception of dialogue-style information between the user and the receiving device 20, for example, if the content of the dialogue-style information is sufficient for content search, the receiving device 20 can execute a function corresponding to the command (e.g., content search). On the other hand, if the command cannot be determined (insufficient information), the receiving device 20 needs to continue the dialogue to obtain additional information from the user. If a function corresponding to the command cannot be determined (No in S140), the speech search processing unit 22 stores the content of the dialogue as casual chat in the chat storage unit 46 (S145). The casual chat stored in the chat storage unit 46 can be used to determine whether or not a function has been determined by the user's command. Thereafter, the process of sending a response, receiving a user response, and analyzing the speech content is repeated until a function corresponding to the user's command is determined (S120~S135).

[0065] If a function corresponding to the command content can be determined (Yes in S140), the speech search processing unit 22 stores the content of the dialogue and the content of the determined function as a function chat in the chat storage unit 46 (S150).

[0066] The speech search processing unit 22 searches for content corresponding to the user's command content confirmed through the content processing unit 44 (S155). The display processing unit 41 displays the search results on the display panel 210. The user may also engage in chat when selecting content from the search results. The playback processing unit 28 plays the selected content (S165).

[0067] Thus, the receiving device of this embodiment allows for more flexible responses to commands because the command content is determined through dialogue with the user. Furthermore, the receiving device of this embodiment stores the content of the dialogue with the user as a chat, and this stored chat can be used when determining the command content. Therefore, even if the command from the user does not follow a specific format, it is possible to easily determine a command that aligns with the user's preferences.

[0068] Note that the operation shown in Figure 4 is just one example, and similar effects can be achieved by omitting or repeating some of the steps.

[0069] (Example of speech content analysis operation in the embodiment) Next, with reference to Figure 5, an example of the operation of the speech search processing unit 22 will be described in detail. Figure 5 is a flowchart showing an example of the operation of the speech search processing unit 22. In the following description, elements common to the embodiments shown in Figures 1 to 4 will be denoted by the same reference numerals, and redundant explanations will be omitted.

[0070] In the example operation shown in Figure 4, when the operation reception unit 25 detects speech, the operation reception unit 25 sends the received audio signal to the speech search processing unit 22, and the audio signal processing unit 43 receives the user's audio signal (S116). In the following explanation, it is assumed that the audio signal processing unit 43 has received the audio "Minamoto no Yoritomo no Ototo no Dorama". The audio signal processing unit 43 sends the received audio signal to the language processing unit 45.

[0071] The language processing unit 45 processes the received audio signal via the search processing unit 47. Here, the search processing unit 47 sends the received audio signal via the network 30 to the speech-to-text conversion service 33 and the language model 31 for language analysis (S117). The search processing unit 47 receives from the language model 31, for example, " Minamoto no Yoritomo's younger brother of drama The information is received with spaces between the characters.

[0072] The search processing unit 47 recognizes that the information received from the language model 31 is "a drama about Minamoto no Yoritomo's younger brother." The search processing unit 47 sends information about "a drama about Minamoto no Yoritomo's younger brother" to the search engine 32 via the network 30 and performs content analysis. The search processing unit 47 receives information from the search engine 32 that it is "a drama about Minamoto no Yoshitsune."

[0073] The language processing unit 45 analyzes the results received by the search processing unit 47 and interprets the voice signal from the user as "the drama of Minamoto no Yoshitsune" (S118). In other words, the language processing unit 45 uses the language model 31 and the search engine 32 to interpret the command content of the user's voice signal.

[0074] The language processing unit 45 generates keywords based on the user's voice signal (S119). For example, keywords such as "Minamoto no Yoshitsune" and "drama" are generated.

[0075] The display processing unit 41 displays information on the display panel 210 to confirm the search content based on the keywords generated by the language processing unit 45 (S120). The display processing unit 41 generates a response content such as, for example, "Is this a drama about Minamoto no Yoshitsune?". The display processing unit 41 may output an audio signal through the operation reception unit 25 instead of displaying on the display panel 210, or it may output both a display and an audio signal.

[0076] When the operation reception unit 25 receives confirmation from the user, the content processing unit 44 searches for content from the storage unit 29, the electronic program guide, etc., based on the keywords generated by the language processing unit 45 (S155).

[0077] The display processing unit 41 displays the search results of the content processing unit 44 on the display panel 210 (S160). The playback processing unit 28 plays the content based on the command (selection) from the user (S165).

[0078] In the example described above, the language processing unit 45 analyzes the user's commands using a language model, search engine, and speech-to-text conversion service through the search processing unit 47, but it is not limited to this. The results of past analyses using the language model, search engine, and speech-to-text conversion service may be stored in the chat memory unit 46 as casual chat or functional chat, and the language processing unit 45 may interpret the user's commands based on the past chat history.

[0079] Thus, the receiving device of this embodiment analyzes user commands using a language model, a search engine, and a speech-to-text conversion service, so that even command signals based on user dialogue can be accurately identified as keywords for content retrieval.

[0080] (An example of the transition of voice dialogue in the receiving device of the embodiment) Next, with reference to Figure 6, the user command confirmation operation in the receiving device of the embodiment, using a user interaction method, will be described. Figure 6 is a diagram showing the chat between the user's utterance and the receiving device's response in the receiving device of the embodiment.

[0081] Assume the user has spoken via the remote controller 219, "I want to watch a video of mountain scenery" (S200).

[0082] The spoken audio signal is sent to the language processing unit 45 via the audio signal processing unit 43. The language processing unit 45 performs language processing via the search processing unit 47 and interprets the message as "I want to watch a video of mountain scenery" through language analysis by the speech-to-text conversion service 33 and the language model 31 (S202).

[0083] If the language processing unit 45 determines that the command (function) is not determined by "I want to watch a video of mountain scenery", the language processing unit 45 generates a response such as "What is it?", and the display processing unit 41 displays the response generated by the language processing unit 45 on the display panel 210 (S204).

[0084] Suppose the user responds to the question "What is it?" by speaking, for example, "It's full of animals" via the remote controller 219 (S206).

[0085] The spoken audio signal is sent to the language processing unit 45 via the audio signal processing unit 43. The language processing unit 45 performs language processing via the search processing unit 47 and interprets it as "There are lots of animals" through language analysis by the speech-to-text conversion service 33 and the language model 31 (S208).

[0086] If the language processing unit 45 determines that the function cannot be determined from "I want to watch a video of mountain scenery" or "There are lots of animals", the language processing unit 45 generates a response, for example, "What season is it?", and the display processing unit 41 displays the response generated by the language processing unit 45 on the display panel 210 (S210).

[0087] Suppose the user responds to the question "What season is it?" by speaking, for example, "Autumn is good" via the remote controller 219 (S212).

[0088] The spoken audio signal is sent to the language processing unit 45 via the audio signal processing unit 43. The language processing unit 45 performs language processing via the search processing unit 47 and interprets it as "Autumn is good" through language analysis by the speech-to-text conversion service 33 and the language model 31 (S214).

[0089] When the language processing unit 45 determines that the function can be determined from the utterances "I want to watch a video of mountain scenery," "Lots of animals," and "Autumn is nice," it summarizes the chat based on these utterances (S216). For example, based on the summarized content of these chats, the language processing unit 45 interprets it as "I want to watch a video of mountains in autumn with lots of animals."

[0090] The language processing unit 45 generates, for example, the response "I understand," and the display processing unit 41 displays the response generated by the language processing unit 45 on the display panel 210 (S218).

[0091] The language processing unit 45 stores the summarized chat message, "I want to watch a video of lots of animals in the autumn mountains," in the chat memory unit 46 (S220). By storing the summarized chat message, it becomes easier to find a match when the user speaks a similar command.

[0092] The language processing unit 45 generates keywords based on the summarized request, "I want to watch a video of lots of animals in the mountains in autumn." For example, "autumn," "mountain," "animals," and "video" are used. The content processing unit 44 searches for content based on these keywords (S222).

[0093] Thus, according to the receiving device of this embodiment, the content of the user's commands is determined through a dialogue with the user, so that the content desired by the user can be searched based on the user's free speech. Furthermore, according to the receiving device of this embodiment, if the dialogue with the user continues and a chat continues, the summarized content is stored as a functional chat, making it possible to easily determine subsequent user commands.

[0094] Next, with reference to Figure 7, the command confirmation method for user interaction in the receiving device of the embodiment will be described. Figure 7 is a diagram showing another aspect of the chat between user utterances and the receiving device's responses in the receiving device of the embodiment.

[0095] Assume the user has spoken via the remote controller 219, "Can you recommend any content?" (S230).

[0096] The spoken audio signal is sent to the language processing unit 45 via the audio signal processing unit 43. The language processing unit 45 performs language processing via the search processing unit 47 and interprets the message as "Please recommend some content" through language analysis by the speech-to-text conversion service 33 and the language model 31 (S232).

[0097] When the language processing unit 45 determines that the command (function) is confirmed as "Tell me some recommended content," the language processing unit 45 refers to past casual chats, function chats, electronic program guides, and playback history from the chat memory unit 46 and generates a response that should be recommended to the user. Here, it is assumed that the language processing unit 45 has generated a response that says, "Here are our current recommended contents: 'Programs trending on social media,' 'Content you are currently watching,' 'The latest episode of your usual content,' or 'Content you watch every day at this time.' Which would you like?" The display processing unit 41 displays the response generated by the language processing unit 45 on the display panel 210 (S234).

[0098] Figure 8 shows an example of display information that the display processing unit 41 displays on the display panel 210. In the example shown in Figure 8, thumbnails 210a, chat messages 210b, search titles 210c, program information 210d, receiving device messages 210e, and user messages 210f are displayed.

[0099] Suppose the user responds to the message "Here are our current recommended contents... Which one would you like?" by speaking via the remote controller 219, for example, "I want to see the latest one" (S236).

[0100] The spoken audio signal is sent to the language processing unit 45 via the audio signal processing unit 43. The language processing unit 45 performs language processing via the search processing unit 47 and interprets it as "I want to see the latest" through language analysis by the speech-to-text conversion service 33 and the language model 31 (S238).

[0101] When the language processing unit 45 determines that the function is confirmed by "I want to see the latest," the language processing unit 45 summarizes the chats "I want to see the latest" and related "the latest episode of the content I always watch." For example, based on these chats, the language processing unit 45 interprets it as "Show the latest episode of the content I always watch." The display processing unit 41 displays the chats summarized by the language processing unit 45 as the response content on the display panel 210 (S240).

[0102] The language processing unit 45 generates keywords based on the summarized chat. Examples include "content I always watch" and "latest episode." The content processing unit 44 searches for content based on these keywords (S242).

[0103] Thus, according to the receiving device of this embodiment, the content of the user's commands is determined through a dialogue with the user, so that the content desired by the user can be searched based on the user's free speech. Furthermore, according to the receiving device of this embodiment, the chat can proceed based on past casual chats, function chats, electronic program guides, and playback history stored in the chat memory unit, so that command responses can be tailored to the user's preferences.

[0104] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of Symbols]

[0105] 20... Receiving device, 21... Transmitting / receiving unit, 22... Speech search processing unit, 23... Data processing unit, 24... Broadcast receiving unit, 25... Operation reception unit, 26... Live viewing processing unit, 27... Recording processing unit, 28... Playback processing unit, 29... Storage unit, 30... Network, 31... Language model, 32... Search engine, 33... Speech-to-text conversion service, 34... Online video service 41...Display processing unit, 42...Data control unit, 43...Audio signal processing unit, 44...Content processing unit, 45...Language processing unit, 46...Chat memory unit, 47...Search processing unit 201…Antenna, 202a~202c…Input terminals, 203…Tuner, 204…Demodulator, 205…Demultiplexer, 206…Analog / Digital converter, 207…Selector, 208…Signal processing unit, 209…Speaker, 210…Display panel 210a...Thumbnail, 210b...Chat, 210c...Search title, 210d...Program display, 210e...Message, 210f...Message 211...Operation unit, 212...Light receiving unit, 213...IP communication unit, 214...CPU, 215...Memory, 216...Storage, 219...Remote controller

Claims

1. A voice signal processing unit that acquires voice signals including user speech, A language processing unit that analyzes the aforementioned audio signal to interpret the content of the user's utterance and collects information in a dialogue format to generate a response to the user according to the content of the user's utterance, A chat storage unit that stores the content of the user's utterances and the content of the responses to the user, A content processing unit searches for content based on the content of the user's utterances and the responses to the user stored in the chat memory unit. A receiving device equipped with the following features.

2. The receiving device according to claim 1, characterized in that the chat memory unit stores the content of the user's utterance and the response to the user repeated multiple times.

3. The receiving device according to claim 1, characterized in that the language processing unit repeats the collection of information in the dialogue format until the content processing unit can search for the content based on the content of the user's utterance and the content of the response to the user.

4. The receiving device according to claim 1, characterized in that the language processing unit includes a search processing unit that obtains analysis results via a network based on the content of the user's utterance in order to interpret the content of the user's utterance.

5. The aforementioned content includes at least one of a recorded broadcast program and a recorded streaming video. The system further comprises a content storage unit for storing the aforementioned content, The content processing unit searches for the search target from the content storage unit based on the content of the user's utterance and the response content to the user stored in the chat storage unit. A receiving device according to any one of claims 1 to 4, characterized by the following:

Images