Display device and operating method thereof

Abstract

A display device according to an embodiment of the present disclosure may comprise: a display; and a controller which receives a voice command uttered by a user, obtains an analysis result of the received voice command, determines, on the basis of a viewing environment of the display device, whether a problem situation matching the analysis result exists, and on the basis of determining that the problem situation exists, displays, on the display, a suggestion response for solving the problem situation or executes a problem-solving sequence for solving the problem situation.

Description

Display device and method of operation thereof

[0001] The present disclosure relates to a display device, and more specifically, to a display device that recognizes a problem situation based on the viewing environment and takes action regarding it.

[0002] Digital TV services using wired or wireless communication networks are becoming commonplace. Digital TV services can provide a variety of services that were not available through existing analog broadcasting services.

[0003] For example, digital TV services such as IPTV (Internet Protocol Television) and smart TV provide interactivity that allows users to actively select the types of programs and viewing time. Based on this interactivity, IPTV and smart TV services can also provide various additional services, such as internet search, home shopping, and online games.

[0004] Conventionally, when major problems occurred, such as external inputs like HDMI, integrated remote control settings, picture / sound quality, or long-distance voice recognition, there was the inconvenience of not being able to find the cause of the problem or having to attempt multiple conversations to find a solution through conversation with a chatbot.

[0005] In addition, there was a problem where users' TV viewing was continuously interrupted, such as when users had to call the call center in the event of a major issue.

[0006] As such, if the problem situation is not resolved immediately, a problem arises where the TV user experience deteriorates.

[0007] The purpose of the present disclosure may be to recognize a problem situation that a user may experience in the viewing environment of a display device and to automatically suggest a solution to the recognized problem situation.

[0008] The purpose of the present disclosure may be to recognize a problem situation that matches a voice command spoken by a user in a viewing environment of a display device, and to automatically proceed with a problem-solving sequence for the recognized problem situation.

[0009] The purpose of the present disclosure may be to check the basic conditions required for viewing, recommend customized diagnostic items needed by the user, and proactively suggest solutions to problems.

[0010] A display device according to an embodiment of the present disclosure may include: a display; and a controller that receives a voice command spoken by a user, obtains an analysis result of the received voice command, determines whether a problem situation matching the analysis result exists based on the viewing environment of the display device, and, based on the determination that the problem situation exists, displays a proposed response to solve the problem situation on the display or executes a problem-solving sequence to solve the problem situation.

[0011] A method of operation of a display device according to an embodiment of the present disclosure may include: receiving a voice command spoken by a user; obtaining an analysis result of the received voice command; determining whether a problem situation matching the analysis result exists based on the viewing environment of the display device; and displaying a proposed response to solve the problem situation or executing a problem-solving sequence to solve the problem situation based on the determination that the problem situation exists.

[0012] According to various embodiments of the present disclosure, by first presenting a solution to a major problem that a user may experience, the time and effort required for the user to reach the problem-solving method can be reduced.

[0013] According to various embodiments of the present disclosure, the user experience can be significantly improved as the problem-solving sequence for problematic situations related to viewing proceeds automatically.

[0014] According to an embodiment of the present disclosure, a problem situation that may cause inconvenience to the user can be monitored frequently within the display device to store a list of problem situations, and when a problem situation occurs, a solution can be proactively presented through a chatbot app, or a solution can be presented immediately when the problem situation is voiced, thereby helping the user to use the display device more conveniently.

[0015] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0016] FIG. 2 is a block diagram of a remote control device according to one embodiment of the present invention.

[0017] FIG. 3 shows an example of the actual configuration of a remote control device according to one embodiment of the present invention.

[0018] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0019] FIG. 5 is a drawing illustrating the configuration of a system according to one embodiment of the present disclosure.

[0020] FIG. 6 is a flowchart for explaining a method of operation of a display device according to one embodiment of the present disclosure.

[0021] FIG. 7 is a diagram illustrating the process of executing a problem-solving sequence according to one embodiment of the present disclosure.

[0022] FIGS. 8a to 8c are drawings illustrating examples of problem-solving sequences according to embodiments of the present disclosure.

[0023] FIG. 9 is a diagram illustrating an example of identifying a problem situation through the analysis of a user's voice command according to one embodiment of the present disclosure and providing a suggested response for solving the identified problem situation.

[0024] FIG. 10 is a flowchart for explaining a method of operation of a display device according to another embodiment of the present disclosure.

[0025] FIG. 11a is a diagram illustrating an example of providing a proposed response suitable for a problem situation according to an embodiment of the present disclosure, and FIG. 11b to 11f are tables describing a proposed response phrase suitable for a problem situation and an action performed when the proposed response phrase is clicked.

[0026] FIG. 12 is a diagram illustrating the process of outputting a proposed response when a problem situation occurs in which a starting word is misrecognized according to one embodiment of the present disclosure.

[0027] FIGS. 13a and FIGS. 13b are drawings illustrating the process of recognizing and saving a problem situation according to the setting of the power timer function of the display device.

[0028] FIG. 14 is a diagram illustrating the process of transmitting a voice signal corresponding to a activator spoken by a user to a server when a problem situation of misrecognition of a activator is detected according to one embodiment of the present disclosure.

[0029] Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "part" for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification, and do not inherently have distinct meanings or roles.

[0030] A display device according to an embodiment of the present invention is, for example, an intelligent display device that adds computer support functions to a broadcast reception function. While faithful to the broadcast reception function, it also adds internet functions, and can be equipped with a more user-friendly interface such as a handwriting input device, a touch screen, or a spatial remote control. Furthermore, by supporting wired or wireless internet functions, it can be connected to the internet and a computer, and can perform functions such as email, web browsing, banking, or games. A standardized general-purpose OS may be used for these various functions.

[0031] Accordingly, the display device described in the present invention allows various applications to be freely added or removed, for example, on a general-purpose OS kernel, thereby enabling various user-friendly functions to be performed. More specifically, the display device may be, for example, a network TV, HBB TV, smart TV, LED TV, OLED TV, etc., and may also be applicable to smartphones depending on the circumstances.

[0032] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0033] Referring to FIG. 1, the display device (100) may include a video receiver (130), an external device interface (135), a memory (140), a user input interface (150), a controller (170), a wireless communication interface (173), a display (180), a speaker (185), and a power supply circuit (190).

[0034] The video receiver (130) may include a tuner (131), a demodulator (132), and a network interface (133).

[0035] The tuner (131) can tune to a specific broadcast channel according to a channel tuning command. The tuner (131) can receive a broadcast signal for the tuned specific broadcast channel.

[0036] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0037] The external device interface (135) can receive an application or a list of applications within an adjacent external device and transmit it to the controller (170) or memory (140).

[0038] The external device interface (135) can provide a connection path between the display device (100) and an external device. The external device interface (135) can receive one or more of video and audio output from an external device connected to the display device (100) wirelessly or via a wired connection, and transmit them to the controller (170). The external device interface (135) may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0039] The video signal of an external device input through the external device interface (135) can be output through the display (180). The audio signal of an external device input through the external device interface (135) can be output through the speaker (185).

[0040] The external device that can be connected to the external device interface (135) may be any one of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB memory, or home theater, but this is merely an example.

[0041] The network interface (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet network. The network interface (133) may transmit or receive data to or from other users or other electronic devices through the connected network or another network linked to the connected network.

[0042] In addition, some of the content data stored in the display device (100) can be transmitted to another user or other electronic device selected among other users or other electronic devices that are previously registered in the display device (100).

[0043] The network interface (133) can access a specific web page through a connected network or another network linked to the connected network. That is, it can access a specific web page through a network and transmit or receive data with the corresponding server.

[0044] Additionally, the network interface (133) can receive content or data provided by a content provider or network operator. That is, the network interface (133) can receive content such as movies, advertisements, games, VOD, broadcast signals, and related information provided by a content provider or network provider through a network.

[0045] Additionally, the network interface (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the internet or a content provider or network operator.

[0046] The network interface (133) can select and receive a desired application among the applications that are open to the public through the network.

[0047] The memory (140) can store programs for each signal processing and control within the controller (170), and can store signal-processed video, audio, or data signals.

[0048] Additionally, the memory (140) may perform the function of temporarily storing video, audio, or data signals input from an external device interface (135) or a network interface (133), and may also store information regarding a predetermined image through a channel memory function.

[0049] The memory (140) can store an application or a list of applications input from an external device interface (135) or a network interface (133).

[0050] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in memory (140) and provide them to the user.

[0051] The user input interface (150) can transmit a signal input by the user to the controller (170) or transmit a signal from the controller (170) to the user. For example, the user input interface (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication, or process to transmit control signals from the controller (170) to the remote control device (200).

[0052] Additionally, the user input interface (150) can transmit control signals input from local keys (not shown), such as power key, channel key, volume key, and setting value, to the controller (170).

[0053] The image signal processed by the controller (170) can be input to the display (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the controller (170) can be input to an external output device through the external device interface (135).

[0054] The voice signal processed by the controller (170) can be output as audio to the speaker (185). Additionally, the voice signal processed by the controller (170) can be input to an external output device through the external device interface (135).

[0055] In addition, the controller (170) can control the overall operation within the display device (100).

[0056] Additionally, the controller (170) can control the display device (100) by means of user commands or internal programs entered through the user input interface (150), and can connect to a network to allow the user to download an application or a list of applications desired by the user into the display device (100).

[0057] The controller (170) enables the processed video or audio signal, such as channel information selected by the user, to be output through the display (180) or speaker (185).

[0058] Additionally, the controller (170) enables a video signal or audio signal from an external device, such as a camera or camcorder, input through the external device interface (135) according to an external device video playback command received through the user input interface (150), to be output through the display (180) or speaker (185).

[0059] Meanwhile, the controller (170) can control the display (180) to display video, for example, broadcast video input through the tuner (131), external input video input through the external device interface (135), video input through the network interface, or video stored in the memory (140) can be controlled to be displayed on the display (180). In this case, the video displayed on the display (180) may be a still image or a video, and may be a 2D image or a 3D image.

[0060] Additionally, the controller (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from the outside, and the content may be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0061] The wireless communication interface (173) can communicate with an external device via wired or wireless communication. The wireless communication interface (173) can perform short-range communication with an external device. To this end, the wireless communication interface (173) can support short-range communication by using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (Wireless USB) technologies. Such wireless communication interface (173) can support wireless communication between the display device (100) and a wireless communication system, between the display device (100) and another display device (100), or between the display device (100) and a network where the display device (100, or an external server) is located, through wireless area networks. Short-range wireless communication networks can be Wireless Personal Area Networks.

[0062] Here, another display device (100) may be a mobile terminal such as a wearable device (e.g., a smartwatch, smart glass, HMD (head mounted display)), a smartphone, etc., capable of exchanging data with (or interacting with) the display device (100) according to the present invention. The wireless communication interface (173) may detect (or recognize) a wearable device capable of communicating around the display device (100).

[0063] Furthermore, if the detected wearable device is a device authenticated to communicate with the display device (100) according to the present invention, the controller (170) can transmit at least a portion of the data processed in the display device (100) to the wearable device through the wireless communication interface (173). Accordingly, the user of the wearable device can use the data processed in the display device (100) through the wearable device.

[0064] The display (180) can generate a driving signal by converting the video signal, data signal, OSD signal processed by the controller (170) or the video signal, data signal, etc. received from the external device interface (135) into R, G, and B signals, respectively.

[0065] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present invention, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the actual implemented display device (100).

[0066] That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. In addition, the functions performed in each block are intended to explain embodiments of the present invention, and the specific operations or devices thereof do not limit the scope of the present invention.

[0067] According to another embodiment of the present invention, the display device (100) may receive and play video through a network interface (133) or an external device interface (135) without having a tuner (131) and a demodulator (132), unlike as shown in FIG. 1.

[0068] For example, the display device (100) may be implemented by separating it into a video processing device, such as a set-top box, for receiving broadcast signals or content according to various network services, and a content playback device for playing content input from the video processing device.

[0069] In this case, the operation method of the display device according to the embodiment of the present invention described below may be performed not only by the display device (100) described with reference to FIG. 1, but also by any one of the image processing device such as the separated set-top box, or a content playback device having a display (180) and a speaker (185).

[0070] Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present invention will be described.

[0071] FIG. 2 is a block diagram of a remote control device according to one embodiment of the present invention, and FIG. 3 shows an example of the actual configuration of a remote control device (200) according to one embodiment of the present invention.

[0072] First, referring to FIG. 2, the remote control device (200) may include a fingerprint reader (210), a wireless communication circuit (220), a user input interface (230), a sensor (240), an output interface (250), a power supply circuit (260), a memory (270), a controller (280), and a microphone (290).

[0073] Referring to FIG. 2, the wireless communication circuit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present invention described above.

[0074] The remote control device (200) is equipped with an RF circuit (221) capable of transmitting and receiving signals to and from the display device (100) according to RF communication standards, and may be equipped with an IR circuit (223) capable of transmitting and receiving signals to and from the display device (100) according to IR communication standards. Additionally, the remote control device (200) may be equipped with a Bluetooth circuit (225) capable of transmitting and receiving signals to and from the display device (100) according to Bluetooth communication standards. Furthermore, the remote control device (200) may be equipped with an NFC circuit (227) capable of transmitting and receiving signals to and from the display device (100) according to NFC (Near Field Communication) communication standards, and may be equipped with a WLAN circuit (229) capable of transmitting and receiving signals to and from the display device (100) according to WLAN (Wireless LAN) communication standards.

[0075] Additionally, the remote control device (200) transmits a signal containing information regarding the movement of the remote control device (200), etc., to the display device (100) through a wireless communication circuit (220).

[0076] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF circuit (221), and, if necessary, can transmit commands regarding power on / off, channel change, volume change, etc. to the display device (100) through the IR circuit (223).

[0077] The user input interface (230) may be composed of a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input interface (230). If the user input interface (230) is equipped with a hard key button, the user can input commands related to the display device (100) to the remote control device (200) through a push operation of the hard key button. This will be explained with reference to FIG. 3.

[0078] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).

[0079] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation and may receive a push operation and a fingerprint recognition operation.

[0080] The power button (231) may be a button for turning the power of the display device (100) on / off.

[0081] The home button (232) may be a button for moving to the home screen of the display device (100).

[0082] The live button (233) may be a button for displaying a live broadcast program.

[0083] The external input button (234) may be a button for receiving an external input connected to the display device (100).

[0084] The volume control button (235) may be a button for adjusting the volume output by the display device (100).

[0085] The voice recognition button (236) may be a button for receiving the user's voice and recognizing the received voice.

[0086] The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel.

[0087] The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.

[0088] Figure 2 is explained again.

[0089] If the user input interface (230) is equipped with a touchscreen, the user can input commands related to the display device (100) to the remote control device (200) by touching the soft keys on the touchscreen. Additionally, the user input interface (230) may be equipped with various types of input means that the user can operate, such as scroll keys or jog keys, and this embodiment does not limit the scope of the present invention.

[0090] The sensor (240) may be equipped with a gyroscope sensor (241) or an accelerometer sensor (243), and the gyroscope sensor (241) may sense information regarding the movement of the remote control device (200).

[0091] For example, the gyroscope sensor (241) can sense information regarding the operation of the remote control device (200) based on the x, y, and z axes, and the accelerometer sensor (243) can sense information regarding the movement speed of the remote control device (200). Meanwhile, the remote control device (200) may further be equipped with a distance measuring sensor to sense the distance to the display (180) of the display device (100).

[0092] The output interface (250) can output a video or audio signal corresponding to the operation of the user input interface (230) or a signal transmitted from the display device (100).

[0093] The user can recognize whether the output interface (250) is operated by the user input interface (230) or whether the display device (100) is controlled.

[0094] For example, the output interface (250) may be equipped with an LED (251) that lights up when the user input interface (230) is operated or when a signal is transmitted or received with the display device (100) through the wireless communication circuit (220), a vibrator (253) that generates vibration, a speaker (255) that outputs sound, or a display (257) that outputs video.

[0095] Additionally, the power supply circuit (260) supplies power to the remote control device (200), and can reduce power waste by stopping the power supply when the remote control device (200) does not move for a predetermined period of time.

[0096] The power supply circuit (260) can resume power supply when a predetermined key provided in the remote control device (200) is operated.

[0097] The memory (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200).

[0098] When the remote control device (200) transmits and receives signals wirelessly through the RF circuit (221) and the display device (100), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.

[0099] The controller (280) of the remote control device (200) can store and refer to information regarding frequency bands, etc., that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200) in the memory (270).

[0100] The controller (280) controls all matters related to the control of the remote control device (200). The controller (280) can transmit a signal corresponding to a predetermined key operation of the user input interface (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor (240) to the display device (100) through the wireless communication circuit (220).

[0101] In addition, the microphone (290) of the remote control device (200) can acquire voice.

[0102] The microphone (290) may be provided in multiple numbers.

[0103] Next, Figure 4 is explained.

[0104] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0105] FIG. 4(a) illustrates a pointer (205) corresponding to a remote control device (200) being displayed on a display (180).

[0106] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display (180) of the display device (100) corresponds to the movement of the remote control device (200). Since the pointer (205) of the remote control device (200) moves and is displayed according to the movement in 3D space as shown in the drawing, it can be named a spatial remote control.

[0107] FIG. 4(b) illustrates that when the user moves the remote control device (200) to the left, the pointer (205) displayed on the display (180) of the display device (100) also moves to the left in response.

[0108] Information regarding the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information regarding the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0109] FIG. 4(c) illustrates a case where, while pressing a specific button within the remote control device (200), the user moves the remote control device (200) away from the display (180). By doing so, the selected area within the display (180) corresponding to the pointer (205) can be zoomed in and enlarged.

[0110] Conversely, when the user moves the remote control device (200) closer to the display (180), the selected area within the display (180) corresponding to the pointer (205) can be zoomed out and reduced in size.

[0111] Meanwhile, when the remote control device (200) moves away from the display (180), the selected area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selected area may be zoomed in.

[0112] Additionally, when a specific button within the remote control device (200) is pressed, recognition of up-down and left-right movement may be excluded. That is, when the remote control device (200) moves away from or closer to the display (180), up-down, left-right movement is not recognized, and only forward-backward movement is recognized. When the specific button within the remote control device (200) is not pressed, only the pointer (205) moves according to the up-down, left-right movement of the remote control device (200).

[0113] Meanwhile, the movement speed or direction of movement of the pointer (205) can correspond to the movement speed or direction of movement of the remote control device (200).

[0114] Meanwhile, the pointer in this specification refers to an object displayed on the display (180) in response to the operation of the remote control device (200). Accordingly, the pointer (205) can be an object of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, a thick outline, etc. Furthermore, the pointer (205) can be displayed corresponding to either a point on the horizontal axis or a vertical axis on the display (180), and it is also possible to display it corresponding to multiple points, such as a line or a surface.

[0115] FIG. 5 is a drawing illustrating the configuration of a system according to one embodiment of the present disclosure.

[0116] Referring to FIG. 5, the system (50) may include a display device (100) and a server (500).

[0117] A display device (100) may have a voice agent application for providing voice recognition services and a chatbot application for providing chatbot services installed therein. The display device (100) may receive user input through each application and transmit the received user input to a server (500).

[0118] The server (500) can transmit response data that responds to user input to the display device (100), and can display the response data on the display (180) through each application or perform an action according to the response data.

[0119] The display device (100) can transmit a voice signal corresponding to a voice command to the server (500), and the server (500) can obtain an analysis result of the voice command based on the voice signal and transmit the obtained analysis result to the display device (100).

[0120] FIG. 6 is a flowchart for explaining a method of operation of a display device according to one embodiment of the present disclosure.

[0121] Referring to FIG. 6, the controller (170) of the display device (100) can receive a voice command (S601).

[0122] In one embodiment, the controller (170) can receive a voice command spoken by a user from a remote control device (200) through a user input interface (150).

[0123] In another embodiment, the controller (170) can receive a voice command spoken by a user through a microphone provided in the user input interface (150).

[0124] The controller (170) can obtain the analysis result of the voice command (S603) and determine whether there is a problem situation that matches the analysis result of the display device (100) based on the viewing environment of the display device (100) (S605).

[0125] The controller (170) can transmit voice data corresponding to a voice command to the server (500) through the network interface (133). The server (500) can convert the voice data into text data through a STT (Speech To Text) engine and obtain an analysis result of the voice command based on the converted text through a Natural Language Processing (NLP) engine. The server (500) can transmit the analysis result of the obtained voice command to the display device (100).

[0126] The analysis results may include the results of analyzing the intent of the voice command.

[0127] In one embodiment, the controller (170) can determine whether there is a problem situation that matches the analysis result if there is a viewing environment that interferes with the intent of the analysis result.

[0128] In one embodiment, the viewing environment of the display device (100) may include at least one of the setting information of the display device (100) or the connection status of an external device. The setting information of the display device (100) may include at least one of the power setting information of the display device (100), the sensitivity of the microphone provided in the display device (100), and whether the microphone is on or off.

[0129] For example, if the analysis result of the voice command is an intention to turn on a specific channel and the power of the set-top box connected to the display device (100) is turned off, the controller (170) may determine that there is a problem situation that matches the analysis result.

[0130] As another example, the controller (170) may determine that there is a problem situation matching the analysis result when the analysis result of the voice command indicates an inconvenience of the power of the display device (100) being automatically turned off, and the power off timer function of the display device (100) is activated.

[0131] As another example, the controller (170) may determine that there is a problem situation that matches the analysis result when the analysis result of the voice command indicates symptoms of misrecognition of the starting word and the voice recognition service is automatically activated.

[0132] In another embodiment, the memory (140) may store a plurality of analysis results and a plurality of problem situations that match each analysis result in advance. The controller (170) may extract a problem situation that matches an analysis result from the memory (140) among the plurality of problem situations.

[0133] If there is no problem situation that matches the analysis result of the display device (100), the controller (170) may output a response corresponding to the analysis result or perform a function that matches the analysis result (S607).

[0134] For example, if the controller (170) is intended to indicate a search for movies, it can display the movie search results on the display (180).

[0135] As another example, the controller (170) can adjust the volume of the audio through the speaker (185) if the analysis result is intended to control the volume of the audio.

[0136] If there is a problem situation that matches the analysis result, the controller (170) can determine whether there is a problem-solving sequence that matches the problem situation (S609).

[0137] The memory (140) may store multiple problem situations and multiple problem-solving sequences that match each of the multiple problem situations.

[0138] The controller (170) can determine whether a problem-solving sequence exists based on whether a problem-solving sequence corresponding to a problem situation matching the analysis result is stored in the memory (140). If a problem-solving sequence corresponding to a problem situation is stored in the memory (140), the controller (170) can determine that a problem-solving sequence corresponding to a problem situation exists.

[0139] If the controller (170) determines that there is no problem-solving sequence matching the problem situation when the problem-solving sequence is not stored in memory (140), the controller (170) may determine that there is no problem-solving sequence matching the problem situation.

[0140] If there is a problem-solving sequence that matches the problem situation, the controller (170) can execute the problem-solving sequence (S611).

[0141] The problem-solving sequence may be a sequence that changes the state of a setting element of a display device (100) related to the problem situation.

[0142] For example, if the result of the analysis of the voice command is an intention to turn on a specific channel and the problem situation is that the power of the set-top box is off, the problem-solving sequence may be a sequence that changes the power of the set-top box connected to the external device interface (135) from off to on.

[0143] If there is no problem-solving sequence that matches the problem situation, the controller (170) can output a suggested response for problem solving (S613).

[0144] The response for problem solving can be a response that recommends a problem solving sequence.

[0145] In one embodiment, the controller (170) can display a suggested response for problem solving on the display (180).

[0146] In another embodiment, the controller (170) can output a suggested response for problem solving through the speaker (185).

[0147] In another embodiment, the controller (170) can transmit a proposed response for problem solving to the user's terminal via a wireless communication interface (173).

[0148] In one embodiment, the controller (170) can display a suggested response for problem solving on the execution screen of the chatbot application as the chatbot application is executed.

[0149] The controller (170) may display a proposed response to resolve the problem situation on the display (180) based on the determination that a problem situation exists, or execute a problem-solving sequence to resolve the problem situation.

[0150] FIG. 7 is a diagram illustrating the process of executing a problem-solving sequence according to one embodiment of the present disclosure.

[0151] FIG. 7 may be an embodiment that embodies step S611 of FIG. 6.

[0152] Referring to FIG. 7, if there is a problem-solving sequence that matches the problem situation, the controller (170) can determine the first state value of a setting element related to the problem situation (S701).

[0153] The controller (170) can change the first state value identified based on the problem-solving sequence to a second state value (S703).

[0154] FIGS. 8a to 8c are drawings illustrating examples of problem-solving sequences according to embodiments of the present disclosure.

[0155] FIGS. 8a to 8c, the controller (170) can be replaced with a situation awareness module. The situation awareness module may be a hardware chip provided separately from the controller (170), but is not limited thereto and may be a hardware chip provided in the controller (170).

[0156] Fig. 8a shows a voice command<ch 1을 틀어줘> This is a diagram explaining the process of performing a problem-solving sequence for a problem situation where the power of the set-top box (800) is turned off, and the intention is to turn on a specific channel.

[0157] Referring to FIG. 8a, the controller (170) can request connection status information of the set-top box (800) from the external device interface (135) (S801), and can receive connection status information of the set-top box (800) from the external device interface (135) (S803).

[0158] The connection status information of the set-top box (800) may include information indicating whether the set-top box (800) is connected to one of the interface terminals among the plurality of interface terminals provided in the external device interface (135) and whether an external input is set to the said interface terminal.

[0159] The connection status information of the set-top box (800) may further include information on whether a signal received from the set-top box (800) is received at the corresponding interface terminal.

[0160] The controller (170) can determine that the power of the set-top box (800) is on when a signal is received through the interface terminal connected to the set-top box (800), and can determine that the power of the set-top box (800) is off when no signal is received through the interface terminal connected to the set-top box (800).

[0161] The controller (170) can transmit an external input switching request to the external device interface (135) based on the received STB connection status information (S805), and can transmit a power key input request of the set-top box (800) to the remote control device (200) based on the received external device connection status information (S807).

[0162] If the controller (170) is not the interface terminal to which the set-top box (800) is connected, it can transmit an external input switching request to the external device interface (135) to switch the external input to the interface terminal to which the set-top box (800) is connected.

[0163] If the controller (170) determines that the power of the set-top box (800) is off based on the received external device connection status information, it may transmit a power key input request (or command) of the set-top box (800) to the remote control device (200) to turn on the power of the set-top box (800) through the user input interface (150).

[0164] The remote control device (200) can transmit a power-on command to the set-top box (800) based on the power key input of the received set-top box (800) (S809). Accordingly, the power of the set-top box (800) can be turned on.

[0165] Referring to Fig. 8b, the voice command is<TV 전원이 자동으로 꺼져> This is a diagram explaining the process of performing a problem-solving sequence for a problem situation in which the power of the display device (100) is automatically turned off, and the power off timer function of the display device (100) is activated.

[0166] The controller (170) can obtain power setting status information of the display device (100) from a storage or memory (140) inside the controller (170) (S811).

[0167] Power setting status information may include information regarding whether the power of the display device (100) is on or off, whether the power-on timer function is enabled, and whether the power-off timer function is enabled. The power-on timer function may be a function that automatically turns on the power of the display device (100) at a specific time. The power-off timer function may be a function that automatically turns off the power of the display device (100) at a specific time.

[0168] The controller (170) can change the power setting state based on the acquired power setting state information (S813).

[0169] The controller (170) can disable the power off function if the power off function is enabled.

[0170] If, voice command<TV 전원이 자동으로 켜져> If the intention is to indicate the inconvenience of the power of the display device (100) being automatically turned on, the power off timer function of the display device (100) can be switched from an enabled state to a disabled state.

[0171] Referring to FIG. 8c, this is a diagram illustrating the process of performing a problem-solving sequence for a problem situation in which a voice command is intended to show a symptom of misrecognition of the activation word "<Voice recognition works even though I didn't say anything>" and the voice recognition service is automatically activated.

[0172] The controller (170) can obtain sensitivity setting status information of the microphone (151) provided in the user input interface (150) (S821), and can change the sensitivity setting status based on the obtained sensitivity setting status information (S823).

[0173] The controller (170) can automatically reduce the sensitivity of the trigger word recognition by reducing the sensitivity setting value of the microphone (151) to a value lower than the existing value.

[0174] As such, according to an embodiment of the present disclosure, as a problem-solving sequence for a problematic situation that is disrupted is automatically executed in response to a user's utterance, the time and effort required for the user to reach a problem-solving method may be reduced.

[0175] FIG. 9 is a diagram illustrating an example of identifying a problem situation through the analysis of a user's voice command according to one embodiment of the present disclosure and providing a suggested response for solving the identified problem situation.

[0176] The embodiment of FIG. 9 can be applied in cases where a problem-solving sequence suitable for the problem situation is not stored.

[0177] Referring to FIG. 9, the controller (170) can receive a voice command spoken by a user and can transmit a voice signal corresponding to the received voice command to a relay server (500-1) through a network interface (133). The relay server (500-1) can transmit the voice signal to an STT server (500-2).

[0178] The STT server (500-2) can convert a voice signal into text data using an STT engine and can transmit the converted text data to a relay server (500-1).

[0179] The relay server (500-1) can transmit text data received from the STT server (500-1) to the NLP server (500-3).

[0180] The NLP server (500-3) can obtain analysis results from the received text data using an NLP engine.

[0181] The NLP server (500-3) can generate analysis results by sequentially performing a morphological analysis step, a syntactic analysis step, a speech act analysis step, and a dialogue processing step on text data.

[0182] The morphological analysis stage is the step of classifying text data corresponding to the speech uttered by the user into morphemes, which are the smallest meaningful units, and determining the part of speech of each classified morpheme.

[0183] The syntactic analysis stage utilizes the results of the morphological analysis stage to classify text data into noun phrases, verb phrases, adjective phrases, etc., and determines the relationships that exist between each classified phrase. Through the syntactic analysis stage, the subject, object, and modifiers of the speech uttered by the user can be determined.

[0184] The speech act analysis stage is a step that analyzes the intent behind the voice command uttered by the user by utilizing the results of the syntactic analysis stage. Specifically, the speech act analysis stage determines the intent of the sentence, such as whether the user is asking a question, making a request, or simply expressing an emotion.

[0185] The dialogue processing stage is a stage that uses the results of the speech act analysis stage to determine whether to answer, respond to, or ask a question inquiring for additional information in response to the user's utterance.

[0186] After the conversation processing step, the NLP server (500-3) can generate an analysis result including one or more of a response, a response, or a request for additional information regarding the user's spoken intent, and can transmit the generated analysis result to the relay server (500-1). The relay server (500-1) can transmit the analysis result to the display device (100).

[0187] The controller (170) of the display device (100) can recognize a problem situation based on the analysis results and the viewing environment of the display device (100). If there is a viewing environment that interferes with the intent of the analysis results, the controller (170) can determine whether there is a problem situation that matches the analysis results.

[0188] The controller (170) can extract a suggested response phrase suitable for the recognized problem situation from the memory (140). The suggested response phrase may include at least one of a phrase for identifying the problem situation or a phrase for solving the problem situation.

[0189] The controller (170) can display the extracted suggestion response phrase on the display (180) through the chatbot application.

[0190] The relay server (500-1), STT server (500-2), and NLP server (500-3) can be configured as a single server (500).

[0191] FIG. 10 is a flowchart for explaining a method of operation of a display device according to another embodiment of the present disclosure.

[0192] In particular, FIG. 10 is an embodiment that automatically detects a problem situation and executes a problem-solving sequence suitable for the detected problem situation or provides a suggested response suitable for the problem situation.

[0193] The controller (170) can detect a problem situation based on the viewing environment of the display device (100) (S1001).

[0194] The controller (170) can automatically detect problematic situations that interfere with viewing based on the viewing environment.

[0195] The controller (170) can determine whether there is a problem-solving sequence that matches the problem situation (S1003).

[0196] For example, if the problem situation is that the power to the set-top box (800) is off, the problem-solving sequence may be a sequence that automatically turns on the power to the set-top box (800), as shown in FIG. 8a.

[0197] As another example, if the problem situation is one where the power of the display device (100) is automatically turned off, the problem-solving sequence may be a sequence that disables the power off timer function.

[0198] As another example, if the problem situation is a situation where the trigger word is misrecognized, the problem-solving sequence may be a sequence that reduces the sensitivity of the microphone (151).

[0199] In one embodiment, the controller (170) can obtain a sequence in which the user solved a problem situation regarding a past problem situation as a problem-solving sequence, and can match the problem situation with the problem-solving sequence and store it in memory (140).

[0200] In another embodiment, the controller (170) may receive a table from the server (500) containing a plurality of problem situations and a plurality of problem-solving sequences corresponding thereto, and store the received problem-solving sequence table in memory (140). Memory (140) may store a plurality of problem-solving sequences corresponding to each of the plurality of problem situations.

[0201] If the controller (170) determines that there is a problem-solving sequence that matches the problem situation, it can execute the problem-solving sequence (S1005).

[0202] The controller (170) can automatically execute a problem-solving sequence that matches the problem situation without separate user input.

[0203] If the controller (170) determines that there is no problem-solving sequence that matches the problem situation, it may output a suggested response for problem solving (S1007).

[0204] In one embodiment, the memory (140) may store a table including a plurality of problem situations and a plurality of proposed responses corresponding to each of the plurality of problem situations. The display device (100) may receive the table from the server (500) and store the received table in the memory (140).

[0205] FIG. 11a is a diagram illustrating an example of providing a proposed response suitable for a problem situation according to an embodiment of the present disclosure, and FIG. 11b to 11f are tables describing a proposed response phrase suitable for a problem situation and an action performed when the proposed response phrase is clicked.

[0206] One example of a proposal response could be a proposal response phrase.

[0207] Referring to FIG. 11a, if the controller (170) detects a problem situation in which the power of the display device (100) is automatically turned off based on the viewing environment of the display device (100), it may display a suggested response (1110) on the execution screen (1100) of the chatbot application. The chatbot application may be an application that enables the user to obtain desired information or perform specific tasks through conversation with the user. The suggested response (1100) may include a phrase confirming that the power of the display device (100) is automatically turned off.

[0208] In one embodiment, the controller (170) can display a suggested response (1110) on the display (180) according to the execution of the chatbot application.

[0209] According to another embodiment, if a problem situation matching a voice command spoken by a user is obtained, the controller (170) may display a suggested response (1110) on the display (180). The controller (170) may also proceed with a problem-solving sequence according to a command to select the suggested response (1110).

[0210] In another embodiment, the controller (170) may display a suggested response (1110) on the display (180) when a problem situation is detected.

[0211] In another embodiment, the controller (170) may display a specific item on the display (180) after displaying the execution screen (1100) of the chatbot application, and when it receives a voice command corresponding to the entry of a specific item, display a suggested response (1110) for the entered specific item. The specific item may be any one of a screen item for screen settings included on the execution screen (1100) of the chatbot application, a sound item for audio settings, a connection item for connection settings with an external device, a power item for power settings of the display device (100), a system item for system settings of the display device (100), or a useful function item for providing useful functions.

[0212] When the controller (170) receives a command to select a specific item on the execution screen (1100) of the chatbot application, it can display a suggested response phrase corresponding to the selected specific item on the display (180).

[0213] In one embodiment, the controller (170) may provide a suggested response for the most recently occurred problem situation when multiple problem situations are detected.

[0214] In another embodiment, the controller (170) may provide a proposed response for the next detected problem situation when a plurality of problem situations are detected, or when the problem situation is resolved, such as by satisfying the condition for deleting the proposed response. The condition for deleting the proposed response may be when a command to select the proposed response (1110) is received.

[0215] In another embodiment, if the controller (170) has displayed a suggested response more than a certain number of times but has not selected, it may display a suggested response for the following problem situation.

[0216] In this way, according to an embodiment of the present disclosure, a problem situation that may cause inconvenience to the user can be monitored frequently within the display device (100) to store a list of problem situations, and when a problem situation occurs, a solution can be proactively presented through a chatbot app, or a solution can be presented immediately when the problem situation is voiced, thereby helping the user to use the display device (100) more conveniently.

[0217] FIG. 11b is a first situation recognition table (1120) that describes a suggested response phrase for each problem situation and an action performed when the suggested response phrase is clicked when a problem situation related to the power of the display device (100) occurs. The first situation recognition table (1120) may be stored in memory (140).

[0218] When a suggested response phrase is clicked, a subsequent response phrase is provided or a problem-solving sequence can be executed. The action performed when a suggested response phrase is clicked may be an action that executes a problem-solving sequence.

[0219] The controller (170) can display a suggested response phrase for each problem situation and a subsequent response phrase displayed as the suggested response phrase is clicked on the execution screen of the chatbot application.

[0220] FIG. 11c is a second situation recognition table (1130) describing a suggested response phrase for each problem situation and an action performed when the suggested response phrase is clicked, when a problem situation related to the battery of the remote control device (200) and a problem situation related to an external device connected to the display device (100) occur. The second situation recognition table (1130) may be stored in memory (140).

[0221] For example, if the controller (170) detects a problem situation where there is a device connected to an HDMI terminal provided in the external device interface (135) but the integrated remote control is not set up, it may display a suggestion response phrase "<Would you like to set up the integrated remote control for the connected device?>" on the execution screen of the chatbot application. The controller (170) may execute an integrated remote control app for setting up the integrated remote control according to a command to click the suggestion response phrase.

[0222] In addition, the memory (140) may store a third situation recognition table (1140) of FIG. 11d, a fourth situation recognition table (1150) of FIG. 11e, and a fifth situation recognition table (1160) of FIG. 11f, which include suggested response phrases and actions upon clicking for each of the various problem situations recognized according to the viewing environment of the display device (100).

[0223] FIG. 12 is a diagram illustrating the process of outputting a proposed response when a problem situation occurs in which a starting word is misrecognized according to one embodiment of the present disclosure.

[0224] Each of the voice input interface (1210), voice conductor (1220), and chatbot conductor (1240) may be a component included in the controller (170) of the display device (100), or a component provided separately from the controller (170).

[0225] The AI ​​adapter (1230) may be a wireless communication circuit that is included in the network interface (133) or provided separately from the network interface (133).

[0226] The voice input interface (1210) can recognize a command word from a voice signal received through the microphone (151) and can transmit the recognition result of the recognized command word to the AI ​​adapter (1230) (S1201). The recognition result of the command word may include a voice signal and a notification indicating that the command word has been recognized.

[0227] The AI ​​adapter (1230) can transmit the recognition result of the received starter word to the server (500) (S1203) and receive the starter word verification result from the server (500) (S1205).

[0228] The activator verification result may include information indicating whether the verification of the activator was successful or failed. The activator verification result may include information indicating the success or failure of the activator verification. The activator verification result may further include a verification score and text corresponding to the activator. The verification score may be a score indicating the similarity between the activator speech signal corresponding to the recognized activator and the activator speech signal corresponding to a pre-set activator.

[0229] The AI ​​adapter (1230) can transmit the received activation word verification result to the voice conductor (1220) (S1207), and the voice conductor (1220) can determine whether to execute the voice agent app based on the activation word verification result (S1209).

[0230] A voice agent app may be an application for providing voice recognition services. A voice conductor (1220) may execute the voice agent app if the verification of the starting word is successful, and may not execute the voice agent app if the verification of the starting word fails.

[0231] The AI ​​adapter (1230) can transmit the starter word verification result to the voice input interface (1210) (S1211), and the voice input interface (1210) can update the number of starter word misrecognitions based on the received starter word verification result (S1213).

[0232] The number of misrecognitions of a motive word may represent the number of times a motive word was recognized but its verification failed.

[0233] The voice input interface (1210) can transmit a notification of the occurrence of a problem situation to the chatbot conductor (1240) when the number of misrecognitions of the trigger word reaches a preset number (S1217).

[0234] The notification of a problem situation may be a notification indicating that a problem situation has occurred in which the misrecognition of the trigger word occurs a preset number of times.

[0235] The chatbot conductor (1240) can execute a chatbot application in response to a notification of the occurrence of a received problem situation and output a suggested response on the execution screen of the chatbot application (S1219).

[0236] The chatbot conductor (1240) can extract a suggestion response phrase "<Does direct voice recognition appear automatically?>" from the third situation recognition table (1140) of FIG. 11d and display the extracted suggestion response phrase on the execution screen of the chatbot application.

[0237] FIGS. 13a and FIGS. 13b are drawings illustrating the process of recognizing and saving a problem situation according to the setting of the power timer function of the display device.

[0238] Referring to FIG. 13a, the controller (170) can detect the inconvenient intent experienced as the power of the display device (100) is automatically turned on based on the analysis result of a voice command spoken by the user (S1301).

[0239] The controller (170) can determine whether the power-on timer function is enabled (S1303).

[0240] When the power-on timer function is enabled, the controller (170) determines that there is no problem situation matching the voice command spoken by the user and may not save the problem situation (S1305).

[0241] If the power-on timer function is enabled, the controller (170) can determine whether the difference between the current time and the time when the power of the display device (100) was previously turned on is less than 5 minutes (S1307).

[0242] The controller (170) can store in memory (140) a problem situation in which the power is automatically turned on when the difference between the current time and the time when the power of the display device (100) was previously turned on is less than 5 minutes (S1309).

[0243] The controller (170) can store in memory (140), a problem situation where the power is automatically turned on, a suggested response phrase matching the power automatic turning on, and an action when the suggested response phrase is clicked, as in the first situation recognition table (1120) of FIG. 11b.

[0244] Referring to FIG. 13b, the controller (170) can detect the inconvenience experienced by the display device (100) as the power is automatically turned off based on the analysis result of a voice command spoken by the user (S1311).

[0245] The controller (170) can determine whether the power off timer function is enabled (S1313).

[0246] When the power off timer function is enabled, the controller (170) determines that there is no problem situation matching the voice command spoken by the user and may not save the problem situation (S1315).

[0247] If the power off timer function is enabled, the controller (170) can determine whether the difference between the current time and the time when the power of the display device (100) was previously turned off is less than 5 minutes (S1317).

[0248] The controller (170) can store in memory (140) a problem situation in which the power is automatically turned off if the difference between the current time and the time when the power of the display device (100) was previously turned off is less than 5 minutes (S1319).

[0249] The controller (170) can store in memory (140), a problem situation where the power is automatically turned off, a suggested response phrase matching the power automatically turned off, and an action when the suggested response phrase is clicked, as in the first situation recognition table (1120) of FIG. 11b.

[0250] In this way, according to an embodiment of the present disclosure, a problematic situation that interferes with viewing can be automatically saved from a voice command spoken by a user.

[0251] FIG. 14 is a diagram illustrating the process of transmitting a voice signal corresponding to a activator spoken by a user to a server when a problem situation of misrecognition of a activator is detected according to one embodiment of the present disclosure.

[0252] The display device (100) can detect a problem situation of misrecognition of a trigger word and output a suggested response on the execution screen (1400) of the chatbot application. After that, the display device (100) can display a report phrase (1410) for updating a voice signal corresponding to a trigger word spoken by the user on the execution screen (1400) of the chatbot application to improve long-distance voice recognition.

[0253] The display device (100) can transmit a voice signal corresponding to a trigger word spoken by the user to the server (500) according to a command to select a report phrase (1410).

[0254] The server (500) can update the activation word verification logic based on the received voice signal. The server (500) can extract voice features from the received voice signal and store them by matching them with user information.

[0255] A display device (100) according to an embodiment of the present disclosure may include a display (180); and a controller (170) that receives a voice command spoken by a user, obtains an analysis result of the received voice command, determines whether a problem situation matching the analysis result exists based on the viewing environment of the display device, and, based on the determination that the problem situation exists, displays a proposed response to solve the problem situation on the display or executes a problem-solving sequence to solve the problem situation.

[0256] The display device (100) may further include a memory (140) that stores a plurality of problem situations generated based on the viewing environment, and the controller (170) may extract a problem situation suitable for the analysis result among the plurality of problem situations stored in the memory.

[0257] The memory (140) may further store multiple proposed responses that are matched to each of the multiple problem situations.

[0258] The memory (140) may further store multiple problem-solving sequences that are matched to each of the multiple problem situations.

[0259] The controller (170) can execute the problem-solving sequence if there is a problem-solving sequence that matches the problem situation, and if there is no problem-solving sequence that matches the problem situation, it can display the proposed response that matches the problem situation on the display.

[0260] The controller (170) can execute the troubleshooting sequence of sending a request to the remote control device to turn on the power of the set-top box when the analysis result is an intention to turn on a specific channel and the problem situation is a situation where the power of the set-top box connected to the display device is off.

[0261] The controller (170) can execute the problem-solving sequence that reduces the sensitivity of the microphone equipped in the display device when the analysis result indicates a misrecognition of the trigger word and the problem situation is a situation where the voice recognition service is automatically activated.

[0262] The above controller (170) may execute the above troubleshooting sequence to disable the power timer function when the above analysis result indicates an inconvenience of the power being automatically controlled and the above problem situation is that the power timer function is activated in the display device.

[0263] According to one embodiment of the present disclosure, the above-described method can be implemented as code that is readable by a processor on a medium on which a program is recorded. Examples of media that are readable by a processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0264] The display device described above is not limited to the configuration and method of the embodiments described above; rather, all or part of each embodiment may be selectively combined to allow for various modifications to be made.

Claims

1. In a display device, Display; and A controller comprising: receiving a voice command spoken by a user, obtaining an analysis result of the received voice command, determining whether a problem situation matching the analysis result exists based on the viewing environment of the display device, and, based on the determination that the problem situation exists, displaying a proposed response to resolve the problem situation on the display or executing a problem-solving sequence to resolve the problem situation. Display device.

2. In Paragraph 1, It further includes a memory that stores a plurality of problem situations generated based on the above viewing environment, and The above controller Extracting the problem situation suitable for the analysis result among the multiple problem situations stored in the memory above. Display device.

3. In Paragraph 2, The above memory is Storing multiple proposed responses matched to each of the above multiple problem situations Display device.

4. In Paragraph 2, The above memory is Storing multiple problem-solving sequences that are matched to each of the above multiple problem situations Display device.

5. In Paragraph 1, The above controller If there is a problem-solving sequence that matches the above problem situation, execute the problem-solving sequence, and If there is no problem-solving sequence matching the above problem situation, the proposed response matching the above problem situation is displayed on the display. Display device.

6. In Paragraph 1, The above controller If the above analysis result indicates an intention to turn on a specific channel and the above problem situation is that the power of the set-top box connected to the display device is off, execute the above troubleshooting sequence that transmits a request to the remote control device to turn on the power of the set-top box. Display device.

7. In Paragraph 1, The above controller If the above analysis result indicates an intention of misrecognizing a trigger word, and the above problem situation is one in which the voice recognition service is automatically activated, execute the above problem-solving sequence that reduces the sensitivity of the microphone equipped in the display device. Display device.

8. In Paragraph 1, The above controller The above analysis result is intended to indicate an inconvenience of automatic power control, and if the above problem situation is that the power timer function is activated in the display device, the above troubleshooting sequence for deactivating the power timer function is executed. Display device.

9. In a method of operating a display device, A step of receiving a voice command spoken by the user; A step of obtaining the analysis result of a received voice command; A step of determining whether there exists a problem situation matching the analysis result based on the viewing environment of the display device; and Based on the determination that the above problem situation exists, the method includes the step of displaying a proposed response to resolve the problem situation or executing a problem-solving sequence to resolve the problem situation. Method of operation of a display device.

10. In Paragraph 9, A step of storing a plurality of problem situations generated based on the above viewing environment; and The method further includes the step of extracting the problem situation suitable for the analysis result from among the plurality of problem situations stored above. Method of operation of a display device.

11. In Paragraph 10, The method further includes the step of storing a plurality of proposed responses matched to each of the plurality of problem situations and a plurality of problem-solving sequences matched to each of the plurality of problem situations. Method of operation of a display device.

12. In Paragraph 9, The step of displaying the above proposed response is If there is no problem-solving sequence matching the above problem situation, the method includes the step of displaying the proposed response matching the above problem situation. The step of executing the above problem-solving sequence is If there exists a problem-solving sequence that matches the above problem situation, the method includes the step of executing the problem-solving sequence. Method of operation of a display device.

13. In Paragraph 9, The step of executing the above problem-solving sequence is If the analysis result indicates an intention to turn on a specific channel and the problem situation is that the power of the set-top box connected to the display device is off, the above includes the step of executing the above problem-solving sequence to transmit a request to the remote control device to turn on the power of the set-top box. Method of operation of a display device.

14. In Paragraph 9, The step of executing the above problem-solving sequence is If the above analysis result indicates an intention of misrecognizing a trigger word and the above problem situation is a situation where the voice recognition service is automatically activated, the method includes the step of executing the above problem-solving sequence to reduce the sensitivity of the microphone equipped in the display device. Method of operation of a display device.

15. In Paragraph 9, The step of executing the above problem-solving sequence is The above analysis result is intended to indicate an inconvenience of automatic power control, and if the above problem situation is that the power timer function is activated in the display device, the method includes the step of executing the above problem-solving sequence to disable the power timer function. Method of operation of a display device.

Images