Speech recognition system, server, display device and control method thereof

Abstract

A voice recognition system, comprising: a server storing a plurality of manuals; and a display device. When the oral speech of a user is recognized, the display device sends feature information and an oral speech signal corresponding to the oral speech to the server, where the feature information is the feature information of the display device. The server sends a response signal to the oral speech signal to the display device based on the manual corresponding to the feature information in the plurality of manuals, and the display device processes an operation corresponding to the received response signal; thereby improving user convenience.

Description

[0001] This application is a divisional application of an application with an application date of November 17, 2015, a Chinese application number of "201510790693.3", and an invention title of "Voice Recognition System, Server, Display Device, and Control Method Thereof".

[0002] Cross - reference to related applications

[0003] This application claims the priority of Korean Patent Application No. 10 - 2014 - 0160130, filed on November 17, 2014, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety. Technical field

[0004] The apparatus and method corresponding to the embodiments relate to a voice recognition system, a server, a display device, and a control method thereof. More specifically, it relates to a voice recognition system, a server, a display device, and a control method thereof that process corresponding operations according to a response signal generated by recognizing oral speech. Background art

[0005] Electronic devices that recognize a user's oral speech and perform corresponding functions have been increasingly used. Generally, a display device capable of recognizing speech collects the oral speech of the user and sends an oral speech signal corresponding to the collected oral speech to a server connected via a network. The server that receives the oral speech signal analyzes the oral speech signal to determine the user's intention, generates a resulting response signal, and sends the generated response signal to the display device. Thus, the display device can execute a function corresponding to the user's oral speech or provide information based on the response signal received from the server.

[0006] However, display devices capable of recognizing speech in the related art have limitations in analyzing a user's oral speech and determining the user's intention based on the analysis result. For example, in the case of a simple function (e.g., "channel - up"), the server analyzes the oral speech signal to correctly determine the user's intention, generates a resulting response signal, and sends the generated signal to the display device. Thus, the display device can display the channel requested by the user based on the response signal.

[0007] However, when the oral speech is not clearly recognized or when user interaction is required, providing simple functions in the related art is not sufficient. If the user orally says "Tell me the recording method.", there is a problem because it is not possible to indicate to the user what to check or the operations the user uses for recording for each step, and only the recording method is displayed.

[0008] In addition, when oral speech such as "the screen is abnormal" is recognized, the hardware performance of the display device is not checked, and there may be no response to the oral speech. That is, when no executable response signal is generated from the oral speech, there is a problem because an incorrect operation is performed or there is no response.

[0009] In addition, although the accuracy of the response to complex oral speech is improved by using a server, there is still a problem because the response signal is generated without reflecting the characteristics of the corresponding display device. Summary of the Invention

[0010] Exemplary embodiments overcome the above-described deficiencies and other deficiencies not described above. In addition, it is not required that the embodiments overcome the above-described deficiencies, and the exemplary embodiments may not overcome any of the above problems.

[0011] Embodiments provide a voice recognition system, a server, a display device, and a control method thereof that generate a response signal to a user's oral speech based on a pre-stored manual and process an operation corresponding to the response signal.

[0012] According to one aspect, a voice recognition system includes: a server that stores a plurality of manuals; and a display device that, when a user's oral speech is recognized, sends characteristic information and an oral speech signal corresponding to the oral speech to the server, where the characteristic information is the characteristic information of the display device, the server sends a response signal to the oral speech signal to the display device based on the manual corresponding to the characteristic information among the plurality of manuals, and the display device processes an operation corresponding to the received response signal.

[0013] When the response signal includes a guidance message or a diagnosis result, the display device may display the guidance message or the diagnosis result.

[0014] When the response signal is a control signal for processing an operation required for diagnosing the display device, the display device may process the operation according to the control signal, send the status of the operation to the server, and the server diagnoses the display device based on the operation status and sends a diagnosis result to the display device.

[0015] According to another aspect, a server includes: at least one processor capable of communicating with a plurality of devices; and a storage unit that stores a plurality of manuals, where the at least one processor: receives an oral speech signal corresponding to oral speech recognized by one of the plurality of devices and the characteristic information of the device, generates a response signal to the oral speech signal based on the manual corresponding to the characteristic information among the plurality of manuals in the storage unit, and sends the response signal to the device.

[0016] When the dictated voice signal is a signal for the function of the device, at least one processor may send a response signal to the device, including a guidance signal for guiding a method of performing the function of the device according to a manual.

[0017] When the dictated voice signal is a signal for the operating state of the device, at least one processor may diagnose the device and send a diagnosis result to the device.

[0018] When it is diagnosed that the operating state of the device is an error state that can be resolved autonomously, at least one processor may send a guidance message for guiding a solution to the diagnosis result to the device.

[0019] When it is diagnosed that the operating state of the device is an error state that cannot be resolved autonomously, at least one processor may send the diagnosis result and the characteristic information of the device to a service center.

[0020] The characteristic information of the device may include at least one of the following: panel information, type information of the device, user area information, and usage time information.

[0021] According to another aspect, a display device includes: a voice recognition unit that recognizes a user's dictated voice; a communication unit that performs communication with a server storing a plurality of manuals; and a processor that, when the dictated voice is determined to be a control signal for controlling the operation of the display device, processes an operation corresponding to the control signal, and when the dictated voice is determined to be a signal for at least one of the function and the operating state of the display device, sends the characteristic information of the display device and the dictated voice signal corresponding to the dictated voice to the server through the communication unit.

[0022] When receiving a response signal generated according to the content of the manual corresponding to the characteristic information of the display device and the dictated voice signal from the server, the processor processes an operation corresponding to the response signal.

[0023] The display device may further include a display unit, and when the response signal includes a guidance message or a diagnosis result, the processor may display the guidance message or the diagnosis result.

[0024] When the response signal is a control signal for processing an operation required for diagnosing the display device, the processor may process the operation according to the control signal and send the state of the operation to the server through the communication unit.

[0025] The characteristic information of the display device may include at least one of the following: panel information, type information of the display device, user area information, and usage time information.

[0026] According to another aspect, a control method of a display device includes: recognizing a user's spoken voice; determining the type of the spoken voice; and when the spoken voice is determined to be a control signal for controlling an operation of the display device, processing an operation corresponding to the control signal, and when the spoken voice is determined to be a signal for at least one of a function and an operation state of the display device, sending feature information of the display device and a spoken voice signal corresponding to the spoken voice to a server.

[0027] The control method may further include: receiving, from the server, a response signal generated according to a manual corresponding to the feature information of the display device and the content of the spoken voice signal, and processing an operation corresponding to the response signal.

[0028] In processing an operation corresponding to the response signal, when the response signal includes a guidance message or a diagnosis result, the guidance message or the diagnosis result may be displayed.

[0029] In processing an operation corresponding to the response signal, when the response signal is a control signal for processing an operation required for diagnosing the display device, an operation depending on the control signal may be processed, and a state of the operation may be sent to the server.

[0030] The feature information of the display device may include at least one of the following: panel information, type information of the display device, user area information, and usage time information.

[0031] According to another aspect, there is provided a computer-readable medium storing a computer program, and the computer program performs the following operations: recognizing a user's spoken voice; determining the type of the spoken voice; and when the spoken voice is determined to be a control signal for controlling an operation of the display device, processing an operation corresponding to the control signal, and when the spoken voice is determined to be a signal for at least one of a function and an operation state of the display device, sending feature information of the display device and a spoken voice signal corresponding to the spoken voice to a server.

[0032] According to another aspect, there is provided a method, including: recognizing a user's voice input from a device among a plurality of devices, diagnosing an operation state of the device based on the recognized voice input, and when the operation state indicates that the device is experiencing an error, providing a part of an operation manual of the device to the user, where the part relates to the error.

[0033] The part may relate to a solution part in the manual for solving the error.

[0034] The part may include a user guide for correcting the error.

[0035] Additional and / or other aspects and advantages of the embodiments will be set forth in part in the following description, and in part will be obvious from the description, or may be recognized from the practice of the embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] By referring to the accompanying drawings to describe certain exemplary embodiments, the above and / or other aspects of the embodiments will become more apparent, in which:

[0037] Figure 1 is a diagram showing a speech recognition system according to an exemplary embodiment;

[0038] Figure 2 is a block diagram showing the configuration of a server according to an exemplary embodiment;

[0039] Figure 3 is a diagram for describing an example of generating a response signal by using the content of a user's oral speech and a manual;

[0040] Figure 4 is a diagram for describing an example of generating a response signal by using the content of another user's oral speech and a manual according to an exemplary embodiment;

[0041] Figure 5 is a diagram for describing the operations of a server and a display device according to an exemplary embodiment;

[0042] Figure 6 is a diagram for describing the diagnostic result of a display device according to an exemplary embodiment;

[0043] Figure 7 is a diagram for describing the diagnostic result of a display device according to another exemplary embodiment;

[0044] Figure 8 is a diagram for describing a control signal for controlling a display device according to an exemplary embodiment;

[0045] Figure 9 is a diagram for describing in detail the operations of a storage unit and a processor according to an exemplary embodiment;

[0046] Figure 10 is a block diagram showing the configuration of a display device according to an exemplary embodiment;

[0047] Figure 11 is a block diagram showing the configuration of a speech recognition unit according to an exemplary embodiment;

[0048] Figure 12 is a flowchart for describing a server control method according to an exemplary embodiment;

[0049] Figure 13 is a flowchart for describing a display device control method according to an exemplary embodiment;

[0050] Figure 14is a flowchart for describing the execution of functions of a display device according to an exemplary embodiment;

[0051] Figure 15 is a flowchart for describing the operation state diagnosis of a display device according to an exemplary embodiment;

[0052] Figure 16 is a diagram for overall describing a speech recognition system according to an exemplary embodiment; and

[0053] Figure 17 and Figure 18 is a diagram for describing a modification example. Detailed Description

[0054] Various modifications can be made to the exemplary embodiments of the present disclosure. Accordingly, specific exemplary embodiments are shown in the drawings and described in detail in the detailed description. However, it is to be understood that the present disclosure is not limited to the specific exemplary embodiments, but includes all modifications, equivalent substitutions, and replacements without departing from the scope and spirit of the present disclosure. In addition, well-known functions and structures are not described in detail because they would obscure the present disclosure with unnecessary details.

[0055] Certain exemplary embodiments will now be described in more detail with reference to the accompanying drawings.

[0056] In the following description, the same reference numerals are used for the same elements even in different figures. Things defined in the description (e.g., detailed structures and elements) are provided to assist in a comprehensive understanding of the embodiments. Thus, it is obvious that the exemplary embodiments can be implemented without these specifically defined things. In addition, well-known functions and structures are not described in detail because they would obscure the embodiments with unnecessary details.

[0057] Embodiments will now be described in detail with reference to the accompanying drawings.

[0058] Figure 1 is a diagram showing a speech recognition system 10 according to an exemplary embodiment. Figure 1 The speech recognition system 10 shown in includes a server 100 and a display device 200.

[0059] Server 100 can communicate with display device 200. Specifically, server 100 can receive an oral speech signal corresponding to the user's oral speech and characteristic information of display device 200, and send a response signal generated based thereon. The characteristic information of display device 200 can be classified into unique information, setting information, and other information. The unique information can include panel information, type information of display device 200, etc., and the setting information can include volume information, channel information, etc. set by the user. In addition, the other information can include usage area information and usage time information. For example, the unique information can be a smart phone of manufacturer A, the setting information can be channel 6, and the other information can be the usage time from 9 o'clock to 10 o'clock. Meanwhile, the oral speech signal can be a speech signal obtained by converting the user's oral speech. For example, the oral speech signal can be a speech signal obtained by removing noise from the user's oral speech, or a digital speech signal converted from an analog signal.

[0060] In addition, server 100 can store manuals for multiple display devices 200. For example, server 100 can store different manuals according to the type, manufacturer, and function of display device 200. The manuals in this article can refer to instruction manuals or user guides. In detail, the manual can be a technical communication document, etc. for providing assistance to users using specific devices. For example, the manual can include various information, including the configuration, function, usage method, error-solving method, A / S center connection information, warnings, etc. of each device.

[0061] When server 100 receives an oral speech signal corresponding to the user's oral speech and characteristic information, server 100 can generate a response signal to the oral speech signal based on the manual corresponding to the characteristic information, and send the generated response signal to display device 200. The response signal in this article can be implemented in various ways according to the content of the oral speech signal. As an example, when the oral speech signal is associated with content querying the usage method, operation, or function of display device 200, server 100 finds the answer to the query in the manual, and the answer is to be included in the response signal. Alternatively, when the oral speech signal is associated with content regarding incorrect operation of display device 200, server 100 finds the solution method for solving the incorrect operation, and the solution method is to be included in the response signal. In addition, server 100 can generate and provide a response signal having various contents according to the manual and the content of the user's oral speech signal. Therefore, users can perform various precise controls even through the voice control method. In the following parts to be described, exemplary embodiments of generating various response signals according to examples of oral speech signals will be described in detail.

[0062] Meanwhile, the display device 200 can be implemented by a broadcast receiving device (e.g., a smart TV or a set-top box), but this is only an exemplary embodiment, and the display device 200 can be implemented by various electronic devices, including smart phones, desktop PCs, tablet PCs, notebook PCs, navigation devices, etc.

[0063] In addition, the display device 200 can recognize the user's spoken voice. However, this is only an example, and the display device 200 can recognize the user's spoken voice through an external device. For example, a remote controller can recognize the user's spoken voice and send the recognized spoken voice to the display device. In addition to the remote controller, any electronic device capable of recognizing spoken voice and communicating with the display device can recognize the spoken voice and send the recognized spoken voice to the display device.

[0064] The display device 200 can determine the type of the user's spoken voice. For example, the user's spoken voice can be determined as a control signal for controlling the operation of the display device 200. Alternatively, the user's spoken voice can be determined as a signal for the functions and operation states of the display device 200. The determination of the type of the spoken voice will be described in detail below.

[0065] When the user's spoken voice is determined as a control signal for controlling the operation of the display device 200, the display device 200 can execute an operation corresponding to the control signal. For example, when a spoken voice such as "increase volume" is input, the display device 200 can execute an operation of increasing the volume of the display device 200.

[0066] Meanwhile, when the user's spoken voice is determined as a signal for the functions and operation states of the display device 200, in the case where the display device 200 sends a spoken voice signal corresponding to the input user's spoken voice and the characteristic information of the display device 200 to the server 100 and receives a response signal corresponding to the user's spoken voice signal from the server 100, the display device 200 can execute an operation corresponding to the response signal. When a guidance message is included in the response signal, the display device 200 can display the guidance message.

[0067] Meanwhile, it is described that the voice recognition system 10 includes the above-mentioned display device 200, but the voice recognition system 10 is not limited thereto. For example, any device including a voice recognition function can be used instead of the display device 200. However, a device without a display function can support a voice support function, etc., instead of a display function. After that, for ease of description, the voice recognition system 10 including the display device 200 will be described. As described above, the voice recognition system 10 generates a response signal corresponding to the user's spoken voice based on the characteristic message of the display device 200 to allow the user to more precisely control the display device 200.

[0068] After that, reference will be made to Figures 2 to 8Describe the server 100 in more detail.

[0069] Figure 2 is a block diagram showing the configuration of a server 100 according to an exemplary embodiment. Figure 2 The server 100 shown in includes a storage unit 110, a communication unit 120, and a processor 130.

[0070] The storage unit 110 can store manuals of multiple display devices 200. The manuals of the display devices 200 may differ from each other according to the type, manufacturer, and function of the display devices 200.

[0071] In addition to the manuals, the storage unit 110 can store various programs and data. As an example, the storage unit 110 can store programs and data required for analyzing oral speech signals. In addition, the storage unit 110 can store information such as the voice history information of users and EPG information.

[0072] The communication unit 120 can communicate with the display device 200. When the communication unit 120 receives an oral speech signal corresponding to the user's oral speech and the feature information of the display device 200 from the display device 200, the communication unit 120 can send a corresponding response signal to the display device 200. For this purpose, the communication unit 120 can include various communication cards and modules, including a wired local area network (LAN) card, a wireless LAN card, a Bluetooth module, a near field communication (NFC) module, a wireless communication module, etc. In this case, the wireless communication module refers to a module that performs communication according to communication standards including IEEE, ZigBee, third generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), etc.

[0073] The processor 130 controls the overall operation of the server 100.

[0074] The processor 130 can be used interchangeably with a central processing unit, a microprocessor, a controller, etc. as a component generally used for controlling a device, and can be implemented together with other functional units such as the communication unit 120 through a system on a chip (system on a chip or SoC) as a component that can control the overall operation of the device.

[0075] When the processor 130 receives the feature information of the display device 200 from the display device 200, the processor acquires a manual corresponding to the feature information. Here, the feature information of the display device 200 may be at least one of the following: panel information, type information of the display device 200, user area information, and usage time information. The processor 130 can specify the display device 200 and determine the corresponding manual based on the unique information of the display device 200 (for example, the panel information and the type information in the feature information).

[0076] The processor 130 can control the communication unit 120 such that a response signal to the oral speech signal can be generated based on the manual and the generated response signal can be sent to the display device 200. As described above, the response signal herein can be implemented in various ways according to the content of the oral speech signal.

[0077] Figure 3 It is a diagram for describing an example of generating a response signal by using the content of the user's oral speech and the manual.

[0078] When the oral speech is a signal for the function of the display device 200, the processor 130 can generate a guidance message for guiding the method of executing the function according to the manual corresponding to the display device 200, and send a response signal including the generated guidance message to the display device 200. As Figure 3 shown, when the user orally says "Please record", the oral speech signal corresponding to the input oral speech is sent to the server 100 together with the characteristic information of the display device 200.

[0079] The processor 130 receives the oral speech signal and the characteristic message through the communication unit 120. The processor 130 detects the manual corresponding to the received characteristic message in the manual stored in the storage unit 110. The processor 130 checks whether the display device 200 has an external device recording function based on the detected manual. For example, when the display device 200 is a model with an external device recording function, the processor 130 can send a response signal including the guidance message "Please connect an external device." to the display device 200. In this case, the response signal can include a control signal for displaying the guidance message and a control signal for notifying the server 100 of the connection status when the external device 310 is connected to the display device 200. Therefore, when the user connects the external device 310 to the display device 200 later, the display device 200 can send an external device connection completion signal to the server 100.

[0080] In this case, the external device can be an external device memory stick or various storage media connected to the external device, and can be implemented through various wired interfaces (such as HDMI) and various wireless interfaces (such as WiFi, Bluetooth, etc.) outside the external device.

[0081] When the processor 130 receives the external device connection completion signal from the display device 200, the processor 130 checks the manual regarding the operation after the external device connection is completed. In Figure 3 it, it is assumed that the external device is used for the first time, and it is assumed that when the external device is used for the first time, the manual includes content asking the user for the format. Therefore, the processor 130 can send a response signal including the guidance message "Do you want to format?" to the display device 200 based on the manual.

[0082] In Figure 3 Figure 3 , it is assumed that the display device 200 is a display device 200 with an external device recording function. However, the display device 200 can be a display device without an external device recording function or a display device with an internal device recording function. In addition to the external device recording function according to this model, the internal device recording function also uses an embedded storage device.

[0083] In the case where the model has both an external device recording function and an internal device recording function, when the processor 130 receives the oral voice "Please record" from the user, it can send a response signal to the display device 200 including a guidance message "Please select an external device or an internal device as the memory in which to record the program or data."

[0084] In this case, when the external device is not properly connected and thus no program or data is recorded, a guidance message for properly connecting the external device can be output through the display or voice.

[0085] On the contrary, in the case where the model does not have an external device recording function and only has an internal device recording function, the processor can send a response signal to the display device 200, which includes a control signal for not performing the operation of displaying a guidance message for guiding the connection of a storage medium and displaying a guidance message for notifying the start of recording, or includes a control signal for immediately performing recording.

[0086] Figure 4 is a diagram for describing an example of generating a response signal by using the content of another user's oral voice and a manual according to an exemplary embodiment.

[0087] In Figure 3 Figure 3 , the user's oral voice is an instruction for the function of the display device, while in Figure 4 Figure 4 , the user's oral voice is a query related to the method of using the function of the display device 200. As shown in Figure 4 Figure 4 , when the user dictates "How do I record?", the oral voice signal corresponding to the input oral voice is sent to the server 100 together with the characteristic information of the display device 200.

[0088] By receiving the oral voice signal and the characteristic information, the processor 130 detects the manual corresponding to the received characteristic information in the manual. The processor 130 checks how the display device 200 performs recording based on the detected manual. In Figure 4 Figure 4 , it is assumed that when the user dictates "How do I perform recording?", the display device 200 provides a menu for selecting the program to be recorded and the order of the programs to be recorded, and this information can be stored in the manual.

[0089] The processor 130 may send a response signal including a guidance message "Please select a program to record." to the display device 200 based on the manual. In this case, the response signal may include a control signal for displaying the guidance message. In addition, when the user dictates a program to be recorded, the response signal may include a control signal for notifying the server 100 of the dictated voice signal for the program to be recorded.

[0090] Therefore, when the user dictates the program "ABCD" to be recorded after dictation, the display device 200 may send the dictated voice signal "ABCD" to the server 100.

[0091] When the processor 130 receives the dictated voice signal for the program to be recorded from the display device 200, the processor 130 checks the manual for operations after determining the program to be recorded. The processor 130 may send a response signal including a guidance message "Please select the recording order among ABCD." to the display device 200 based on the manual.

[0092] In Figure 4 , assuming that the program ABCD is recognized as a recordable program, but when the program ABCD does not exist or the broadcast time has passed, the processor 130 may send a guidance message "You cannot perform recording." to the display device 200.

[0093] In addition, when the program ABCD has no order and is a short program, the processor 130 may generate a response signal for allowing the display device 200 to immediately perform recording.

[0094] In addition, the user may query the operating state or incorrect operation of the display device 200. When the dictated voice signal is a signal for the operating state of the display device 200, the processor 130 diagnoses the operating state of the display device 200 and may send a response signal including the diagnosis result to the display device 200. The operating state indicates whether the display device 200 is operating normally or whether the display device 200 is operating incorrectly.

[0095] Figure 5 is a diagram for describing the operations of the server 100 and the display device 200 according to an exemplary embodiment. In Figure 5 , it is assumed that the user dictates "The sound is abnormal."

[0096] When the user dictates "The sound is abnormal.", the processor 130 may send a response signal including a guidance message such as "Do you want to perform a sound test?" to the display device 200.

[0097] In addition, the processor 130 may include a response signal containing a control command so that the display device 200 can be allowed to perform a sound test based on the manual. As Figure 5As shown, when the server 100 receives the sound test result from the display device 200, the processor 130 may generate a new response signal according to the result and send the generated response signal to the display device 200, and may include a guidance message such as "The audio cable is not correctly connected." in the new response signal.

[0098] Figure 6 is a diagram for describing the diagnostic result of the display device 200 according to an exemplary embodiment.

[0099] When the processor diagnoses that the operating state of the display device 200 is an error state that can be resolved autonomously, the processor 130 may send a new response signal to the display device 200, and the new response signal includes a guidance message for guiding the solution method of the diagnostic result. The processor 130 may also determine whether the operating state of the display device 200 can be resolved autonomously based on the manual. For example, as Figure 6 shown, when as a result of performing the sound test according to the dictated voice signal, the audio cable is not correctly connected, the processor 130 may send a new response signal including a guidance message such as "Please connect the audio cable as follows." to the display device 200.

[0100] Figure 7 is a diagram for describing the diagnostic result of the display device 200 according to another exemplary embodiment.

[0101] When the processor 130 diagnoses that the operating state of the display device 200 is an error state that cannot be resolved autonomously, the processor may send the diagnostic result and the characteristic information of the display device 200 to the service center. The processor 130 may also determine whether the operating state of the display device 200 can be resolved autonomously based on the manual. For example, as Figure 7 shown, although the sound test is performed according to the dictated voice signal, the sound test itself may not be performed or the sound may not be output normally. In this case, the processor 130 may send a new response signal including a guidance message such as "The sound card does not respond. We will request repair." to the display device 200. In addition, the processor 130 may request the manufacturer or service center of the corresponding display device 200 to perform repair based on the manual corresponding to the characteristic message of the display device 200.

[0102] Figure 8 is a diagram for describing the control signal for controlling the display device 200 according to an exemplary embodiment.

[0103] Meanwhile, when the dictated voice signal is a control signal for controlling the operation of the display device 200, the processor 130 may send a response signal including a control signal corresponding to the control signal to the display device 200. For example, as Figure 8As shown, when an input user's oral speech such as "increase volume" is input, the server 100 may receive an oral speech signal corresponding to the oral speech from the display device 200.

[0104] The processor 130 may determine that the received oral speech signal is a signal for controlling the operation of the display device 200. Accordingly, the processor 130 may send a response signal including a control signal for controlling the display device 200 to the corresponding display device 200 based on a manual corresponding to the feature information. In addition, the processor 130 may cause a signal for displaying a result to be included in the response signal together with the control signal. At the same time, the control signal may vary according to the display device 200. As an example, the increase volume signal in a smart phone may be different from the increase volume signal in a smart TV, and thus, the processor 130 may generate a control signal corresponding to the corresponding display device 200.

[0105] For example, in the case where the resolution of a smart phone of manufacturer A is WVGA and an oral speech for regenerating a specific image is input from a user, the processor 130 may generate a response signal including the following command and send the generated response signal to the display device 200: regenerate an image having WVGA among images having different resolutions.

[0106] At the same time, in Figure 8 it is described that even when the oral speech signal is a control signal, the server 100 sends a response signal thereto. However, this is one of the exemplary embodiments of the server 100, and the display device 200 may directly execute an operation corresponding to the control signal. This will be described below.

[0107] Figure 9 is a diagram for describing in detail the operations of the storage unit 110 and the processor 130 according to an exemplary embodiment.

[0108] The storage unit 110 includes a dialogue agent module 111, an action agent module 112, and a manual module 113. Specifically, the manual module 113 includes a manual collection module 113-1, a manual parsing module 113-2, a manual analysis module 113-3, and a manual database 113-4.

[0109] The manual collection module 113-1 is a module that collects information related to the manual of the display device 200. The manual parsing module 113-2 is a module that decomposes a series of text strings into meaningful text strings in the collected manual-related information and forms a text structure constructed thereby. The manual analysis module 113-3 is a module that changes the formed text structure into a manual having a format, and the manual having the format may be stored in the manual database 113-4. The manual data set 113-4 stores the generated manual.

[0110] The dialogue agent module 111 is a module that detects text from an oral speech signal corresponding to the user's oral speech to analyze the user input. The action agent module 112 is a module that generates a response signal based on information related to the extracted oral object, object area, object function, and main features.

[0111] The CPU 131 accesses the storage unit 110 to perform various operations by using various modules in the storage unit 110. In addition, the CPU 131 copies various modules stored in the storage unit 110 into the RAM 132 and executes the modules copied into the RAM 132 to perform various operations.

[0112] The processor 130 can extract an oral object, object area, object function, and main features regarding the text detected from an oral speech signal corresponding to the user's oral speech when using the dialogue agent module 111. For example, when the user orally states "How do I perform recording?", the processor 130 extracts the text from the oral speech signal corresponding to the user's oral speech and analyzes the extracted text to extract that the oral object is the function of the query display device 200, the object area is the method of using the function of the display device 200, and the object function corresponds to the recording function.

[0113] When using the action agent module 112, the processor 130 can generate a response signal based on a manual corresponding to the feature information of the display device 200. For example, when the user orally states "How do I perform recording?", since the object function is the recording function, the processor 130 can extract the information related to the recording function in the manual. In addition, since the object area is the method of using the function of the display device 200, the processor 130 can extract the method of using the recording function from the information related to the recording function. In addition, since the oral object is the function of the query display device 200, the processor 130 can generate a response signal for displaying a detailed description of the method of using the recording function.

[0114] The processor 130 does not use the dialogue agent module 111 and the action agent module 112 separately, but can organically use the dialogue agent module 111 and the action agent module 112 based on the feature information received from the display device 200 and the corresponding manual in the respective processes.

[0115] The server 100 generates response signals corresponding to the respective display devices 200 as described above, and thus, the user can control the display device 200 more efficiently.

[0116] Figure 10 is a block diagram showing the configuration of the display device 200 according to an exemplary embodiment. Figure 10 The display device 200 shown in includes a voice recognition unit 210, a communication unit 220, and a processor 230.

[0117] Meanwhile, Figure 10 The various components are comprehensively illustrated by using the following situation as an example: The display device 200 is a device having various functions including a voice recognition function, a communication function, a display function, etc. Thus, in some exemplary embodiments, Figure 10 it is shown that some of the components may be omitted or modified, and other components may also be added.

[0118] The voice recognition unit 210 recognizes and processes an audio signal including a user's voice to generate a user voice signal. In this case, the voice recognition unit 210 may be located in the main body of the display device 200, but this is only an exemplary embodiment, and the voice recognition unit 210 may be located outside the main body (e.g., a remote controller or a separate microphone). When the voice recognition unit 210 is located outside the main body, the voice recognition unit 210 may send the generated user voice signal to the main body of the display device 200 through a wired / wireless interface (e.g., WiFi, Bluetooth, etc.).

[0119] Reference will be made to Figure 11 describe a method in which the voice recognition unit 210 recognizes an audio signal including a user's voice to generate a user voice signal.

[0120] Figure 11 is a block diagram showing the configuration of the voice recognition unit 210 according to an exemplary embodiment. Figure 11 The voice recognition unit 210 shown in it includes a microphone 211, an analog-to-digital converter (ADC) 212, an energy determination unit 213, a noise removal unit 214, and an oral speech signal generation unit 215.

[0121] The microphone 211 receives an analog-type audio signal including a user's voice.

[0122] In addition, the ADC 212 converts the multi-channel analog signal input from the microphone into a digital signal.

[0123] In addition, the energy determination unit 213 calculates the energy of the converted digital signal to determine whether the energy of the digital signal is greater than or equal to a predetermined value. When the energy of the digital signal is greater than or equal to the predetermined value, the energy determination unit 213 sends the input digital signal to the noise cancellation unit 214, and when the energy of the digital signal is less than the predetermined value, the energy determination unit 213 does not output the input digital signal to the outside and waits for another input. Thus, the entire audio processing process is not activated by voice but by sound, so that unnecessary power consumption can be prevented.

[0124] When inputting the input digital signal into the noise removal unit 214, the noise removal unit 214 removes the noise component from the digital signal including the noise component and the user's dictated speech component, and outputs the digital signal without the noise component to the dictated speech signal generation unit 215. In this case, the noise component, which is the scattered noise that may be generated in the home environment, may include air conditioner sounds, vacuum cleaner sounds, music sounds, etc.

[0125] The dictated speech signal generation unit 215 tracks the user's dictated position existing within the 360° range based on the speech recognition unit 210 by using the positioning / speaker tracking module to obtain the direction information of the user's dictated speech signal. In addition, through target dictated sound extraction, the dictated speech signal generation unit 215 extracts the target sound source existing within the 360° range based on the speech recognition unit 210 by using the digital signal without noise and the direction information of the user's dictated speech to generate the dictated speech signal.

[0126] Meanwhile, as described above, generating the speech signal by removing unnecessary environmental noise is only an exemplary embodiment, and the technical essence of the embodiment can also be applied to the exemplary embodiment of generating the dictated speech signal by determining whether there is a keyword in the user's speech.

[0127] Return Figure 10 The communication unit 220 performs communication with the server 100. Specifically, the communication unit 220 may send the user's dictated speech signal generated by the speech recognition unit 210 and the feature information of the display device 200, and receive a response signal from the server 100. In this case, the communication unit 120 may be implemented by Ethernet, wireless LAN, Wi-Fi, etc., but is not limited thereto.

[0128] The processor 230 controls the overall operation of the display device 200.

[0129] The processor 230 may determine the type of the dictated speech. The user's dictated speech may be determined as a control signal for controlling the operation of the display device 200 or a signal for the functions and operation states of the display device 200 for the user.

[0130] When determining that the user's dictated speech is a control signal for controlling the operation of the display device 200, the processor 230 may perform the operation corresponding to the control signal. For example, when inputting the dictated speech such as "increase the channel", the processor may perform the operation of changing the channel of the display device 200.

[0131] Meanwhile, the processor 230 can even perform the same function with respect to similar dictated voices. For example, although different dictated voices are input (such as "increase volume" and "raise the voice"), the processor 230 can similarly perform the operation of increasing the volume. However, the processor is not limited to this and can be configured to perform only one operation with respect to one dictated voice. For example, when a dictated voice such as "increase volume" is input, the processor performs the operation of increasing the volume. However, in addition, when dictated voices such as "raise the voice", "increase the volume", "I can't hear the sound", etc. are input, the processor 230 may not perform an operation either.

[0132] In addition, even when the dictated voices of multiple users overlap with each other, the processor can also perform corresponding operations. For example, even when a dictated voice such as "increase volume" of user 1 and a dictated voice such as "I'm very hungry" of user 2 are input simultaneously, the processor 230 can identify "increase volume" by distinguishing the differences between the voices of user 1 and user 2 and perform the corresponding operation.

[0133] Meanwhile, when the dictated voice of the user is determined to be a signal for the functions and operation states of the display device 200, the processor 230 can send a dictated voice signal corresponding to the input user dictated voice and the characteristic information of the display device 200 to the server 100. However, the processor 230 is not limited to this, and the processor 230 can receive a signal for the functions and operation states of the display device 200 to perform corresponding operations. For example, when the processor 230 receives a dictated voice for the operation state of the display device 200, the processor 230 can check the operation state and perform and display the resulting diagnosis. However, the corresponding operations provided by the server 100 when the dictated voice of the user is determined to be a signal for the functions and operation states of the display device 200 are described later. In addition, when the processor 230 receives a response signal from the server 100, the processor 230 can perform an operation corresponding to the response signal. In detail, when the response signal includes a guidance message or a diagnosis result, the processor 230 can display the guidance message or the diagnosis result. For example, the guidance message can be a message for each step of using the functions of the display device 200, and the diagnosis result can be information indicating whether the display device 200 is normal through the diagnosis of the display device 200.

[0134] In addition, when the response signal is a control signal for performing an operation required for diagnosing the display device 200, the processor 230 may perform the operation according to the control signal and send the operation status to the server 100 through the communication unit 120. For example, when the processor 230 receives a control signal for diagnosing the displayed image from the server 100, the processor 230 may check the quality, capacity, and display status of the displayed image according to the received control signal and send the checked quality, capacity, and display status to the server 100.

[0135] As described above, the display device 200 sends characteristic information to more efficiently control the functions of the display device 200 through the user's spoken voice.

[0136] Figure 12 is a flowchart for describing a control method of the server 100 according to an exemplary embodiment.

[0137] The server 100 may receive a spoken voice signal corresponding to the spoken voice input in the display device 200 and the characteristic information of the display device 200 (S1210). In this case, the spoken voice signal may be a digital signal converted from an analog signal.

[0138] In addition, the server 100 generates a response signal for the spoken voice signal based on a manual corresponding to the characteristic information (S1220). In addition, the server 100 sends the generated response signal to the display device 200 (S1230).

[0139] In addition, in sending the response signal to the display device 200 (S1230), when the spoken voice signal is a signal for a function of the display device 200, a guidance message for guiding a method of performing the function according to the manual corresponding to the display device 200 is generated, and a response signal including the guidance message is sent to the display device 200.

[0140] In addition, in sending the response signal to the display device 200 (S1230), when the spoken voice signal is a signal for the operation status of the display device 200, the operation status of the display device 200 is diagnosed, and a response signal including the diagnosis result is sent to the display device 200.

[0141] In addition, in sending the response signal to the display device 200 (S1230), when it is determined that the operation status of the display device 200 is an error state that can be autonomously resolved, a response signal including a guidance message for guiding a solution method for the diagnosis result may be sent to the display device 200.

[0142] In addition, when sending a response signal to the display device 200 (S1230), if it is determined that the operating state of the display device 200 is an error state that cannot be resolved autonomously, the diagnostic result and the characteristic information of the display device 200 may be sent to the service center.

[0143] Meanwhile, the characteristic information may include at least one of the following: panel information, type information of the display device 200, user area information, and usage time information.

[0144] Figure 13 is a flowchart for describing a control method of the display device 200 according to an exemplary embodiment.

[0145] The display device 200 can recognize the user's spoken voice signal (S1310). In addition, it is determined whether the spoken voice is a control signal for controlling the operation of the display device 200 (S1320). When the spoken voice is determined to be a control signal for controlling the operation of the display device 200, the operation corresponding to the control signal is executed (S1330).

[0146] When it is determined that the spoken voice is not a control signal for controlling the operation of the display device 200, it is determined whether the spoken voice is a signal for at least one of the functions and operating states of the display device 200 (S1340). The determination of the type of the spoken voice is described herein, which is divided into two steps, but is not limited thereto. For example, the display device 200 can simultaneously determine whether the spoken voice is a control signal and whether the spoken voice is a signal for at least one of the functions and operating states.

[0147] When the spoken voice is determined to be a signal for at least one of the functions and operating states of the display device 200, the characteristic information of the display device 200 and the spoken voice signal corresponding to the spoken voice are sent to the server 100 (S1350). The characteristic information of the display device 200 may include at least one of the following: panel information, type information of the display device 200, user area information, and usage time information. When it is determined that the spoken voice is not a signal for at least one of the functions and operating states of the display device 200, no operation may be performed.

[0148] In addition, the control method may further include: receiving a response signal generated according to the manual corresponding to the characteristic information and the content of the spoken voice signal from the server 100, and processing the operation corresponding to the response signal.

[0149] In addition, in processing the operation corresponding to the response signal, when the response signal includes a guidance message or a diagnostic result, the guidance message or the diagnostic result may be displayed.

[0150] In addition, in the operation corresponding to the response signal, when the response signal is a control signal for processing an operation required for diagnosing the display device 200, the operation according to the control signal can be processed, and the operation status can be sent to the server.

[0151] In addition, the characteristic information of the display device 200 may include at least one of the following: panel information, type information of the display device 200, user area information, and usage time information.

[0152] Figure 14 It is a flowchart for describing the function execution of the display device 200 according to an exemplary embodiment.

[0153] First, there is a recording request from the user (S1410). The user's recording request can be input by oral speech or by operating a button. In addition, when the oral speech is "Please record now", the display device 200 can immediately start recording, and when the oral speech is "How do I record?", the display device 200 can send the characteristic information and the oral speech signal corresponding to the oral speech to the server 100.

[0154] When there is a recording query by the user's oral speech, the server 100 checks the manual corresponding to the characteristic information of the display device 200. Assume that an external device is required for recording in the corresponding manual.

[0155] The server 100 generates a response signal for checking whether an external device is connected to the display device 200 and sends the generated response signal to the display device 200. In addition, the response signal may include a control signal for checking the status of the external device when the external device is already connected and a control signal for displaying an instruction to connect the external device when the external device is not connected.

[0156] The display device 200 that receives the response signal checks the external device (S1420). When the external device is not connected, an instruction to connect the external device is given (S1425). In addition, after a predetermined time has passed, the external device can be checked again.

[0157] Meanwhile, as a result of checking the external device, when the external device is already connected, the status of the external device is checked (S1430). When the external device is used for the first time, a format is requested from the user (S1435). In addition, after a predetermined time has passed, the status of the external device can be checked again. Meanwhile, as a result of checking the status of the external device, when the external device is used for the first time, recording is performed (S1440).

[0158] Figure 15 It is a flowchart for describing the operation status diagnosis of the display device 200 according to an exemplary embodiment.

[0159] First, input the dictated speech with abnormal user voice (S1510). Accordingly, the display device 200 sends the feature information and the dictated speech signal corresponding to the dictated speech to the server 100, and the server checks the manual corresponding to the feature information of the display device 200. A response signal for performing a sound test is generated based on the corresponding manual.

[0160] The display device 200 that receives the response signal from the server 100 performs a sound test (S1520). When the sound is abnormal after performing the sound test, it is determined whether user processing is available (S1525). Whether user processing is available can be determined by the display device 200 itself, but the result of the sound test is sent to the server 100 for the server 100 to determine.

[0161] When it is determined that user processing is not available, the feature information is sent to the service center (S1530). This can also be performed by the display device 200 or the server 100. Meanwhile, when it is determined that user processing is available, the processing method can be guided to the user.

[0162] When it is determined that the operation state is normal, or even if the operation state is abnormal after performing the sound test but user processing is available, the cable is first checked (S1540). However, the embodiment is not limited thereto, and it is preferable to check the sound source. When the cable is abnormal, a cable connection request is made (S1545). In addition, after a predetermined time has passed, the cable can be checked again. Meanwhile, when the cable is normal, a message indicating that the cable is normal is displayed (S1550).

[0163] Figure 14 and Figure 15 The control method according to various exemplary embodiments is described in, however, it is not limited thereto. Specifically, the manual can be diversified according to the manufacturer, type, etc. of the display device 200, and regarding Figure 15 the user's dictated speech "the sound is abnormal" in, it is preferable to perform a voice data for checking the cable or the content instead of the sound test.

[0164] Figure 16 is a diagram for overall describing the speech recognition system 10 according to an exemplary embodiment.

[0165] First, input the user's spoken voice (S1610). When the display device 200 determines that it may not directly process the user's spoken voice, it may send the spoken voice signal corresponding to the user's spoken voice and the feature information to the server 100. The server 100 extracts the spoken object, object area, object function, and main features from the recognized spoken voice signal (S1620). In addition, the server 100 determines whether the spoken voice signal is used to control the display device 200 based on the extracted information (S1630). When it is determined that the spoken voice signal is not used to control the display device 200, the server 100 may not generate a response signal or generate a response signal that allows the display device 200 not to perform an operation. When the user says "What is today's main meal?", since the spoken voice is not used to control the display device 200, the display device 200 may not perform an operation.

[0166] When it is determined that the spoken voice signal is used to control the display device 200, the server 100 determines whether the spoken voice signal is a spoken voice signal for requesting guidance (S1640). When the spoken voice signal is determined to be a spoken voice signal for requesting guidance, the server 100 generates a response signal based on the manual and sends the generated response signal to the display device 200. The display device 200 operates according to the received response signal (S1645). When the user's spoken voice such as "How to use the touchpad function of the remote control?" is input, a response signal including a guidance message for guiding the method of using the touchpad function of the remote control is generated based on the manual of the corresponding display device 200, and the display device 200 may display the guidance message.

[0167] Meanwhile, when it is determined that the spoken voice signal is not a spoken voice signal for requesting guidance, the server 100 determines whether the spoken voice signal is a spoken voice signal for requesting diagnosis (S1650). When it is determined that the spoken voice signal is a spoken voice signal for requesting diagnosis, the server 100 determines whether there is a problem with the hardware corresponding to the attribute (S1660). When the user's spoken voice such as "The image is abnormal." is input, it can be determined whether there is a problem in the video processing unit corresponding to the image attribute, and when the user's spoken voice such as "The voice is abnormal." is input, it can be determined whether there is a problem in the audio processing unit corresponding to the voice attribute.

[0168] When it is determined that there is a problem with the hardware, the user is notified of the failure of the display device 200, and service support is requested by contacting the service center (S1670). When it is determined that there is no problem with the hardware, the display device 200 operates according to the response signal generated based on the manual (S1680). When the user's spoken voice such as "The image is abnormal." is input and it is determined that there is no problem in the video processing unit, a message allowing the user to verify the content or a message requesting to connect the cable may be displayed.

[0169] Meanwhile, when it is determined that the dictated speech signal is not a dictated speech signal for requesting a diagnosis, the server 100 executes the function corresponding to the dictated speech signal (S1635). When the user dictates "increase volume", the display device 200 may execute the operation of increasing the volume not through the dictated speech signal for requesting guidance nor through the dictated speech signal for requesting a diagnosis, but through the dictated speech signal for controlling the display device 200. In this case, the display device 200 may execute the operation of increasing the volume based on the response signal generated by the server 100 after the dictated speech signal is sent to the server 100. However, the display device 200 may also execute the operation of increasing the volume by itself. In the latter case, the display device 200 even has a voice recognition function therein and may immediately execute basic voice recognition operations without passing through the server 100.

[0170] The server 100 and the display device 200 have been described separately as individual devices above. However, the server 100 and the display device 200 may be configured in a different manner.

[0171] Figure 17 and Figure 18 is a diagram for describing a modification example.

[0172] According to Figure 17 , the voice recognition system 10 includes a server 100, a display device 200, a voice recognition server 1710, and a database 1720. Descriptions of configurations that are repeated with the foregoing configurations will be omitted.

[0173] The display device 200 receives dictated speech from the user and converts the received dictated speech into a dictated speech signal to send the converted dictated speech signal to the voice recognition server 1710. The voice recognition server 1710 may extract text from the received dictated speech signal. The voice recognition server 1710 may then send the extracted text to the display device 200.

[0174] In addition, the display device 200 may send the received text to the server 100. The server 100 analyzes the received text to generate a response signal. The server 100 may receive a manual from the database 1720 and use the received manual during the generation of the response signal. The database 1720 may store different manuals according to the type, manufacturer, and function of the display device 200.

[0175] In Figure 17 , it is described that the voice recognition server 1710 and the database 1720 are configured as devices separate from the server 100.

[0176] Figure 18This is a diagram for describing the construction of a voice recognition system in the display device 200. According to Figure 18 , the display device 200 includes a voice input unit 210, a storage unit 240, a display unit 250, and a processor 230. Descriptions of configurations that are the same as the foregoing configurations will be omitted.

[0177] The storage unit 240 can store the manual of the display device 200. In this case, only the manual corresponding to the type and function of the display device 200 can be stored, and there is no need to store the manuals for all other display devices 200. Therefore, the manual stored in the storage unit 240 of the display device 200 can be smaller in information volume than the manual stored in the storage unit 110 of the server 100. In addition, the storage unit 240 can store data for voice recognition.

[0178] When the user's spoken voice is input by the voice input unit 210, the processor 230 extracts text from the user's spoken voice by using the data for voice recognition stored in the storage unit 240. In addition, the processor 230 analyzes the extracted text to operate the display device 200 based on the manual stored in the storage unit 240 of the display device 200.

[0179] According to Figure 18 's configuration, the display device 200 recognizes and analyzes the user's spoken voice therein to perform the resulting operations, and thus, the display device 200 can have a simpler configuration compared to the Figure 1 's voice recognition system. As the information stored in the storage unit 240, only the information corresponding to the corresponding display device 200 is required and there is no need to perform communication with the server 100, and thus, the communication unit 220 may not be provided either. However, the communication unit 220 is provided to handle operations for receiving response signals from the server 100 corresponding to complex spoken voices.

[0180] As described above, according to each exemplary embodiment, the user can control the display device 200 by spoken voice. In detail, various response signals are generated based on the characteristic information of the display device 200 to improve the convenience and efficiency of controlling the display device 200.

[0181] Meanwhile, the methods according to each exemplary embodiment are programmed to be stored in various storage media. Therefore, in various types of electronic devices that implement the storage media, the methods according to each exemplary embodiment can be implemented.

[0182] In detail, according to an exemplary embodiment, a non-volatile computer-readable medium storing a program may be provided, and the program sequentially performs: identifying a user's spoken voice, determining the type of the spoken voice, and when the spoken voice is determined to be a control signal for controlling the operation of a display device, processing an operation corresponding to the control signal, and when the spoken voice is determined to be a signal for at least one of the functions and operation states of a display device under computer control, sending characteristic information of the display device and a spoken voice signal corresponding to the spoken voice to a server.

[0183] A non-volatile computer-readable medium does not refer to a medium that stores data for a short time (such as registers, caches, memories, etc.), but rather a medium that stores data semi-persistently and can be read by a device. In detail, various applications or programs may be provided and stored simultaneously in a non-volatile computer-readable medium (such as CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, ROMs, etc.).

[0184] According to various exemplary embodiments, a display device and a server generate a response signal based on a manual corresponding to characteristic data of the display device according to a spoken voice signal corresponding to the spoken voice, so as to perform an operation corresponding to the response signal, thereby improving user satisfaction when controlling the display device.

[0185] The foregoing exemplary embodiments and advantages are merely exemplary and should not be construed as limiting the embodiments. The present disclosure can be easily applied to other types of devices. In addition, the description of the exemplary embodiments is intended to be illustrative and not to limit the scope of the claims, and many alternatives, modifications, and variations will be apparent to those skilled in the art.

Claims

1. A display device, comprising: a display; a voice input receiver; and a processor configured to: receive a user voice input through the voice input receiver, execute a function of the display device based on that the user voice input corresponds to a function control of the display device, control the display to output a UI corresponding to the function query based on the user voice input corresponding to a function query different from the function control and based on a manual of the display device and the user voice input, control the display to output a UI corresponding to the operation state when it is diagnosed based on status information of the display device that the operation state of the display device is a state that can be autonomously resolved, based on the user voice input corresponding to an operation state of the display device different from the function control, wherein the UI corresponding to the operation state includes a UI for indicating that the operation state of the display device is normal when the operation state of the display device is a normal state.

2. The display device according to claim 1, wherein, The processor is configured to: control the display to output a UI based on that the user voice input corresponds to a function control and corresponds to an external device that can be connected to the display device through a communicator of the display device, and based on a connection state of the external device and the user voice input.

3. The display device according to claim 2, wherein, The UI based on the connection state of the external device and the user voice input includes information for guiding connection to the external device when the external device is not connected.

4. The display device according to claim 1, Among them, The processor is configured to: control the display to output information corresponding to the function query according to the user voice input from a manual stored in at least one of the display device or the server, based on that the user voice input corresponds to a function query.

5. The display device according to claim 4, wherein, The UI corresponding to the function query includes information related to a solution to the function query.

6. The display device according to claim 1, wherein, The user voice input corresponding to the operation state of the display device is a voice input corresponding to a failure of a function executed in the display device.

7. The display device according to claim 1, wherein, The processor is configured to: control the display to output different UIs according to the operation state of the display device when the user voice input is received, based on that the user voice input corresponds to an operation state of the display device.

8. The display device according to claim 1, wherein, The processor is configured to: execute the same function as the function corresponding to the user voice input received through the voice input receiver, based on that the user voice input is received from an external device wirelessly connected to the display device.

9. A control method for a display device, the control method comprising: receiving a user voice input; executing a function of the display device based on that the user voice input corresponds to a function control of the display device, Based on that the user voice input corresponds to a function query different from the function control, and based on the manual of the display device and the user voice input, output a UI corresponding to the function query; and Based on that the user voice input corresponds to the operating state of the display device different from the function control, when it is diagnosed from the status information of the display device that the operating state of the display device is a state that can be solved autonomously, output a UI corresponding to the operating state, wherein, the UI corresponding to the operating state includes a UI for indicating that the operating state of the display device is normal when the operating state of the display device is a normal state.

10. The control method according to claim 9, further comprising: Based on that the user voice input corresponds to the function control and corresponds to an external device that can be connected to the display device, output a UI based on the connection state of the external device and the user voice input.

11. The control method according to claim 10, wherein, The UI based on the connection state of the external device and the user voice input includes information for guiding connection to the external device when the external device is not connected.

12. The control method according to claim 9, further comprising: Based on that the user voice input corresponds to the function query, output information corresponding to the function query according to the user voice input obtained from the manual stored in at least one of the display device or the server.

13. The control method according to claim 12, wherein, The UI corresponding to the function query includes information related to the solution of the function query.

14. The control method according to claim 9, wherein, The user voice input corresponding to the operating state of the display device is a voice input corresponding to a failure of a function executed in the display device.

15. The control method according to claim 9, wherein, The output of the UI corresponding to the operating state includes: outputting different UIs according to the operating state of the display device when the user voice input is received.

16. The control method according to claim 9, wherein, The user voice input is received through a voice input receiver of the display device, and wherein, the control method further comprises: Based on that the user voice input is received from an external device wirelessly connected to the display device, execute the same function as the function corresponding to the user voice input received through the voice input receiver.

Images