Display device and operation method therefor

Abstract

A display device according to an embodiment of the present disclosure may comprise: a display; a network interface for communicating with one or more servers; and a controller for obtaining a speaker registration sentence including a suggested word for speaker registration, displaying, upon receiving a request for the speaker registration, the generated speaker registration sentence on the display, obtaining a voice command corresponding to the displayed speaker registration sentence, and transmitting voice data corresponding to the obtained voice command to the one or more servers through the network interface, wherein the suggested word includes one of a name of latest content and a word indicating a dialect of a region.

Description

Display device and method of operation thereof

[0001] The present disclosure relates to a display device and to collecting a user's spoken voice through sentences for speaker registration.

[0002] Speaker recognition services use voice recognition technology to identify and distinguish specific speakers. Speaker recognition services can be used in a variety of applications, including security, education, voice command, and automation systems.

[0003] Speaker recognition services analyze the characteristics of the voices uttered by speakers, store each speaker's unique voice patterns, and identify speakers based on the stored voice patterns.

[0004] A speaker registration process is required to register the speaker's voice for speaker recognition service.

[0005] During the speaker registration process, suggested words are provided to improve the accuracy of voice recognition.

[0006] The speaker utters a given word, and a voice recognition device, such as a mobile device or TV, recognizes the spoken word and identifies the speaker.

[0007] However, in the conventional speaker registration process, only trigger commands or common spoken words were provided, resulting in uniform voice recognition that did not take into account the user's speech characteristics (dialect, speech style).

[0008] Additionally, there was a problem with low voice recognition rates for words such as the names of the latest content.

[0009] The purpose of this disclosure is to improve speaker recognition rate and voice recognition rate by utilizing the suggested words in the user's speaker registration process.

[0010] The purpose of this disclosure is to provide a personalized service for a speaker by extracting voice features for a given word during the speaker registration process.

[0011] A display device according to an embodiment of the present disclosure includes a display; a network interface communicating with one or more servers; and a controller that obtains a speaker registration sentence including a suggestion word for speaker registration, displays the generated speaker registration sentence on the display upon receiving a request for speaker registration, obtains a voice command corresponding to the displayed speaker registration sentence, and transmits voice data corresponding to the obtained voice command to the one or more servers through the network interface, wherein the suggestion word may include one of a name of the latest content or a word representing a regional dialect.

[0012] A method of operating a display device according to an embodiment of the present disclosure includes the steps of: obtaining a speaker registration sentence including a suggestion word for speaker registration; displaying the generated speaker registration sentence upon receiving a request for speaker registration; obtaining a voice command corresponding to the displayed speaker registration sentence; and transmitting voice data corresponding to the obtained voice command to one or more servers, wherein the suggestion word may include one of a name of the latest content or a word representing a regional dialect.

[0013] According to an embodiment of the present disclosure, speaker recognition rate and conversion accuracy of an STT model can be improved as voice data for names of recent content with little data, words corresponding to dialects, and words with low recognition rates are collected.

[0014] According to an embodiment of the present disclosure, a voice recognition service optimized for an individual can be provided by extracting features from a voice spoken by a user.

[0015] Figure 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0016] Figure 2 is a block diagram of a remote control device according to one embodiment of the present invention.

[0017] Figure 3 shows an example of an actual configuration of a remote control device according to one embodiment of the present invention.

[0018] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0019] FIG. 5 illustrates an artificial intelligence (AI) server according to one embodiment of the present disclosure.

[0020] FIG. 6 is a ladder diagram for explaining an operation method of an AI system according to an embodiment of the present disclosure.

[0021] FIG. 7 is a ladder diagram for explaining an operation method of an AI system according to an embodiment of the present disclosure.

[0022] FIGS. 8A to 8C are drawings illustrating examples of displaying various types of speaker registration sentences according to embodiments of the present disclosure.

[0023] FIG. 9 is a diagram showing a process of collecting voice data for a suggested word according to an embodiment of the present disclosure.

[0024] FIG. 10 is a flowchart for explaining an operating method of a display device according to an embodiment of the present disclosure.

[0025] Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "part" used in the following description for components are assigned or used interchangeably solely for the convenience of writing the specification, and do not in themselves have distinct meanings or roles.

[0026] A display device according to an embodiment of the present invention is, for example, an intelligent display device that adds computer-assisted functionality to its broadcast reception function. While faithfully performing the broadcast reception function, it can also be equipped with Internet functionality and other features, providing a more user-friendly interface, such as a manual input device, touch screen, or space remote control. Furthermore, with support for wired or wireless Internet functionality, it can connect to the Internet and a computer, enabling functions such as email, web browsing, banking, or gaming. A standardized, general-purpose operating system can be used for these various functions.

[0027] Accordingly, the display device described in the present invention can perform various user-friendly functions, for example, by allowing various applications to be freely added or deleted on a general-purpose operating system kernel. More specifically, the display device can be a network TV, HBB TV, smart TV, LED TV, OLED TV, etc., and in some cases, it can also be applied to smartphones.

[0028] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0029] Referring to FIG. 1, the display device (100) may include a broadcast receiving unit (130), an external device interface (135), a memory (140), a user input interface (150), a controller (170), a wireless communication interface (173), a display (180), a speaker (185), and a power supply circuit (190).

[0030] The broadcast receiving unit (130) may include a tuner (131), a demodulator (132), and a network interface (133).

[0031] The tuner (131) can select a specific broadcast channel according to a channel selection command. The tuner (131) can receive a broadcast signal for the selected specific broadcast channel.

[0032] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0033] The external device interface (135) can receive an application or a list of applications within an adjacent external device and transmit it to the controller (170) or memory (140).

[0034] The external device interface (135) can provide a connection path between the display device (100) and the external device. The external device interface (135) can receive one or more of images and audio output from an external device connected wirelessly or wiredly to the display device (100) and transmit them to the controller (170). The external device interface (135) can include a plurality of external input terminals. The plurality of external input terminals can include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0035] A video signal of an external device input through an external device interface (135) can be output through a display (180). A voice signal of an external device input through an external device interface (135) can be output through a speaker (185).

[0036] An external device that can be connected to the external device interface (135) may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is only an example.

[0037] The network interface (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet. The network interface (133) may transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.

[0038] Additionally, some content data stored in the display device (100) can be transmitted to a selected user or electronic device among other users or other electronic devices pre-registered in the display device (100).

[0039] The network interface (133) can access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, data can be transmitted or received with the corresponding server.

[0040] In addition, the network interface (133) can receive content or data provided by a content provider or network operator. That is, the network interface (133) can receive content such as movies, advertisements, games, VOD, broadcast signals, etc. and information related thereto provided from a content provider or network provider via a network.

[0041] Additionally, the network interface (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the Internet or content provider or network operator.

[0042] The network interface (133) can select and receive a desired application from among applications open to the public via a network.

[0043] The memory (140) stores a program for each signal processing and control within the controller (170), and can store signal-processed image, voice, or data signals.

[0044] In addition, the memory (140) may perform a function for temporary storage of video, audio, or data signals input from an external device interface (135) or a network interface (133), and may store information about a specific image through a channel memory function.

[0045] The memory (140) can store an application or a list of applications input from an external device interface (135) or a network interface (133).

[0046] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in the memory (140) and provide them to the user.

[0047] The user input interface (150) can transmit a signal input by the user to the controller (170) or transmit a signal from the controller (170) to the user. For example, the user input interface (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF) communication, or infrared (IR) communication, or process control signals from the controller (170) to be transmitted to the remote control device (200).

[0048] In addition, the user input interface (150) can transmit control signals input from local keys (not shown) such as a power key, channel key, volume key, and setting value to the controller (170).

[0049] An image signal processed by the controller (170) can be input to the display (180) and displayed as an image corresponding to the image signal. In addition, an image signal processed by the controller (170) can be input to an external output device through an external device interface (135).

[0050] The voice signal processed by the controller (170) can be output as audio to the speaker (185). In addition, the voice signal processed by the controller (170) can be input to an external output device through the external device interface (135).

[0051] In addition, the controller (170) can control the overall operation within the display device (100).

[0052] In addition, the controller (170) can control the display device (100) by a user command or internal program input through the user input interface (150), and can connect to a network to enable the user to download a desired application or application list into the display device (100).

[0053] The controller (170) enables the user-selected channel information, etc. to be output through a display (180) or speaker (185) together with processed video or audio signals.

[0054] In addition, the controller (170) allows a video signal or audio signal from an external device, for example, a camera or camcorder, input through the external device interface (135) to be output through the display (180) or speaker (185) in accordance with an external device video playback command received through the user input interface (150).

[0055] Meanwhile, the controller (170) can control the display (180) to display an image, for example, a broadcast image input through a tuner (131), an external input image input through an external device interface (135), an image input through a network interface, or an image stored in a memory (140) can be controlled to be displayed on the display (180). In this case, the image displayed on the display (180) can be a still image or a moving image, and can be a 2D image or a 3D image.

[0056] In addition, the controller (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from outside, and the content can be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0057] The wireless communication interface (173) can communicate with an external device through wired or wireless communication. The wireless communication interface (173) can perform short-range communication with the external device. To this end, the wireless communication interface (173) can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. This wireless communication interface (173) can support wireless communication between the display device (100) and a wireless communication system, between the display device (100) and another display device (100), or between the display device (100) and a network in which the display device (100, or an external server) is located via a short-range wireless communication network (Wireless Area Network). The short-range wireless communication network can be a short-range wireless personal area network (Wireless Personal Area Network).

[0058] Here, the other display device (100) may be a wearable device (e.g., a smartwatch, smart glasses, a head-mounted display (HMD)) or a mobile terminal such as a smart phone that can exchange data with (or be linked to) the display device (100) according to the present invention. The wireless communication interface (173) may detect (or recognize) a wearable device capable of communication around the display device (100).

[0059] Furthermore, if the detected wearable device is a device certified to communicate with the display device (100) according to the present invention, the controller (170) can transmit at least a portion of the data processed in the display device (100) to the wearable device via the wireless communication interface (173). Accordingly, a user of the wearable device can utilize the data processed in the display device (100) via the wearable device.

[0060] The display (180) can generate a driving signal by converting a video signal, data signal, OSD signal processed by the controller (170) or a video signal, data signal, etc. received from an external device interface (135) into R, G, and B signals, respectively.

[0061] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present invention, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the display device (100) actually implemented.

[0062] That is, two or more components may be combined into a single component, or a single component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments of the present invention, and their specific operations or devices do not limit the scope of the present invention.

[0063] According to another embodiment of the present invention, the display device (100) may receive and play back an image through a network interface (133) or an external device interface (135) without having a tuner (131) and a demodulator (132), unlike that shown in FIG. 1.

[0064] For example, the display device (100) may be implemented separately as an image processing device, such as a set-top box, for receiving broadcast signals or contents according to various network services, and a content playback device for playing contents input from the image processing device.

[0065] In this case, the operating method of the display device according to the embodiment of the present invention described below may be performed by any one of the display device (100) described with reference to FIG. 1, as well as an image processing device such as the separated set-top box, or a content playback device having a display (180) and an audio output unit (185).

[0066] Next, a remote control device according to an embodiment of the present invention will be described with reference to FIGS. 2 and 3.

[0067] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present invention, and FIG. 3 shows an example of an actual configuration of a remote control device (200) according to an embodiment of the present invention.

[0068] First, referring to FIG. 2, the remote control device (200) may include a fingerprint recognition device (210), a wireless communication circuit (220), a user input interface (230), a sensor (240), an output interface (250), a power supply circuit (260), a memory (270), a controller (280), and a microphone (290).

[0069] Referring to FIG. 2, the wireless communication circuit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present invention described above.

[0070] The remote control device (200) may be equipped with an RF circuit (221) capable of transmitting and receiving signals with the display device (100) according to RF communication standards, and an IR circuit (223) capable of transmitting and receiving signals with the display device (100) according to IR communication standards. In addition, the remote control device (200) may be equipped with a Bluetooth circuit (225) capable of transmitting and receiving signals with the display device (100) according to Bluetooth communication standards. In addition, the remote control device (200) may be equipped with an NFC circuit (227) capable of transmitting and receiving signals with the display device (100) according to NFC (Near Field Communication) communication standards, and a WLAN circuit (229) capable of transmitting and receiving signals with the display device (100) according to WLAN (Wireless LAN) communication standards.

[0071] In addition, the remote control device (200) transmits a signal containing information about the movement of the remote control device (200) to the display device (100) through a wireless communication circuit (220).

[0072] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF circuit (221), and, if necessary, can transmit commands for turning the power on / off, changing the channel, changing the volume, etc. to the display device (100) through the IR circuit (223).

[0073] The user input interface (230) may be configured as a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input interface (230). If the user input interface (230) includes a hard key button, the user can input commands related to the display device (100) to the remote control device (200) by pushing the hard key button. This will be described with reference to FIG. 3.

[0074] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).

[0075] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation, and may receive a push operation and a fingerprint recognition operation.

[0076] The power button (231) may be a button for turning the power of the display device (100) on / off.

[0077] The home button (232) may be a button for moving to the home screen of the display device (100).

[0078] The live button (233) may be a button for displaying a real-time broadcast program.

[0079] The external input button (234) may be a button for receiving an external input connected to the display device (100).

[0080] The volume control button (235) may be a button for adjusting the size of the volume output by the display device (100).

[0081] The voice recognition button (236) may be a button for receiving a user's voice and recognizing the received voice.

[0082] The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel.

[0083] The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.

[0084] Let's explain Figure 2 again.

[0085] When the user input interface (230) has a touch screen, the user can input commands related to the display device (100) using the remote control device (200) by touching the soft keys of the touch screen. In addition, the user input interface (230) may have various types of input means that can be operated by the user, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.

[0086] The sensor (240) may include a gyro sensor (241) or an acceleration sensor (243), and the gyro sensor (241) may sense information about the movement of the remote control device (200).

[0087] For example, the gyro sensor (241) can sense information about the operation of the remote control device (200) based on the x, y, and z axes, and the acceleration sensor (243) can sense information about the movement speed of the remote control device (200). Meanwhile, the remote control device (200) can further include a distance measuring sensor, so as to sense the distance to the display (180) of the display device (100).

[0088] The output interface (250) can output a video or audio signal corresponding to an operation of the user input interface (230) or a signal transmitted from the display device (100).

[0089] The user can recognize whether the output interface (250) is manipulating the user input interface (230) or controlling the display device (100).

[0090] For example, the output interface (250) may include an LED (251) that lights up when the user input interface (230) is operated or a signal is transmitted and received with the display device (100) via the wireless communication unit (225), a vibrator (253) that generates vibrations, a speaker (255) that outputs sound, or a display (257) that outputs images.

[0091] In addition, the power supply circuit (260) supplies power to the remote control device (200), and power waste can be reduced by stopping the power supply when the remote control device (200) does not move for a predetermined period of time.

[0092] The power supply circuit (260) can resume power supply when a predetermined key provided in the remote control device (200) is operated.

[0093] The memory (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200).

[0094] When the remote control device (200) wirelessly transmits and receives signals through the display device (100) and the RF circuit (221), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.

[0095] The controller (280) of the remote control device (200) can store and reference information regarding the frequency band that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200) in the memory (270).

[0096] The controller (280) controls all matters related to the control of the remote control device (200). The controller (280) can transmit a signal corresponding to a predetermined key operation of the user input interface (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor (240) to the display device (100) via the wireless communication unit (225).

[0097] Additionally, the microphone (290) of the remote control device (200) can acquire voice.

[0098] A plurality of microphones (290) may be provided.

[0099] Next, Figure 4 is described.

[0100] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0101] Figure 4 (a) illustrates that a pointer (205) corresponding to a remote control device (200) is displayed on a display (180).

[0102] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display (180) of the display device (100) corresponds to the movement of the remote control device (200). This remote control device (200) can be called a space remote control because, as shown in the drawing, the pointer (205) moves and is displayed according to the movement in 3D space.

[0103] Figure 4 (b) illustrates that when a user moves the remote control device (200) to the left, the pointer (205) displayed on the display (180) of the display device (100) also moves to the left correspondingly.

[0104] Information about the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information about the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0105] Figure 4 (c) illustrates a case where a user moves the remote control device (200) away from the display (180) while pressing a specific button within the remote control device (200). As a result, a selection area within the display (180) corresponding to the pointer (205) can be zoomed in and displayed in an enlarged manner.

[0106] Conversely, when the user moves the remote control device (200) closer to the display (180), the selection area within the display (180) corresponding to the pointer (205) may be zoomed out and displayed in a reduced size.

[0107] Meanwhile, when the remote control device (200) moves away from the display (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selection area may be zoomed in.

[0108] In addition, when a specific button within the remote control device (200) is pressed, recognition of up, down, left, and right movements may be excluded. That is, when the remote control device (200) moves away from or toward the display (180), up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When a specific button within the remote control device (200) is not pressed, only the pointer (205) moves in accordance with the up, down, left, and right movements of the remote control device (200).

[0109] Meanwhile, the movement speed or movement direction of the pointer (205) can correspond to the movement speed or movement direction of the remote control device (200).

[0110] Meanwhile, the pointer in this specification refers to an object displayed on the display (180) in response to the operation of the remote control device (200). Accordingly, objects of various shapes other than the arrow shape illustrated in the drawing can be used as the pointer (205). For example, the pointer may be a concept including a point, a cursor, a prompt, a thick outline, etc. In addition, the pointer (205) may be displayed corresponding to one point on the horizontal or vertical axis on the display (180), or may be displayed corresponding to multiple points such as lines or surfaces.

[0111] FIG. 5 illustrates an artificial intelligence (AI) server according to one embodiment of the present disclosure.

[0112] Referring to FIG. 5, the AI ​​server (500) may refer to a device that trains an artificial neural network using a machine learning algorithm or uses a trained artificial neural network.

[0113] The AI ​​server (500) may be composed of multiple servers to perform distributed processing, and may be defined as a 5G network.

[0114] The AI ​​server (500) may be included as part of the configuration of the AI ​​device (100) and may perform at least part of the AI ​​processing together.

[0115] The AI ​​server (500) may include a communication unit (510), a memory (530), a learning processor (540), and a processor (560).

[0116] The communication unit (510) can transmit and receive data with an external device such as a display device (100).

[0117] The memory (530) may include a model storage unit (531).

[0118] The model storage unit (531) can store a model (or artificial neural network, 531a) that is being learned or has been learned through the learning processor (540).

[0119] A learning processor (540) can train an artificial neural network (531a) using learning data. The learning model can be used while mounted on the AI ​​server (500) of the artificial neural network, or can be mounted on an external device such as a display device (100).

[0120] The learning model may be implemented in hardware, software, or a combination of hardware and software. If part or all of the learning model is implemented in software, one or more instructions constituting the learning model may be stored in memory (530).

[0121] The processor (560) can use a learning model to infer a result value for new input data and generate a response or control command based on the inferred result value.

[0122] FIG. 6 is a diagram for explaining the configuration of an AI system according to one embodiment of the present disclosure.

[0123] Referring to FIG. 6, the AI ​​system (60) may include an AI server (500), a display device (100), a speaker recognition server (610), and an STT (Speech To Text) server (630).

[0124] In one embodiment, the speaker recognition server (610) and the STT server (630) may be configured as a single server.

[0125] In another embodiment, the AI ​​server (500) may include a speaker recognition server (610) and an STT server (630).

[0126] Components of an AI system can communicate with each other over the Internet.

[0127] The AI ​​server (500) can generate one or more suggested words for speaker registration.

[0128] The AI ​​server (500) can transmit one or more generated suggestion words to the display device (100) via the communication unit (510).

[0129] The display device (100) can display a speaker registration sentence on the display (180) based on one or more received suggestion words.

[0130] The display device (100) can obtain a voice command corresponding to a speaker registration sentence.

[0131] The display device (100) can transmit voice data and speaker identification information corresponding to the acquired voice command to the speaker recognition server (610) via the network interface (133).

[0132] The speaker recognition server (610) can match the characteristics of the received voice data to speaker identification information and store them in a speaker database.

[0133] The display device (100) can transmit voice data corresponding to the acquired voice command to the STT server (630) through the network interface (133).

[0134] The STT server (630) can convert received voice data into text data and update the STT model based on the converted text data.

[0135] FIG. 7 is a ladder diagram for explaining an operation method of an AI system according to an embodiment of the present disclosure.

[0136] The processor (560) of the AI ​​server (500) can generate one or more suggested words for speaker registration (S701).

[0137] Speaker registration may be a process of extracting features of the voice spoken by the speaker and matching the speaker's identification information to the extracted features of the voice.

[0138] When the speaker registration process is completed, the display device (100) can extract the features of the voice spoken by the speaker and perform a voice recognition function only when there is speaker identification information that matches the extracted features.

[0139] In order to register a speaker, a speaker registration sentence containing the suggested word to be displayed on the display device (100) is required.

[0140] To this end, the processor (560) can generate one or more suggested words for speaker registration.

[0141] In one embodiment, the processor (560) may generate suggestions based on data stored in a regional dialect database. The regional dialect database may store words representing dialects used in each of a plurality of regions for a single language.

[0142] For example, a regional dialect database may include a plurality of words recognized as dialects in a first region and a plurality of words recognized as dialects in a second region.

[0143] The processor (560) can obtain a standard word that can be pronounced in a dialect in the region corresponding to the location information of the display device (100) as a suggested word.

[0144] The regional dialect database may be included in the AI ​​server (500) or may be provided separately from the AI ​​server (500).

[0145] In another embodiment, the processor (560) may generate suggestions based on data stored in a recent content database. The recent content database may store information about recent content. The information about the content may include one or more of the content name, an abbreviation for the content, or an alias.

[0146] A modern content database can periodically receive information about content from content providers.

[0147] The processor (560) can extract the name of the latest content from the latest content database and obtain the name of the extracted latest content as a suggested word.

[0148] In another embodiment, the processor (560) may obtain a suggested word based on a word recognition rate. If the word recognition rate of a specific word is lower than a preset recognition rate, the processor (560) may obtain the word as a suggested word.

[0149] The word recognition rate can indicate the percentage of times a specific spoken word is recognized. It can also indicate the number of times a word is successfully recognized relative to the total number of times it is spoken.

[0150] The processor (560) can obtain, as a suggested word, a word with a word recognition rate lower than a preset recognition rate among a plurality of words stored in a database.

[0151] In another embodiment, the processor (560) may obtain, as suggested words, words representing names of the latest content and regional dialects, among which the word recognition rate is lower than a preset recognition rate.

[0152] The processor (560) of the AI ​​server (500) can transmit one or more generated suggestion words to the display device (100) via the communication unit (510) (S703).

[0153] In one embodiment, the processor (560) may transmit one or more suggestion words generated to be used for speaker registration to the display device (100) via the communication unit (510).

[0154] In another embodiment, the processor (560) may generate one or more speaker registration sentences including one or more suggested words, and transmit the generated one or more speaker registration sentences to the display device (100) via the communication unit (510).

[0155] The speaker registration sentence may be a sentence including a trigger word and a generated suggestion word for activating the voice recognition function of the display device (100).

[0156] The controller (170) of the display device (100) can display a speaker registration sentence on the display (180) based on one or more received suggestion words (S705).

[0157] The controller (170) can generate one or more speaker registration sentences including one or more received suggestion words and trigger words.

[0158] When the controller (170) receives a request for speaker registration via voice, it can display a speaker registration sentence on the display (180).

[0159] The controller (170) can receive a request for speaker registration through voice by executing an application that provides a voice recognition service.

[0160] The controller (170) of the display device (100) can obtain a voice command corresponding to a speaker registration sentence (S707).

[0161] In one embodiment, the controller (170) can obtain a voice command corresponding to a speaker registration sentence from a remote control device (200) through a user input interface (150). The user can utter the speaker registration sentence through the remote control device (200), and the remote control device (200) can transmit the voice command uttered by the user to the display device (100).

[0162] In another embodiment, the controller (170) can receive a voice command corresponding to a speaker registration sentence through a microphone (not shown) provided in the display device (200).

[0163] The controller (170) of the display device (100) can transmit voice data and speaker identification information corresponding to the acquired voice command to the speaker recognition server (610) via the network interface (133) (S709).

[0164] Speaker identification information may include information that can identify the speaker.

[0165] Speaker identification information may include information that can identify the speaker, such as the speaker's name, account, and email.

[0166] The speaker recognition server (610) can match the characteristics of the received voice data to speaker identification information and store them in the speaker database (S711).

[0167] The speaker recognition server (610) can extract features of voice data. The features of voice data may include one or more of pitch, timbre, gender, volume, and frequency band.

[0168] In one embodiment, the speaker recognition server (610) can extract features of voice data using Mel-Frequency Cepstral Coefficient (MFCC) technology.

[0169] MFCC technology can extract the frequency characteristics of voice by converting voice data into Mel frequency scale in the frequency domain.

[0170] In another embodiment, the speaker recognition server (610) can extract features of voice data using a deep learning-based voice feature extraction model.

[0171] A voice feature extraction model can be a model that extracts features of voice data from voice data using a neural network architecture such as a Convolutional Neural Network (CNN) or Recurrent Neural Network (RNN).

[0172] The speaker recognition server (610) can match the features of the extracted voice data to speaker identification information and store them in a speaker database.

[0173] The speaker database may store speaker identification information of each of a plurality of speakers and a set of voice features (including a plurality of voice features) matching the speaker identification information.

[0174] After the speaker registration process, the speaker recognition server (610) can determine whether the speaker is the same by comparing the characteristics of the spoken voice signal with the characteristics stored in the speaker database when the speaker speaks.

[0175] The speaker recognition server (610) can determine that the speaker is the same if one or more of the features of the spoken voice signal matches one or more features stored in the database.

[0176] In particular, the speaker recognition server (610) can improve the recognition accuracy of a specific speaker by extracting and storing features of voice data corresponding to a presented word representing a dialect.

[0177] Meanwhile, the controller (170) of the display device (100) can transmit voice data corresponding to the acquired voice command to the STT server (630) through the network interface (133) (S713).

[0178] The STT server (630) can convert the received voice data into text data (S715) and update the STT model based on the converted text data (S717).

[0179] The STT server (630) can use the converted text data as training data for updating the STT model. The STT model may be a model that converts voice data into text data.

[0180] That is, there may not be much data collected for words that indicate dialects included in speaker registration sentences, names of recent content, or suggested words with low word recognition rates.

[0181] The STT server (630) can retrain the STT model using the speaker's voice data for the suggested word collected by the display device (100) during the speaker registration process.

[0182] Accordingly, the conversion accuracy of the STT model can be significantly improved.

[0183] FIGS. 8A to 8C are drawings illustrating examples of displaying various types of speaker registration sentences according to embodiments of the present disclosure.

[0184] The display device (100) can display a speaker registration screen (800) on the display (180) in response to a speaker registration request through voice utterance.

[0185] Referring to FIG. 8a, the display device (100) can display on a speaker registration screen (800) a first speaker registration sentence (810) including a first suggested word (811).

[0186] The first suggested word (811) may be the name of the latest content.

[0187] The user can utter a voice command corresponding to a first speaker registration sentence (810) containing a first suggested word (811) toward the remote control device (200).

[0188] The display device (100) can receive a voice command from a remote control device (200) and transmit voice data corresponding to the received voice command to a speaker recognition server (610) and an STT server (630).

[0189] In this way, according to an embodiment of the present disclosure, as voice data for the names of the latest content with little data is collected, it can be used to improve the speaker recognition rate and conversion accuracy of the STT model.

[0190] Referring to FIG. 8b, the display device (100) can display a second speaker registration sentence (830) including a second suggested word (831) on the speaker registration screen (800).

[0191] The second suggested word (831) may be a standard word that can be pronounced as a dialect. That is, the second suggested word (831) may be a word that can be pronounced differently depending on the region within a country. The second suggested word (831) may be a word that can be recognized as a dialect in the regional information of the display device (100).

[0192] The user can utter a voice command corresponding to a second speaker registration sentence (830) containing a second suggestion word (831) toward the remote control device (200).

[0193] The display device (100) can receive a voice command from a remote control device (200) and transmit voice data corresponding to the received voice command to a speaker recognition server (610) and an STT server (630).

[0194] In this way, according to an embodiment of the present disclosure, as voice data for words corresponding to a dialect is collected, it can be used to improve the speaker recognition rate and conversion accuracy of the STT model.

[0195] Referring to FIG. 8c, the display device (100) can display a third speaker registration sentence (850) including a third suggested word (851) on the speaker registration screen (800).

[0196] The third suggested word (851) may be a word whose word recognition rate is lower than the preset recognition rate.

[0197] The user can utter a voice command corresponding to a third speaker registration sentence (850) containing a third suggestion word (851) toward the remote control device (200).

[0198] The display device (100) can receive a voice command from a remote control device (200) and transmit voice data corresponding to the received voice command to a speaker recognition server (610) and an STT server (630).

[0199] In this way, according to an embodiment of the present disclosure, as voice data for words with low word recognition rates are collected, it can be used to improve the speaker recognition rate and conversion accuracy of the STT model.

[0200] In another embodiment, the display device (100) may sequentially display a first speaker registration sentence (810), a second speaker registration sentence (830), and a third speaker registration sentence (850).

[0201] Accordingly, voice data for the first suggested word (811), the second suggested word (831), and the third suggested word (851) can be collected all at once.

[0202] FIG. 9 is a diagram showing a process of collecting voice data for a suggested word according to an embodiment of the present disclosure.

[0203] The AI ​​server (500) can receive names of the latest content from the latest content DB (910).

[0204] The AI ​​server (500) can obtain the name of the latest content as a suggested word for speaker registration.

[0205] The AI ​​server (500) can receive words corresponding to the dialect of the region corresponding to the location information from the local dialect DB (930) based on the location information of the display device (100).

[0206] The AI ​​server (500) can obtain local dialect words corresponding to the location information of the display device (100) as suggested words for speaker registration.

[0207] The AI ​​server (500) can obtain words with a word recognition rate lower than a preset recognition rate from its own database as suggested words for speaker registration.

[0208] The AI ​​server (500) can transmit one or more generated suggestion words to the display device (100).

[0209] The display device (100) can generate a speaker registration sentence using one or more generated suggestion words.

[0210] When the display device (100) receives a speaker registration request through voice, it can display a first speaker registration sentence (810), a second speaker registration sentence (830), or a third speaker registration sentence (850) on the display (180), as shown in FIGS. 8a to 8c.

[0211] The display device (100) can obtain voice data spoken by a user for a speaker registration sentence, and transmit the obtained voice data and speaker identification information to a speaker recognition server (610) and an STT server (630).

[0212] The speaker recognition server (610) can extract a voice signal corresponding to a presented word from the received voice data and obtain features of the extracted voice signal.

[0213] The speaker recognition server (610) can match the features of the acquired voice signal to speaker identification information and store them in the speaker DB (950).

[0214] The speaker DB (950) may store speaker identification information of each of a plurality of speakers and the speaker's voice characteristics by matching the speaker identification information.

[0215] After registering a speaker, the speaker recognition server (610) can extract features of the speaker's voice command received from the display device (100) and perform speaker recognition by comparing the extracted features with stored features.

[0216] The speaker recognition server (610) can transmit the speaker recognition result to the display device (100), and the display device (100) can output the speaker recognition result.

[0217] The STT server (630) can convert voice data received from the display device (100) into text data. The STT server (630) can extract suggested word data corresponding to the suggested word from the converted text data.

[0218] The STT server (630) can retrain the STT model (970) using the suggested word data collected during the speaker registration process. The STT model (970) requires a large amount of data to increase text conversion accuracy.

[0219] If the STT model (970) is retrained using the suggested word data collected during the speaker registration process, the text conversion accuracy of the STT model (970) can be significantly improved.

[0220] FIG. 10 is a flowchart for explaining an operating method of a display device according to an embodiment of the present disclosure.

[0221] Referring to FIG. 10, the controller (170) of the display device (100) can obtain one or more suggested words for speaker registration (S1001).

[0222] In one embodiment, the controller (170) may receive one or more suggestions from the AI ​​server (500).

[0223] In another embodiment, the controller (170) can receive the name of the latest content from the content provider server and obtain the received name as a suggestion word.

[0224] In another embodiment, the controller (170) can receive the name of the latest content from the latest content DB (910).

[0225] In another embodiment, the controller (170) can receive a word representing a local dialect corresponding to the location information of the display device (100) from the local dialect DB (930) and obtain the received word as a suggested word.

[0226] The controller (170) of the display device (100) can generate a speaker registration sentence including the generated suggestion word (S1003).

[0227] The controller (170) can generate multiple speaker registration sentences containing one suggested word.

[0228] As another example, the controller (170) can generate a speaker registration sentence including multiple suggested words.

[0229] The controller (170) of the display device (100) displays a speaker registration sentence on the display (180) in response to a speaker registration request (S1005).

[0230] The controller (170) can display the generated speaker registration sentence on the display (180) upon receiving a speaker registration request.

[0231] The controller (170) of the display device (100) can obtain a voice command spoken by a user corresponding to a speaker registration sentence (S1007).

[0232] In one embodiment, the controller (170) can receive a user-spoken voice command corresponding to a speaker registration sentence from a remote control device (200).

[0233] In another embodiment, the controller (170) can receive a voice command spoken by a user corresponding to a speaker registration sentence through a microphone (not shown) provided in the display device (100).

[0234] The controller (170) of the display device (100) can transmit voice data corresponding to a voice command to the speaker recognition server (610) and the STT server (630) via a network interface (S1009).

[0235] The controller (170) can transmit voice data and speaker identification information to the speaker recognition server (610).

[0236] The speaker recognition server (610) can extract the speaker's voice features from the received voice data, match the extracted voice features to speaker identification information, and store them in the speaker DB (950).

[0237] The STT server (630) can use the received voice data to learn the STT model.

[0238] In this way, according to an embodiment of the present disclosure, as voice data for names of the latest content with little data, words corresponding to dialects, and words with low recognition rates are collected, it can be used to improve speaker recognition rate and conversion accuracy of the STT model.

[0239] According to one embodiment of the present invention, the above-described method can be implemented as processor-readable code on a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

Claims

1. In the display device, display; a network interface that communicates with one or more servers; and A controller is included that obtains a speaker registration sentence including a suggestion word for speaker registration, displays the generated speaker registration sentence on the display upon receiving a request for speaker registration, obtains a voice command corresponding to the displayed speaker registration sentence, and transmits voice data corresponding to the obtained voice command to the one or more servers through the network interface. The above suggestions are Contains one of the words that represents the name of the latest content or a regional dialect. Display device.

2. In paragraph 1, The above suggestions are Words with a lower recognition rate than the preset recognition rate Display device.

3. In paragraph 1, The above controller Receiving the name of the latest content from a server included in one or more of the above servers Display device.

4. In paragraph 1, The above controller Obtaining the location information of the display device, and obtaining the word representing the dialect of the region corresponding to the location information from the local dialect database as the suggested word. Display device.

5. In paragraph 1, The above controller Multiple speaker-registered sentences containing different suggestions are sequentially displayed on the display. Display device.

6. In paragraph 1, The above controller Transmitting the voice data to the speaker recognition server and STT (Speech To Text) server through the network interface Display device.

7. In paragraph 6, The above controller Transmitting speaker identification information that identifies the speaker and the voice data to the speaker recognition server Display device.

8. In the method of operating the display device, A step of obtaining a speaker registration sentence including a suggested word for speaker registration; A step of displaying the generated speaker registration sentence upon receiving a request for speaker registration; A step of obtaining a voice command corresponding to the speaker registration sentence displayed above; and comprising a step of transmitting voice data corresponding to the acquired voice command to one or more servers; The above suggestions are Contains one of the words that represents the name of the latest content or a regional dialect. How the display device operates.

9. In paragraph 8, The above suggestions are Words with a lower recognition rate than the preset recognition rate How the display device operates.

10. In paragraph 8, Further comprising a step of receiving the name of the latest content from a server included in the one or more servers. How the display device operates.

11. In paragraph 8, A step of obtaining location information of the display device; and Further comprising a step of obtaining the word representing the dialect of the region corresponding to the location information from the regional dialect database as the suggested word. How the display device operates.

12. In paragraph 8, The steps indicated above are A step of sequentially displaying multiple speaker-registered sentences containing different suggested words. How the display device operates.

13. In paragraph 8, The above transmitting steps are A step of transmitting the above voice data to a speaker recognition server and an STT (Speech To Text) server. How the display device operates.

14. In paragraph 13, The above transmitting steps are A step of transmitting speaker identification information identifying the speaker and the voice data to the speaker recognition server. How the display device operates.

Images