Image display apparatus and system comprising same

Abstract

The present disclosure relates to an image display apparatus and a system comprising same. The image display apparatus according to an embodiment of the present disclosure comprises: a display; an external apparatus interface unit that communicates with a remote control device; a network interface unit that communicates with at least one server; and a control unit, wherein the control unit may: on the basis that a first command for activating a function of receiving a speech input from the remote control device is received, output, through the display, a predetermined screen including a first object corresponding to the end of the function; on the basis that the speech input is received from the remote control device, output, through the predetermined screen, text corresponding to the speech input that has been received from the remote control device; and on the basis that a second command for selecting the first object is received, process the entire text that has been output through the predetermined screen.

Description

Video display device and system including the same

[0001] The present disclosure relates to a video display device and a system including the same.

[0002] A video display device is a device that displays images for the user to view. For example, a video display device may include a television (TV), monitor, or notebook computer equipped with a liquid crystal display (LCD) using liquid crystals or an organic light-emitting diode (OLED) display using organic light-emitting diodes (OLED).

[0003] With technological advancements, various services utilizing voice recognition technology are being developed and provided across various fields. Various technological developments are also underway to apply voice recognition technology to video display devices such as TVs. Traditionally, voice recognition was performed on words, phrases, or short sentences spoken by the user, and the video display device then performed actions based on the results of the voice recognition.

[0004] Meanwhile, with the rapid advancement of technology in the field of artificial intelligence, there's a growing trend toward developing services that analyze long texts entered by users and summarize their content or provide answers. Consequently, there's a growing need for user interfaces that utilize the user's spoken words to compose long texts.

[0005] The present disclosure aims to solve the above-mentioned and other problems.

[0006] Another object is to provide a video display device and a system including the same that can compose long text using a user's voice input.

[0007] Another object is to provide a video display device and a system including the same that can edit text using a user's voice input.

[0008] Another purpose is to provide a video display device and a system including the same that can recommend keywords for sentence composition by considering the context of the text.

[0009] In order to achieve the above object, an image display device according to one embodiment of the present disclosure includes: a display; an external device interface unit communicating with a remote control device; a network interface unit communicating with at least one server; and a control unit, wherein the control unit, based on receiving a first command for activating a function for receiving a voice input from the remote control device, outputs a predetermined screen including a first object corresponding to termination of the function through the display; based on receiving a voice input from the remote control device, outputs text corresponding to the voice input received from the remote control device through the predetermined screen; and based on receiving a second command for selecting the first object, processes the entire text output through the predetermined screen.

[0010] In order to achieve the above object, a system according to one embodiment of the present disclosure includes a video display device, a remote control device, and at least one server, wherein the remote control device transmits a first command for activating a function for receiving a voice input to the video display device, and transmits a voice input received through a microphone to the video display device while the function is activated, and the video display device outputs a predetermined screen including a first object corresponding to termination of the function based on reception of the first command from the remote control device, transmits the voice input received from the remote control device to a server, outputs text corresponding to the voice input received from the server through the predetermined screen, and processes the entire text output through the predetermined screen based on reception of a second command for selecting the first object.

[0011] The effects of the video display device and the system including the same according to the present disclosure are described as follows.

[0012] According to at least one embodiment of the present disclosure, a long text can be composed using a user's voice input.

[0013] According to at least one embodiment of the present disclosure, text can be edited using a user's voice input.

[0014] According to at least one embodiment of the present disclosure, keywords for structuring sentences can be recommended by taking into account the context of the text.

[0015] Further scope of the applicability of the present disclosure will become apparent from the detailed description below. However, since various modifications and variations within the spirit and scope of the present disclosure will become apparent to those skilled in the art, it should be understood that the detailed description and specific examples, such as preferred embodiments of the present disclosure, are given by way of example only.

[0016] FIG. 1 is a diagram illustrating an image display system according to one embodiment of the present disclosure.

[0017] Figure 2 is an internal block diagram of the image display device of Figure 1.

[0018] Figure 3 is an internal block diagram of the control unit of Figure 2.

[0019] FIG. 4a is a drawing illustrating a control method of the remote control device of FIG. 2, and FIG. 4b is an example of an internal block diagram of the remote control device of FIG. 2.

[0020] Figure 5 is a drawing referenced in the description of the server of Figure 1.

[0021] FIG. 6 is a flowchart of an operation method of an image display device according to one embodiment of the present disclosure.

[0022] FIG. 7 is a flowchart of a method of operating a system according to one embodiment of the present disclosure.

[0023] FIGS. 8 to 33 are drawings for reference in explaining the operation of a video display device that composes text using voice input according to various embodiments of the present disclosure.

[0024] Hereinafter, the present disclosure will be described in detail with reference to the drawings. In the drawings, portions irrelevant to the description are omitted to clearly and concisely describe the present disclosure, and the same reference numerals are used for identical or extremely similar portions throughout the specification.

[0025] The suffixes "module" and "part" used in the following description are given solely for the convenience of writing this specification and do not impart any particularly significant meaning or role to the components themselves. Therefore, the terms "module" and "part" may be used interchangeably.

[0026] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0027] Additionally, while terms such as "first" and "second" may be used in this specification to describe various elements, these elements are not limited by these terms. These terms are used only to distinguish one element from another.

[0028] FIG. 1 is a diagram illustrating an image display system according to various embodiments of the present invention.

[0029] Referring to FIG. 1, the image display system (10) may include an image display device (100) and / or a remote control device (200).

[0030] The image display device (100) may be a device that processes and outputs an image. The image display device (100) is not particularly limited as long as it can output a screen corresponding to an image signal, such as a TV, a notebook computer, or a monitor.

[0031] The video display device (100) can receive a broadcast signal, process the signal, and output the processed broadcast image. When the video display device (100) receives a broadcast signal, the video display device (100) may correspond to a broadcast receiving device.

[0032] The video display device (100) can receive broadcast signals wirelessly via an antenna, or can receive broadcast signals wired via a cable. For example, the video display device (100) can receive terrestrial broadcast signals, satellite broadcast signals, cable broadcast signals, IPTV (Internet Protocol Television) broadcast signals, etc.

[0033] The remote control device (200) can be connected to the image display device (100) by wire and / or wirelessly, and can provide various control signals to the image display device (100). At this time, the remote control device (200) can include a device that establishes a wired or wireless network with the image display device (100), and transmits various control signals to the image display device (100) through the established network, or receives signals related to various operations processed in the image display device (100) from the image display device (100).

[0034] For example, various input devices such as a mouse, keyboard, space remote control, trackball, joystick, etc. can be used as the remote control device (200). The remote control device (200) can be referred to as an external device, and it is to be noted in advance that external devices and remote control devices can be used interchangeably as needed.

[0035] The video display device (100) can be connected to only a single remote control device (200) or can be connected to two or more remote control devices (200) simultaneously, and can change objects displayed on the screen or adjust the status of the screen based on control signals provided from each remote control device (200).

[0036] Meanwhile, the video display system (10) may further include at least one server (400). The video display device (100) may transmit and receive data with the server (400). For example, the video display device (100) may transmit and receive data with the server (400) via a network such as the Internet.

[0037] The video display device (100) can transmit data related to an operation performed according to a user input to the server (400), and the server (400) can store the data received from the video display device (100).

[0038] Figure 2 is an internal block diagram of the image display device of Figure 1.

[0039] Referring to FIG. 2, the video display device (100) may include a broadcast receiving unit (105), an external device interface unit (130), a network interface unit (135), a storage unit (140), a user input interface unit (150), an input unit (160), a control unit (170), a display (180), an audio output unit (185), and / or a power supply unit (190).

[0040] The broadcast receiving unit (105) may include a tuner unit (110) and a demodulator unit (120).

[0041] Meanwhile, unlike the drawing, the image display device (100) may include only the broadcast reception unit (105) and the external device interface unit (130) among the broadcast reception unit (105), the external device interface unit (130), and the network interface unit (135). That is, the image display device (100) may not include the network interface unit (135).

[0042] The tuner unit (110) can select a broadcast signal corresponding to a channel selected by the user or all previously stored channels among broadcast signals received via an antenna (not shown) or a cable (not shown). The tuner unit (110) can convert the selected broadcast signal into an intermediate frequency signal or a baseband video or audio signal.

[0043] For example, the tuner unit (110) can convert the selected broadcast signal into a digital IF signal (DIF) if it is a digital broadcast signal, and can convert it into an analog baseband video or audio signal (CVBS / SIF) if it is an analog broadcast signal. That is, the tuner unit (110) can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit (110) can be directly input to the control unit (170).

[0044] Meanwhile, the tuner unit (110) can sequentially select broadcast signals of all broadcast channels stored through the channel memory function among the received broadcast signals and convert them into intermediate frequency signals or baseband video or audio signals.

[0045] Meanwhile, the tuner unit (110) may be equipped with multiple tuners to receive broadcast signals of multiple channels. Alternatively, a single tuner that simultaneously receives broadcast signals of multiple channels is also possible.

[0046] The demodulation unit (120) can perform a demodulation operation by receiving a digital IF signal (DIF) converted by the tuner unit (110).

[0047] The demodulation unit (120) can output a stream signal (TS) after performing demodulation and channel decoding. At this time, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed.

[0048] The stream signal output from the demodulation unit (120) can be input to the control unit (170). The control unit (170) can output an image through the display (180) and output an audio through the audio output unit (185) after performing demultiplexing, image / audio signal processing, etc.

[0049] The external device interface unit (130) can transmit or receive data with a connected external device. To this end, the external device interface unit (130) may include an A / V input / output unit (not shown).

[0050] The external device interface unit (130) can be connected to external devices such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), set-top box, etc., via wired / wireless connection, and can also perform input / output operations with the external devices.

[0051] In addition, the external device interface unit (130) can establish a communication network with various remote control devices (200) as illustrated in FIG. 1, and receive a control signal related to the operation of the image display device (100) from the remote control device (200) or transmit data related to the operation of the image display device (100) to the remote control device (200).

[0052] The A / V input / output unit can receive video and audio signals from an external device. For example, the A / V input / output unit can include an Ethernet terminal, a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an MHL (Mobile High-definition Link) terminal, an RGB terminal, a D-SUB terminal, an IEEE 1394 terminal, an SPDIF terminal, a Liquid HD terminal, etc. Digital signals input through these terminals can be transmitted to the control unit (170). At this time, analog signals input through the CVBS terminal and the S-video terminal can be converted into digital signals through an analog-to-digital converter (not shown) and transmitted to the control unit (170).

[0053] The external device interface unit (130) may include a wireless communication unit (not shown) for short-range wireless communication with other electronic devices. Through this wireless communication unit, the external device interface unit (130) can exchange data with an adjacent mobile terminal. For example, in mirroring mode, the external device interface unit (130) may receive device information, running application information, application images, etc. from the mobile terminal.

[0054] The external device interface unit (130) can perform short-range wireless communication using Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra-Wideband), ZigBee, etc.

[0055] The network interface unit (135) can provide an interface for connecting the video display device (100) to a wired / wireless network including the Internet.

[0056] The network interface unit (135) may include a communication module (not shown) for connection to a wired / wireless network. For example, the network interface unit (135) may include a communication module for WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), etc.

[0057] The network interface unit (135) can transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.

[0058] The network interface unit (135) can receive web content or data provided by a content provider or network operator. That is, the network interface unit (135) can receive content such as movies, advertisements, games, VOD, broadcasts, etc., and related information provided from a content provider or network provider via a network.

[0059] The network interface unit (135) can receive firmware update information and update files provided by the network operator, and transmit data to the Internet or content provider or network operator.

[0060] The network interface unit (135) can select and receive a desired application from among applications open to the public through a network.

[0061] The storage unit (140) may store programs for signal processing and control within the control unit (170), or may store processed video, audio, or data signals. For example, the storage unit (140) may store application programs designed for the purpose of performing various tasks that can be processed by the control unit (170), and may selectively provide some of the stored application programs upon request from the control unit (170).

[0062] Programs stored in the storage unit (140) are not particularly limited as long as they can be executed by the control unit (170).

[0063] The storage unit (140) may also perform a function for temporarily storing video, audio, or data signals received from an external device through the external device interface unit (130).

[0064] The storage unit (140) can store information about a specific broadcast channel through a channel memory function such as a channel map.

[0065] Although the storage unit (140) of FIG. 2 is provided separately from the control unit (170), the scope of the present invention is not limited thereto, and the storage unit (140) may be included within the control unit (170).

[0066] The storage unit (140) may include at least one of volatile memory (e.g., DRAM, SRAM, SDRAM, etc.) or non-volatile memory (e.g., flash memory, hard disk drive (HDD), solid-state drive (SSD), etc.). In various embodiments of the present invention, the storage unit (140) and memory may be used interchangeably.

[0067] The user input interface unit (150) can transmit a signal input by the user to the control unit (170) or transmit a signal from the control unit (170) to the user.

[0068] For example, a user input signal such as power on / off, channel selection, screen setting, etc. may be transmitted / received from a remote control device (200), a user input signal input from a local key (not shown) such as a power key, a channel key, a volume key, a setting value, etc. may be transmitted to the control unit (170), a user input signal input from a sensor unit (not shown) that senses a user's gesture may be transmitted to the control unit (170), or a signal from the control unit (170) may be transmitted to the sensor unit.

[0069] The input unit (160) may be provided on one side of the main body of the video display device (100). For example, the input unit (160) may include a touch pad, a physical button, etc.

[0070] The input unit (160) can receive various user commands related to the operation of the video display device (100) and transmit a control signal corresponding to the input command to the control unit (170).

[0071] The input unit (160) may include at least one microphone (not shown) and may receive the user's voice through the microphone.

[0072] The control unit (170) may include at least one processor, and may control the overall operation of the image display device (100) using the processor included therein. Here, the processor may be a general processor such as a central processing unit (CPU). Of course, the processor may be a dedicated device such as an ASIC or another hardware-based processor.

[0073] The control unit (170) can demultiplex a stream input through the tuner unit (110), the demodulator unit (120), the external device interface unit (130), or the network interface unit (135), or process the demultiplexed signals to generate and output a signal for video or audio output.

[0074] The display (180) can generate a driving signal by converting a video signal, data signal, OSD signal, control signal, etc. processed by the control unit (170) or a video signal, data signal, control signal, etc. received from the external device interface unit (130).

[0075] The display (180) may include a display panel (not shown) having a plurality of pixels.

[0076] The plurality of pixels provided on the display panel may have RGB sub-pixels. Alternatively, the plurality of pixels provided on the display panel may have RGBW sub-pixels. The display (180) may convert image signals, data signals, OSD signals, control signals, etc. processed by the control unit (170) to generate driving signals for the plurality of pixels.

[0077] The display (180) can be a PDP (Plasma Display Panel), an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode), a flexible display, etc., and may also be a 3D display. The 3D display (180) can be divided into a glasses-free type and a glasses type.

[0078] Meanwhile, the display (180) is configured as a touch screen and can be used as an input device in addition to an output device.

[0079] The audio output unit (185) receives a signal processed by the control unit (170) and outputs it as voice.

[0080] The image signal processed by the control unit (170) can be input to the display (180) and displayed as an image corresponding to the image signal. In addition, the image signal processed by the control unit (170) can also be input to an external output device through the external device interface unit (130).

[0081] The voice signal processed in the control unit (170) can be output as sound to the audio output unit (185). In addition, the voice signal processed in the control unit (170) can be input to an external output device through the external device interface unit (130).

[0082] Although not shown in FIG. 2, the control unit (170) may include a demultiplexing unit, an image processing unit, etc. This will be described later with reference to FIG. 3.

[0083] In addition, the control unit (170) can control the overall operation within the video display device (100). For example, the control unit (170) can control the tuner unit (110) to select (tune) a broadcast corresponding to a channel selected by the user or a previously stored channel.

[0084] In addition, the control unit (170) can control the image display device (100) by a user command or internal program input through the user input interface unit (150).

[0085] Meanwhile, the control unit (170) can control the display (180) to display an image. At this time, the image displayed on the display (180) may be a still image or a moving image, and may be a 2D image or a 3D image.

[0086] Meanwhile, the control unit (170) can cause a predetermined 2D object to be displayed within an image displayed on the display (180). For example, the object can be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

[0087] Meanwhile, the image display device (100) may further include a camera (not shown). The camera can capture images of a user. The camera can be implemented with a single camera, but is not limited thereto, and may also be implemented with multiple cameras. Meanwhile, the camera can be embedded in the image display device (100) above the display (180) or can be separately positioned. Image information captured by the camera can be input to the control unit (170).

[0088] The control unit (170) can recognize the user's location based on the image captured by the camera. For example, the control unit (170) can determine the distance (z-axis coordinate) between the user and the image display device (100). In addition, the control unit (170) can determine the x-axis coordinate and y-axis coordinate within the display (180) corresponding to the user's location.

[0089] The control unit (170) can detect the user's gesture based on an image captured from the camera unit, a signal detected from the sensor unit, or a combination thereof.

[0090] The power supply unit (190) can supply power to the entire image display device (100). In particular, it can supply power to a control unit (170) that can be implemented in the form of a system on chip (SOC), a display (180) for image display, and an audio output unit (185) for audio output.

[0091] Specifically, the power supply unit (190) may be equipped with a converter (not shown) that converts AC power into DC power and a Dc / Dc converter (not shown) that converts the level of DC power.

[0092] The remote control device (200) can transmit user input to the user input interface unit (150). To this end, the remote control device (200) can use Bluetooth, RF (Radio Frequency) communication, infrared (Infrared Radiation) communication, UWB (Ultra-wideband), ZigBee, etc. In addition, the remote control device (200) can receive images, voices, or data signals output from the user input interface unit (150) and display or output the same as voice on the remote control device (200).

[0093] Meanwhile, the above-described video display device (100) may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasts.

[0094] Meanwhile, the block diagram of the image display device (100) illustrated in FIG. 2 is only a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted depending on the specifications of the image display device (100) actually implemented.

[0095] That is, two or more components may be combined into a single component, or a single component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments of the present invention, and their specific operations or devices do not limit the scope of the present invention.

[0096] Figure 3 is an internal block diagram of the control unit of Figure 2.

[0097] Referring to FIG. 3, a control unit (170) according to one embodiment of the present invention may include a demultiplexer (310), an image processing unit (320), a processor (330), an OSD generation unit (340), a mixer (345), a frame rate conversion unit (350), and / or a formatter (360). In addition, an audio processing unit (not shown) and a data processing unit (not shown) may be further included.

[0098] The demultiplexer (310) can demultiplex an input stream. For example, when MPEG-2 TS is input, it can be demultiplexed to separate it into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer (310) may be a stream signal output from the tuner (110), the demodulator (120), or the external device interface (130).

[0099] The image processing unit (320) can perform image processing of a demultiplexed image signal. To this end, the image processing unit (320) may be equipped with an image decoder (325) and a scaler (335).

[0100] The video decoder (325) can decode a demultiplexed video signal, and the scaler (335) can perform scaling so that the resolution of the decoded video signal can be output on the display (180).

[0101] The video decoder (325) may include decoders of various standards. For example, it may include an MPEG-2, H.264 decoder, a 3D video decoder for color images and depth images, a decoder for multi-view images, etc.

[0102] The processor (330) can control the overall operation within the video display device (100) or the control unit (170). For example, the processor (330) can control the tuner (110) to select (tune) a broadcast corresponding to a channel selected by the user or a pre-stored channel.

[0103] In addition, the processor (330) can control the image display device (100) by a user command or internal program input through the user input interface unit (150).

[0104] Additionally, the processor (330) can perform data transmission control with the network interface unit (135) or the external device interface unit (130).

[0105] Additionally, the processor (330) can control the operation of the demultiplexing unit (310), the image processing unit (320), the OSD generation unit (340), etc. within the control unit (170).

[0106] The OSD generation unit (340) can generate OSD signals based on user input or on its own. For example, based on a user input signal input through the input unit (160), it can generate signals for displaying various information in the form of graphics or text on the screen of the display (180).

[0107] The generated OSD signal may include various data such as the user interface screen of the video display device (100), various menu screens, widgets, icons, etc. In addition, the generated OSD signal may include a 2D object or a 3D object.

[0108] Additionally, the OSD generation unit (340) can generate a pointer that can be displayed on the display (180) based on a pointing signal input from the remote control device (200).

[0109] The OSD generation unit (340) may include a pointing signal processing unit (not shown) that generates a pointer. It is also possible for the pointing signal processing unit (not shown) to be provided separately rather than within the OSD generation unit (240).

[0110] The mixer (345) can mix the OSD signal generated by the OSD generation unit (340) and the decoded image signal processed by the image processing unit (320). The mixed image signal can be provided to the frame rate conversion unit (350).

[0111] The frame rate converter (FRC) (350) can convert the frame rate of an input video. Meanwhile, the frame rate converter (350) can also output the video as is without a separate frame rate conversion.

[0112] The formatter (360) can arrange left-eye image frames and right-eye image frames of a frame rate-converted 3D image. In addition, it can output a synchronization signal (Vsync) for opening the left-eye glasses and right-eye glasses of a 3D viewing device (not shown).

[0113] Meanwhile, the formatter (360) can change the format of the input video signal into a video signal for display on the display (180) and output it.

[0114] Additionally, the formatter (360) can change the format of a 3D video signal. For example, it can change the format to any one of various 3D formats, such as a side-by-side format, a top-down format, a frame sequential format, an interlaced format, and a checker box format.

[0115] Meanwhile, the formatter (360) can also convert a 2D image signal into a 3D image signal. For example, according to a 3D image generation algorithm, an edge or a selectable object can be detected within a 2D image signal, and an object or a selectable object according to the detected edge can be separated and generated as a 3D image signal. At this time, the generated 3D image signal can be separated and aligned into a left-eye image signal (L) and a right-eye image signal (R), as described above.

[0116] Meanwhile, although not shown in the drawing, a 3D processor (not shown) for 3D effect signal processing may be further placed after the formatter (360). This 3D processor may process brightness, tint, and color adjustments of the image signal to improve the 3D effect. For example, it may perform signal processing to make the image clear at a close distance and blurry at a long distance. Meanwhile, the function of this 3D processor may be incorporated into the formatter (360) or incorporated into the image processing unit (320).

[0117] Meanwhile, the audio processing unit (not shown) within the control unit (170) can perform audio processing of the demultiplexed audio signal. For this purpose, the audio processing unit (not shown) can be equipped with various decoders.

[0118] Additionally, the audio processing unit (not shown) within the control unit (170) can process bass, treble, volume control, etc.

[0119] A data processing unit (not shown) within the control unit (170) can perform data processing of a demultiplexed data signal. For example, if the demultiplexed data signal is an encoded data signal, it can be decoded. The encoded data signal may be electronic program guide information (EPG) information that includes broadcast information such as the start time and end time of a broadcast program broadcast on each channel.

[0120] Meanwhile, the block diagram of the control unit (170) illustrated in FIG. 3 is only a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted depending on the specifications of the control unit (170) actually implemented.

[0121] In particular, the frame rate conversion unit (350) and the formatter (360) are not provided within the control unit (170), but may be provided separately, or may be provided separately as one module.

[0122] FIG. 4a is a drawing illustrating a control method of the remote control device of FIG. 2, and FIG. 4b is an example of an internal block diagram of the remote control device of FIG. 2.

[0123] Referring to FIG. 4a, it can be confirmed that a pointer (205) corresponding to a remote control device (200) is displayed on the display (180) of the video display device (100).

[0124] Referring to (a) of Fig. 4a, the user can move or rotate the remote control device (200) up and down, left and right, forward and backward. At this time, the pointer (205) displayed on the display (180) of the image display device (100) can be displayed in response to the movement of the remote control device (200). Since the pointer (205) of this remote control device (200) moves and is displayed according to the movement in 3D space, as shown in the drawing, it can be called a space remote control or a 3D pointing device.

[0125] Referring to (b) of FIG. 4a, when the user moves the remote control device (200) to the left, it can be confirmed that the pointer (205) displayed on the display (180) of the image display device (100) also moves to the left in response to the movement of the remote control device (200).

[0126] Information about the movement of the remote control device (200) detected through the sensor of the remote control device (200) can be transmitted to the image display device (100). The image display device (100) can calculate the coordinates of the pointer (205) from the information about the movement of the remote control device (200). The image display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0127] Referring to (c) of FIG. 4a, a user can move the remote control device (200) away from the display (180) while pressing a specific button provided on the remote control device (200). As a result, a selection area within the display (180) corresponding to the pointer (205) can be zoomed in and displayed in an enlarged manner. Conversely, when a user moves the remote control device (200) closer to the display (180) while pressing a specific button provided on the remote control device (200), a selection area within the display (180) corresponding to the pointer (205) can be zoomed out and displayed in a reduced manner.

[0128] Meanwhile, when the remote control device (200) moves away from the display (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selection area may be zoomed in.

[0129] Meanwhile, when the user presses a specific button within the remote control device (200), recognition of up, down, left, and right movements may be excluded. That is, when the remote control device (200) moves away from or toward the display (180), up, down, left, and right movements are not recognized, and only forward and backward movements may be recognized. When the user does not press a specific button within the remote control device (200), only up, down, left, and right movements of the remote control device (200) may be recognized, and accordingly, only the pointer (205) may be moved.

[0130] Meanwhile, the movement speed or movement direction of the pointer (205) can correspond to the movement speed or movement direction of the remote control device (200).

[0131] Referring to FIG. 4b, the remote control device (200) may include a wireless communication unit (220), a user input unit (230), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), and / or a control unit (280).

[0132] The wireless communication unit (220) can transmit and receive signals with the image display device (100).

[0133] In this embodiment, the remote control device (200) may be equipped with an RF module (221) capable of transmitting and receiving signals with the image display device (100) according to RF (Radio frequency) communication standards. In addition, the remote control device (200) may be equipped with an IR module (223) capable of transmitting and receiving signals with the image display device (100) according to IR (Infrared radiation) communication standards.

[0134] The remote control device (200) can transmit a signal including information about the movement of the remote control device (200) to the image display device (100) through the RF module (221). The remote control device (200) can receive the signal transmitted by the image display device (100) through the RF module (221).

[0135] The remote control device (200) can transmit commands for power on / off, channel change, volume change, etc. to the video display device (100) through the IR module (223).

[0136] The user input unit (230) may be composed of a keypad, buttons, a touch pad, a touch screen, etc. The user can input commands related to the video display device (100) to the remote control device (200) by operating the user input unit (230).

[0137] When the user input unit (230) has a hard key button, the user can input a command related to the video display device (100) to the remote control device (200) through a push operation of the hard key button.

[0138] When the user input unit (230) has a touch screen, the user can input commands related to the video display device (100) using the remote control device (200) by touching the soft keys of the touch screen.

[0139] Meanwhile, the user input unit (230) may be equipped with various types of input means that can be operated by the user, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.

[0140] The user input unit (230) may be equipped with a microphone. The user may speak into the microphone provided in the user input unit (230). At this time, the microphone provided in the user input unit (230) may receive the voice spoken by the user.

[0141] The sensor unit (240) may be equipped with a gyro sensor (241) or an acceleration sensor (243). The gyro sensor (241) can sense the movement of the remote control device (200).

[0142] The gyro sensor (241) can sense information about the operation of the remote control device (200) based on the x, y, and z axes. The acceleration sensor (243) can sense information about the movement speed of the remote control device (200). Meanwhile, the sensor unit (240) may further include a distance measuring sensor capable of sensing the distance from the display (180).

[0143] The output unit (250) can output an image or sound corresponding to the operation of the user input unit (230) or to a signal transmitted from the image display device (100). Through the output unit (250), the user can recognize whether the user input unit (230) is being operated or whether the image display device (100) is being controlled.

[0144] The output unit (250) may include an LED module (251) including at least one light-emitting element (e.g., an LED (Light Emitting Diode)), a vibration module (253) that generates vibration, a sound output module (255) that outputs sound, and / or a display module (257) that outputs an image.

[0145] The power supply unit (260) can supply power to each component provided in the remote control device (200). The power supply unit (260) can include at least one battery (not shown).

[0146] The power supply unit (260) can prevent unnecessary power consumption by stopping the power supply to each component provided in the remote control device (200) when movement of the remote control device (200) is not detected for a predetermined period of time through the sensor unit (240).

[0147] The power supply unit (260) can resume power supply to each component equipped in the remote control device (200) when a predetermined event occurs. For example, the power supply unit (260) can resume power supply to each component when a predetermined key equipped in the remote control device (200) is operated. For example, the power supply unit (260) can resume power supply to each component equipped in the remote control device (200) when movement of the remote control device (200) is detected through the sensor unit (240).

[0148] The storage unit (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200).

[0149] When the remote control device (200) wirelessly transmits and receives signals through the image display device (100) and the RF module (221), the remote control device (200) and the image display device (100) can transmit and receive signals through a predetermined frequency band. The control unit (280) of the remote control device (200) can store and reference information about the frequency band, etc., through which signals can be wirelessly transmitted and received between the remote control device (200) and the image display device (100) paired therewith in the storage unit (270).

[0150] The control unit (280) may include at least one processor, and may control the overall operation of the remote control device (200) using the processor included therein.

[0151] The control unit (280) can transmit a control signal corresponding to a predetermined key operation of the user input unit (230) or a control signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the image display device (100) via the wireless communication unit (220).

[0152] The user input interface unit (150) of the video display device (100) may be equipped with a wireless communication unit (151) capable of transmitting and receiving signals wirelessly with a remote control device (200), and a coordinate value calculation unit (155) capable of calculating the coordinate value of a pointer corresponding to the operation of the remote control device (200).

[0153] The user input interface unit (150) can wirelessly transmit and receive signals with the remote control device (200) via the RF module (152). In addition, the user input interface unit (150) can receive signals transmitted by the remote control device (200) according to the IR communication standard via the IR module (153).

[0154] The coordinate value calculation unit (155) can calculate the coordinate values ​​(x, y) of the pointer (205) to be displayed on the display (170) by correcting hand tremors or errors from a signal corresponding to the operation of the remote control device (200) received through the wireless communication unit (151).

[0155] A transmission signal of a remote control device (200) input to a video display device (100) through a user input interface unit (150) can be transmitted to a control unit (170) of the video display device (100). The control unit (170) of the video display device (100) can check information about the operation and key operation of the remote control device (200) from the signal transmitted from the remote control device (200) and control the video display device (100) in response thereto.

[0156] As another example, the remote control device (200) can calculate the pointer coordinate values ​​corresponding to the operation and output them to the user input interface unit (150) of the image display device (100). In this case, the user input interface unit (150) of the image display device (100) can transmit information about the received pointer coordinate values ​​to the control unit (170) without a separate hand shake or error correction process.

[0157] In addition, as another example, the coordinate value calculation unit (155) may be provided inside the control unit (170) rather than the user input interface unit (150), unlike in the drawing.

[0158] Figure 5 is a drawing referenced in the description of the server of Figure 1.

[0159] Referring to FIG. 5, the server (400) may include a relay server (410), an STT (Speech To Text) server (420), an NLP (Natural Language Processing) server (430), an AI (Artificial Intelligence) server (440), and / or a database (450). In the present disclosure, the relay server (410), the STT server (420), the NLP server (430), and the AI ​​server (440) are described as being distinct from each other, but are not limited thereto. For example, two or more of the relay server (410), the STT server (420), the NLP server (430), and the AI ​​server (440) may be configured as one server.

[0160] The relay server (410) can communicate with the video display device (100). The relay server (410) can transfer data between the STT server (420), the NLP server (430), and the video display device (100). The relay server (410) can store at least a portion of the data transferred between the STT server (420), the NLP server (430), and the video display device (100).

[0161] The STT server (420) can receive voice data. The STT server (420) can convert the voice data into text data. The STT server (420) can transmit the text data to the video display device (100) via the relay server (410). The STT server (420) may also be referred to as an ASR (Automatic Speech Recognition) server.

[0162] The STT server (420) can improve the accuracy of speech-to-text conversion using a language model. The language model can refer to a model that can calculate the probability of a sentence or the probability of a subsequent word given previous words. For example, the language model can include probabilistic language models such as a unigram model, a bigram model, an N-gram model, etc. In other words, the STT server (420) can use the language model to determine whether text data converted from speech data has been appropriately converted, thereby improving the accuracy of conversion into text data.

[0163] The NLP server (430) can receive text data. Based on the received text data, the NLP server (430) can perform intent analysis on the text data. The NLP server (430) can transmit intent analysis information indicating the results of the intent analysis to the video display device (100) via the relay server (410).

[0164] According to one embodiment, the NLP server (430) may sequentially perform a morphological analysis step, a syntax analysis step, a speech act analysis step, and a dialogue processing step on text data to generate intent analysis information. The morphological analysis step is a step of classifying text data corresponding to speech uttered by a user into morphemes, which are the smallest units having meaning, and determining which part of speech each classified morpheme has. The syntax analysis step is a step of using the results of the morphological analysis step to classify text data into noun phrases, verb phrases, adjective phrases, etc., and to determine what kind of relationship exists between each of the classified phrases. Through the syntax analysis step, the subject, object, and modifiers of the speech uttered by the user can be determined. The speech act analysis step is a step of analyzing the intent of the speech uttered by the user using the results of the syntax analysis step. Specifically, the speech act analysis step is a step of determining the intent of a sentence, such as whether the user is asking a question, making a request, or simply expressing an emotion. The conversation processing stage uses the results of the speech act analysis stage to determine whether to respond to the user's utterance, respond, or ask a question for additional information.

[0165] The AI ​​server (440) may transmit a response according to a request from the NLP server (430) to the relay server (410) or the NLP server (430). For example, when a content search request is received from the NLP server (430), the AI ​​server (440) may transmit data for at least one content corresponding to the received content search request to the NLP server (430). For example, when a recommendation request for a keyword associated with a predetermined keyword (hereinafter, “associated keyword”) is received from the NLP server (430), the AI ​​server (440) may transmit data for at least one associated keyword corresponding to the predetermined keyword to the NLP server (430).

[0166] In one embodiment, the AI ​​server (440) may include multiple AI agent servers. Here, the multiple AI agent servers may each correspond to a type of request from the NLP server (430). For example, the AI ​​server (440) may utilize a first AI agent server when a text-related request is received from the NLP server (430), and may utilize a second AI agent server when a video-related request is received.

[0167] The database (450) can store data used to generate responses from the AI ​​server (440). The database (450) can include multiple sub-databases (451 to 453). For example, the database (450) can include a first database (451) that stores text such as syllables and words, a second database (452) that stores voices, a third database (453) that stores various learning models, etc.

[0168] FIG. 6 is a flowchart of an operation method of an image display device according to one embodiment of the present disclosure.

[0169] Referring to FIG. 6, the image display device (100) can activate a function for receiving voice input (hereinafter, voice recognition function) in operation S601. The image display device (100) can activate the voice recognition function based on receiving a command for activating the voice recognition function (hereinafter, start command) from the remote control device (200). For example, when a user presses a specific button included in the remote control device (200), the remote control device (200) can transmit the start command to the image display device (100). Meanwhile, when the voice recognition function of the image display device (100) is activated, the remote control device (200) can activate a microphone included in the user input unit (230).

[0170] When the voice recognition function is activated, the video display device (100) can output a predetermined screen corresponding to the voice recognition function through the display (180). At this time, the predetermined screen may include at least one object corresponding to the voice recognition function. For example, the predetermined screen may include an object corresponding to the termination of the voice recognition function (hereinafter, referred to as a termination object).

[0171] The video display device (100) can determine, in operation S602, whether a voice input is received. For example, if a user's voice is input into the remote control device (200) through a microphone included in the remote control device (200), the remote control device (200) can transmit data regarding the input user's voice to the video display device (100).

[0172] In operation S603, if a voice input is received, the video display device (100) can transmit the voice input to the server (400). In addition, the video display device (100) can receive text corresponding to the voice input from the server (400). For example, if the video display device (100) transmits voice data to the server (400), the STT server (420) can convert the voice data into text data and transmit it to the video display device (100).

[0173] According to one embodiment, the video display device (100) can transmit voice data in preset units such as syllables and words to the server (400). That is, when a user utters a sentence, the video display device (100) can transmit voice data in preset units to the server (400) and receive text data in preset units from the server (400) while a voice input corresponding to the sentence is received from the remote control device (200).

[0174] The video display device (100) can output text corresponding to a voice input through the display (180) in operation S604. The video display device (100) can display text corresponding to a voice input through a predetermined screen corresponding to a voice recognition function output through the display (180).

[0175] The video display device (100), in operation S605, can determine whether the voice input received from the remote control device (200) corresponds to a sentence. For example, if a preset minimum time has elapsed since the voice input was received from the remote control device (200), the video display device (100) can determine that the voice input received from the remote control device (200) constitutes a sentence. For example, if a preset word is included in the text corresponding to the voice input, the video display device (100) can determine that the voice input received from the remote control device (200) constitutes a sentence. Here, the preset word may include a conjunction (e.g., and, so, but, then), which is an element that connects a word, phrase, or sentence to the following word, phrase, or sentence, and a meaningless word (e.g., empty word) located in the middle or at the end of a sentence.

[0176] The video display device (100), in operation S606, can perform intent analysis on the voice input if the voice input corresponds to a sentence. For example, the video display device (100) can transmit text corresponding to the voice input to the NLP server (420) via the relay server (410). For example, if the relay server (410) stores text corresponding to the voice input converted by the STT server (420), the video display device (100) can request intent analysis on the text corresponding to the voice input stored in the relay server (410) from the server (400).

[0177] In this disclosure, the video display device (100) is described as determining whether a voice input corresponds to a sentence, but is not limited thereto. For example, the relay server (410) may determine whether a voice input received from the video display device (100) corresponds to a sentence. In addition, the relay server (410) may transmit text corresponding to the voice input stored in the relay server (410) to the NLP server (420).

[0178] In operation S607, the video display device (100) can determine whether the voice input is an input for editing existing text based on the intent analysis information received from the NLP server (430). For example, the video display device (100) can determine whether the intent analysis information received from the NLP server (430) includes an editing type corresponding to the voice input. Here, the editing type may include insertion, deletion, modification, replacement, etc. of text.

[0179] In operation S608, if the voice input is an input for editing text, the video display device (100) can delete text corresponding to the voice input for editing text from a predetermined screen. In addition, the video display device (100) can edit existing text displayed on a predetermined screen based on the voice input for editing text. For example, the intent analysis information received from the NLP server (430) can include keywords included in the voice input, sentence components corresponding to the keywords, editing types corresponding to the voice input, etc. In this case, the video display device (100) can edit the text displayed on the predetermined screen based on the keywords, sentence components, editing types, etc. included in the intent analysis information.

[0180] The video display device (100) can determine, in operation S609, whether a command to terminate the voice recognition function (hereinafter, "termination command") has been received. For example, the video display device (100) can determine that a termination command has been received if an input for selecting a termination object displayed on a predetermined screen is received from a remote control device (200).

[0181] According to one embodiment, the video display device (100) can initialize all text output through a given screen before the start command is received again, if the start command is received again before the end command is received.

[0182] Meanwhile, in operation S610, if no voice input is received, the video display device (100) can determine whether a predetermined time has elapsed since the voice input was received. Here, the predetermined time may exceed a preset minimum time.

[0183] In operation S611, when a predetermined time has elapsed since a voice input is received, the video display device (100) can output at least one keyword (hereinafter, “recommended keyword”) related to the voice input through a predetermined screen. The video display device (100) can output an object (hereinafter, “recommended object”) corresponding to the recommended keyword through a predetermined screen.

[0184] For example, when a predetermined time has passed since the first voice input was received, the video display device (100) may request a recommended keyword for the first voice input from the server (400). At this time, the video display device (100) may transmit a text corresponding to the first voice input to the server (400). The server (400) may transmit a related keyword for a keyword included in the text corresponding to the first voice input received from the video display device (100) as a recommended keyword to the video display device (100). Meanwhile, the server (400) may also transmit a recommended keyword for the first voice input to the video display device (100) after a predetermined time has passed since the first voice input was received.

[0185] The video display device (100) can determine, in operation S612, whether an input for selecting a recommended keyword displayed on a predetermined screen is received from the remote control device (200). For example, the video display device (100) can determine whether an input for selecting an object is received from the remote control device (200) in a state where the coordinates of the pointer (205) correspond to a recommended object.

[0186] In operation S613, when a recommended keyword is selected, the video display device (100) can output text corresponding to the selected recommended keyword. Meanwhile, when a first recommended keyword is selected, the video display device (100) can output at least one second recommended keyword associated with the selected first recommended keyword.

[0187] Meanwhile, the video display device (100) can process the entire text output through a predetermined screen when a termination command is received in operation S613. In this disclosure, an example will be provided in which the entire text output through a predetermined screen is processed as input for a service utilizing interactive artificial intelligence.

[0188] Figure 7 is a flowchart illustrating a method of operating a system according to one embodiment of the present disclosure. Any details that overlap with those described in Figure 6 will be omitted for detailed explanation.

[0189] Referring to FIG. 7, the video display device (100) can activate a voice recognition function in operation S701. For example, the video display device (100) can activate the voice recognition function based on receiving a start command from a remote control device (200).

[0190] The video display device (100) can receive voice input in operation S702. For example, the video display device (100) can receive data regarding the user's voice input through a microphone included in the remote control device (200) from the remote control device (200).

[0191] The video display device (100) can transmit the received voice input to the relay server (410) in operation S703. For example, while the voice input is being received, the video display device (100) can transmit voice data in preset units such as syllables and words to the relay server (410).

[0192] The relay server (410) can transmit the voice input received from the video display device (100) to the STT server (420) in operation S704.

[0193] The STT server (430) can convert voice input received from the relay server (410) into text in operation S705.

[0194] The STT server (430) can transmit text corresponding to voice input to the relay server (410) in operation S706.

[0195] The relay server (410) can transmit the text received from the STT server (420) to the video display device (100) in operation S707. According to one embodiment, the relay server (410) can store the text received from the STT server (420).

[0196] The video display device (100) can output text corresponding to voice input received from the relay server (410) through a predetermined screen in operation S708.

[0197] In operation S709, if the voice input corresponds to a sentence, the video display device (100) may request the relay server (410) to perform intent analysis on the voice input. For example, if the relay server (410) stores text corresponding to the voice input converted by the STT server (420), the video display device (100) may request intent analysis on the text corresponding to the voice input stored in the relay server (410). For example, if the relay server (410) does not store text corresponding to the voice input converted by the STT server (420), the video display device (100) may transmit the text corresponding to the voice input to the relay server (410).

[0198] The relay server (410) can transmit text corresponding to the voice input to the NLP server (430) in operation S710.

[0199] The NLP server (430) may, in operation S711, perform intent analysis on text corresponding to a voice input. For example, the NLP server (430) may determine keywords included in the voice input, sentence components of the keywords, and the intent of the sentence through intent analysis of the voice input. In this case, if the intent of the sentence is to edit existing text, the NLP server (430) may determine the editing type corresponding to the voice input.

[0200] The NLP server (430) can transmit the intent analysis result including intent analysis information to the relay server (410) in operation S712.

[0201] The relay server (410) can transmit the intent analysis result received from the NLP server (430) to the image display device (100) in operation S713.

[0202] The video display device (100) may perform an operation based on the intent analysis result in operation S714. For example, if the voice input is not an input related to editing existing text, the video display device (100) may maintain the text displayed on the predetermined screen. For example, if the voice input is an input related to editing existing text, the video display device (100) may delete the text corresponding to the voice input related to editing text from the predetermined screen. In addition, the video display device (100) may edit the existing text displayed on the predetermined screen based on the voice input related to editing text.

[0203] Meanwhile, the video display device (100) may request a recommended keyword from the relay server (410) in operation S715. For example, when a predetermined time has elapsed since the first voice input is received, the video display device (100) may request a recommended keyword for the first voice input from the relay server (410). At this time, the video display device (100) may transmit a text corresponding to the first voice input to the relay server (410). Alternatively, if the text corresponding to the first voice input is stored in the relay server (410), the video display device (100) may omit transmitting the text corresponding to the first voice input to the relay server (410).

[0204] The relay server (410) may request a recommended keyword from the AI ​​server (440) in operation S716. For example, the relay server (410) may transmit a text corresponding to the first voice input to the AI ​​server (440). Meanwhile, the relay server (410) may also request a recommended keyword by transmitting a text corresponding to the first voice input to the NLP server (430). In this case, the NLP server (430) may transmit the intent analysis result for the text corresponding to the first voice input to the AI ​​server (440).

[0205] The AI ​​server (440) may determine a recommended keyword in operation S717. For example, the AI ​​server (440) may use data contained in the database (450) to determine a related keyword corresponding to a keyword contained in the first voice input as a recommended keyword.

[0206] According to one embodiment, the AI ​​server (440) may determine recommended keywords based on a preset pattern that constitutes a sentence. For example, if the received text corresponds to a sentence, the AI ​​server (440) may determine a keyword for the subject of the next sentence associated with the keyword of the sentence as a recommended keyword. For example, if the received text is an incomplete sentence including a subject, the AI ​​server (440) may determine a keyword for the object associated with the subject included in the text as a recommended keyword.

[0207] The AI ​​server (440) can transmit recommended keywords to the relay server (410) in operation S718.

[0208] The relay server (410) can transmit the recommended keyword received from the AI ​​server (440) to the video display device (100) in operation S719.

[0209] The video display device (100) can output a recommended keyword in operation S720. The video display device (100) can output a recommended object corresponding to the recommended keyword through a predetermined screen.

[0210] Meanwhile, the video display device (100) can process the entire text output through a predetermined screen when a termination command is received in operation S730. For example, the video display device (100) can process the entire text output through a predetermined screen as input for a service utilizing interactive artificial intelligence.

[0211] FIGS. 8 to 33 are drawings for reference in explaining the operation of a video display device that composes text using voice input according to various embodiments of the present disclosure.

[0212] Referring to FIG. 8, the video display device (100) can output a predetermined screen (800) corresponding to the voice recognition function based on receiving an initiation command for activating the voice recognition function from the remote control device (200). At this time, the microphone of the remote control device (200) can be activated to receive voice input.

[0213] The given screen (800) may include a first indicator (810) indicating a waiting state for voice input, an end object (820), and / or an example of voice input.

[0214] Referring to FIG. 9, when a user utters the first voice input, “Make a fairy tale,” the remote control device (200) can transmit the first voice input received through the microphone to the video display device (100).

[0215] The video display device (100) can transmit a first voice input received from a remote control device (200) to a server (400). The video display device (100) can output text (910) corresponding to the first voice input through a predetermined screen (800) based on the text corresponding to the first voice input received from the server (400). According to one embodiment, the video display device (100) can transmit the first voice input to the server (400) as voice data in preset units such as syllables and words. At this time, the video display device (100) can sequentially output text corresponding to the voice data received from the server (400) through a predetermined screen (800).

[0216] The video display device (100) can change the first indicator (810) included in a predetermined screen (800) to a second indicator (815) indicating the reception status of the voice input while receiving the first voice input from the remote control device (200).

[0217] Referring to FIG. 10, the video display device (100) can change the second indicator (815) included in the predetermined screen (800) back to the first indicator (810) as the reception of the first voice input is completed.

[0218] The video display device (100) can request the server (400) to analyze the intent of the first voice input, "Make a fairy tale." At this time, since the first voice input, "Make a fairy tale," is not an input for editing existing text, the video display device (100) can maintain the text (910) corresponding to the first voice input output through a predetermined screen (800). Meanwhile, the video display device (100) can receive data from the server (400) regarding keywords included in the first voice input, sentence components corresponding to the keywords, etc.

[0219] According to one embodiment, the image display device (100) can output an object (hereinafter, additional object) (830) corresponding to additional reception of voice input through a predetermined screen (800). If the image display device (100) determines that the first voice input corresponds to a sentence, the image display device (100) can output the additional object (830) through the predetermined screen (800). If the image display device (100) determines that the first voice input is not an input for editing existing text, the image display device (100) can output the additional object (830) through the predetermined screen (800). Meanwhile, after the additional object (830) is displayed on the predetermined screen (800) and before an input for selecting the additional object (830) from the remote control device (200) is received by the image display device (100), the microphone of the remote control device (200) can be deactivated.

[0220] Meanwhile, according to one embodiment, the video display device (100) may determine that a termination command has been received when, while an additional object (830) is displayed on a predetermined screen (800), no input for selecting an additional object (830) is received from the remote control device (200) for a predetermined period of time.

[0221] Referring to FIG. 11, when a user selects an additional object (830) using a pointer (205) displayed on a predetermined screen (800), the microphone of the remote control device (200) may be activated. Meanwhile, when an input for selecting an additional object (830) is received from the remote control device (200), the image display device (100) may output a third indicator (835) indicating that the image display device (100) is receiving a voice input through the predetermined screen (800). For example, when a user selects an additional object (830) using a pointer (205) displayed on the predetermined screen (800), the image display device (100) may change the additional object (830) included in the predetermined screen (800) to the third indicator (835).

[0222] Referring to FIGS. 12 and 13, when a user utters the second voice input, “This is a story about a naughty witch tormenting a good pig,” the remote control device (200) can transmit the second voice input received through the microphone to the video display device (100). The video display device (100) can display a second indicator (815) on a predetermined screen (800) while the second voice input is received from the remote control device (200).

[0223] The video display device (100) can transmit the second voice input to the server (400) as voice data in preset units such as syllables and words. At this time, the video display device (100) can sequentially output text corresponding to the voice data received from the server (400) through a predetermined screen (800). Accordingly, while the second voice input is being received, text (915) corresponding to a portion of the first voice input and the second voice input can be output on the predetermined screen (800).

[0224] When the reception of the second voice input is completed, the video display device (100) can output text (920) corresponding to the first voice input and the second voice input through a predetermined screen (800).

[0225] The video display device (100) can request the server (400) to analyze the intent of the second voice input, 'It's a story about a mean witch harassing a good pig.' At this time, since the second voice input, 'It's a story about a mean witch harassing a good pig,' is not an input regarding editing of an existing text, the video display device (100) can maintain the text (920) corresponding to the first voice input and the second voice input output through a predetermined screen (800). Meanwhile, the video display device (100) can receive data on keywords included in the second voice input, sentence components corresponding to keywords, etc., from the server (400).

[0226] Meanwhile, the video display device (100) may display a first indicator (810) on a predetermined screen (800) as the reception of the second voice input is completed. In addition, since the second voice input corresponds to a sentence and is not an input for editing existing text, an additional object (830) may be displayed on the predetermined screen (800).

[0227] Meanwhile, according to one embodiment, the video display device (100) may not use a user interface for the additional object (830). In this case, the video display device (100) may have the microphone of the remote control device (200) activated between the time a start command is received and the time a stop command is received. The following description will be based on an embodiment in which a user interface for the additional object (830) is not used.

[0228] Referring to FIG. 14, when the pointer (205) points to text displayed on a predetermined screen (800), the video display device (100) may determine a portion corresponding to the pointer (205) as an editing area (1400). At this time, the portion corresponding to the pointer (205) may be determined based on parts of speech such as nouns, adjectives, and verbs and / or sentence components such as subjects, objects, and modifiers included in the text displayed on the predetermined screen (800). For example, when the coordinates of the pointer (205) correspond to 'the witch' among the second voice inputs among the text displayed on the predetermined screen (800), the portion corresponding to 'the witch' may be set as the editing area (1400).

[0229] Meanwhile, when an editing area (1400) is set, the video display device (100) can display an object related to editing of the editing area (1400) on a predetermined screen (800). The object related to editing of the editing area (1400) can include an object corresponding to editing of text (hereinafter, “edit object”) (841), an object corresponding to deleting of text (hereinafter, “delete object”) (842), etc.

[0230] Referring to FIG. 15, the image display device (100) can adjust a text portion corresponding to an editing area (1400). For example, the image display device (100) can adjust a text portion corresponding to an editing area (1400) based on an input for operating a direction key received from a remote control device (200).

[0231] Meanwhile, according to one embodiment, the image display device (100) can adjust a text portion corresponding to the editing area (1400) based on a change in the position of the pointer (205). For example, when an input for selecting the editing area (1400) is received through the remote control device (200), the image display device (100) can enlarge or reduce a text portion corresponding to the editing area (1400) to the left in response to a movement of the position of the pointer (205) to the left.

[0232] Referring to Fig. 16, when the text portion corresponding to 'the annoying witch' is set as the editing area (1400), the user can select a deletion object (842) using the pointer (205) displayed on a predetermined screen (800). At this time, the video display device (100) can display the text (925) with 'the annoying witch' deleted on the predetermined screen (800).

[0233] Meanwhile, referring to FIG. 17, when the text portion corresponding to 'the annoying witch' is set as the editing area (1400), the user can select a modification object (841) using the pointer (205) displayed on the predetermined screen (800). At this time, the image display device (100) can output a third indicator (835) indicating that the image display device (100) is receiving a voice input through the predetermined screen (800). For example, when the user selects an additional object (830) using the pointer (205) displayed on the predetermined screen (800), the image display device (100) can change the object related to editing included in the predetermined screen (800) to the third indicator (835).

[0234] Referring to FIG. 18, when a user utters the third voice input, “a hunter with a scary gun,” the remote control device (200) can transmit the third voice input received through the microphone to the image display device (100). The image display device (100) can transmit the third voice input received from the remote control device (200) to the server (400). The image display device (100) can output text corresponding to the voice data received from the server (400) through a predetermined screen (800). At this time, the predetermined screen (800) can display text (930) in which “a nasty witch” is changed to “a hunter with a scary gun.”

[0235] Meanwhile, referring to FIGS. 19 and 20, when a user utters a fourth voice input, “I want to change a good pig into a cute rabbit,” while texts (920) corresponding to the first and second voice inputs are displayed on a predetermined screen (800), the remote control device (200) can transmit the fourth voice input received through the microphone to the image display device (100). The image display device (100) can transmit the fourth voice input to the STT server (420) and receive text corresponding to the fourth voice input. Based on the text corresponding to the fourth voice input, the image display device (100) can output texts (940) corresponding to the first, second, and fourth voice inputs through the predetermined screen (800).

[0236] The video display device (100) may request the server (400) to perform an intent analysis on the fourth voice input. The NLP server (430) may perform an intent analysis on the fourth voice input. At this time, the NLP server (430) may determine that the intent of the sentence corresponding to the fourth voice input is editing of existing text based on the word "I want to edit" included in the fourth voice input. In addition, the NLP server may determine the type of editing as text replacement, determine the keyword before replacement as "good pig", and determine the keyword after replacement as "cute rabbit", and determine that both keywords are noun phrases.

[0237] Referring to FIG. 21, the video display device (100) may determine, based on intent analysis information received from the server (400), that the fourth voice input is an input regarding editing text. At this time, the video display device (100) may delete the text corresponding to the fourth voice input, "I want to change a good pig into a cute rabbit," from a predetermined screen (800).

[0238] The video display device (100) can display text (945) that changes 'good pig' to 'cute rabbit' in the text (920) corresponding to the first voice input and the second voice input on a predetermined screen (800) based on keywords included in the intent analysis information received from the server (400).

[0239] Meanwhile, referring to FIGS. 22 and 23, when the user utters the fifth voice input, “I want to edit it with a cute rabbit,” while the text (920) corresponding to the first voice input and the second voice input are displayed on the predetermined screen (800), the remote control device (200) can transmit the fifth voice input received through the microphone to the image display device (100). The image display device (100) can transmit the fifth voice input to the STT server (420) and receive the text corresponding to the fifth voice input. Based on the text corresponding to the fifth voice input, the image display device (100) can output the text (950) corresponding to the first voice input, the second voice input, and the fifth voice input through the predetermined screen (800).

[0240] The video display device (100) may request the server (400) to perform an intent analysis on the fifth voice input. The NLP server (430) may perform an intent analysis on the fifth voice input. At this time, the NLP server (430) may determine that the intent of the sentence corresponding to the fifth voice input is to edit existing text based on the phrase "I want to edit" included in the fifth voice input. In addition, the NLP server may determine that the keyword after editing is "cute rabbit," determine that the keyword is a noun phrase composed of an adjective and a noun, and determine the type of editing as text replacement.

[0241] Referring to FIG. 24, the video display device (100) may determine that the fifth voice input is an input regarding editing text based on the intent analysis information received from the server (400). At this time, the video display device (100) may delete the text corresponding to the fifth voice input, "I want to edit it to a cute rabbit," from the predetermined screen (800).

[0242] Meanwhile, the video display device (100) can confirm that the noun phrase 'cute rabbit' is a keyword after editing based on the keyword included in the intent analysis information received from the server (400). At this time, the video display device (100) can determine 'annoying witch' and 'nice pig', which are composed of adjectives and nouns, in the text (920) corresponding to the first voice input and the second voice input, as keywords before editing based on the fact that 'cute rabbit' is a noun phrase composed of an adjective and a noun.

[0243] The video display device (100) can display a fourth indicator (851, 852) indicating a keyword before editing on a predetermined screen based on the presence of multiple keywords before editing. The fourth indicator (851, 852) can be displayed adjacent to a text portion determined as a keyword before editing. In addition, the video display device (100) can display a portion determined as a keyword before editing as an edit area. The user can select one of the fourth indicators (851, 852) indicating a keyword before editing by using the pointer (205) displayed on the predetermined screen (800) when 'bad witch' and 'good pig' are determined as keywords before editing. Alternatively, the user can select one of the portions determined as keywords before editing displayed as an edit area by using the pointer (205) displayed on the predetermined screen (800).

[0244] Referring to FIG. 25, when a user selects 'annoying witch' among 'annoying witch' and 'nice pig' determined as keywords before editing, the video display device (100) can display text (955) that changes 'annoying witch' to 'cute rabbit' in the text (920) corresponding to the first voice input and the second voice input on a predetermined screen (800).

[0245] Meanwhile, according to one embodiment, a user may edit a portion of text output through a predetermined screen (800) using a voice input. For example, if a user utters "I want to delete from 'Naughty Witch' to 'Story'," the NLP server (430) may determine that the intent of the sentence is to edit the existing text based on 'I want to delete' included in the voice input. In addition, the NLP server may determine the editing type as deletion of text and determine 'Naughty Witch' and 'Story' as keywords indicating the deletion range. In addition, the image display device (100) may display the deleted text from 'Naughty Witch' to 'Story' in the text (920) corresponding to the first voice input and the second voice input on the predetermined screen (800) based on the keywords included in the intent analysis information received from the server (400).

[0246] Meanwhile, referring to FIGS. 26 and 27, when a user utters the first voice input, “Make me a fairy tale,” the video display device (100) can display text (810) corresponding to the first voice input on a predetermined screen (800). At this time, if the video display device (100) determines that the first voice input corresponds to a sentence rather than an input for editing an existing text, the video display device (100) can display a fifth indicator (861) indicating the sentence on the predetermined screen (800). The fifth indicator (861) corresponding to the first voice input can be placed adjacent to a text portion corresponding to the first voice input.

[0247] In addition, when the user utters the second voice input, "It's a story about a naughty witch tormenting a good pig," the video display device (100) can display text (820) corresponding to the first voice input and the second voice input on a predetermined screen (800). At this time, if the video display device (100) determines that the second voice input corresponds to a sentence rather than an input for editing an existing text, the video display device (100) can display a fifth indicator (862) indicating the sentence on the predetermined screen (800). The fifth indicator (862) corresponding to the second voice input can be placed adjacent to a text portion corresponding to the second voice input.

[0248] Referring to FIG. 28, when the fifth indicator (861, 862) is displayed on a predetermined screen (800), if the user utters the sixth voice input, “I want to edit number 2,” the remote control device (200) can transmit the sixth voice input received through the microphone to the video display device (100). The video display device (100) can transmit the sixth voice input to the STT server (420) and receive text corresponding to the sixth voice input. Based on the text corresponding to the sixth voice input, the video display device (100) can output text (960) corresponding to the first voice input, the second voice input, and the sixth voice input through the predetermined screen (800).

[0249] The video display device (100) may request the server (400) to perform an intent analysis on the sixth voice input. The NLP server (430) may perform an intent analysis on the sixth voice input. At this time, the NLP server (430) may determine that the intent of the sentence corresponding to the fourth voice input is to edit existing text based on the phrase "I want to edit" included in the sixth voice input. In addition, the NLP server may determine the type of editing as text editing and determine the keyword to be edited as "2."

[0250] Referring to FIG. 29, the video display device (100) may determine that the sixth voice input is an input regarding editing text based on the intent analysis information received from the server (400). At this time, the video display device (100) may delete the text corresponding to the sixth voice input, 'I want to edit it twice', from the predetermined screen (800).

[0251] The video display device (100) can determine that the fifth indicator (862) corresponding to the second voice input among the fifth indicators (861, 862) is selected based on a keyword included in the intent analysis information received from the server (400).

[0252] The video display device (100) can display, on a predetermined screen (800), a sixth indicator (871 to 876) indicating sentence components constituting a sentence corresponding to the second voice input based on the selection of the fifth indicator (862) corresponding to the second voice input. Each of the sixth indicators (871 to 876) can be positioned adjacent to a sentence component constituting a sentence corresponding to the second voice input.

[0253] When a user selects one of the sixth indicators (871 to 876) using a pointer (205) displayed on a predetermined screen (800) or using voice input, the image display device (100) can perform editing on a sentence element corresponding to the selected sixth indicator. For example, the image display device (100) can output a modification object (841), a deletion object (842), etc. adjacent to the sentence element corresponding to the selected sixth indicator.

[0254] Meanwhile, according to one embodiment, the image display device (100) may perform editing on a sentence corresponding to the selected fifth indicator based on the selection of one of the fifth indicators (861, 862). For example, the image display device (100) may output a modification object (841), a deletion object (842), etc. adjacent to the sentence corresponding to the selected fifth indicator.

[0255] Meanwhile, referring to FIG. 30, the video display device (100) can display text (910) corresponding to the first voice input through a predetermined screen (800) based on the reception of the first voice input, "Make a fairy tale." The video display device (100) can determine whether a predetermined amount of time has elapsed since the first voice input was received. If the predetermined amount of time has elapsed since the first voice input was received, the video display device (100) can request a recommended keyword for the first voice input from the server (400).

[0256] The NLP server (430) may perform intent analysis on the text corresponding to the first voice input. At this time, based on the words "fairy tale" and "make it," included in the first voice input, the NLP server (430) may determine that the intent of the sentence corresponding to the first voice input is that the user is requesting the creation of a text in the genre of a fairy tale.

[0257] The AI ​​server (440) may determine a related keyword corresponding to the keyword 'fairy tale' included in the first voice input as a recommended keyword based on the intent analysis result received from the NLP server (430). For example, the AI ​​server (440) may use a database corresponding to 'fairy tale' among multiple databases (450). At this time, the AI ​​server (440) may determine a recommended keyword using a preset pattern that constitutes a sentence. For example, the AI ​​server (440) may determine 'in the forest', 'in the sea', and 'in the castle', which are related keywords for the background of 'fairy tale', as recommended keywords based on the intent of the sentence corresponding to the first voice input being the creation of a text.

[0258] Referring to FIG. 31, the video display device (100) can output a recommended keyword for a first voice input received from a server (400) through a predetermined screen (800). At this time, the video display device (100) can output a recommended object (3110, 3120, 3130) corresponding to the recommended keyword received from the server (400) through a predetermined area (870) of the predetermined screen (800). The user can select one of the recommended objects (3110, 3120, 3130) using the pointer (205) displayed on the predetermined screen (800).

[0259] Referring to FIG. 32, when a user selects an object (3130) corresponding to 'in the castle' among the recommended objects (3110, 3120, 3130), the video display device (100) can display the first voice input and text (971) corresponding to the recommended keyword 'in the castle' on a predetermined screen (800).

[0260] Meanwhile, the video display device (100) can request the server (400) again for the first voice input and recommended keywords for "in the castle." The NLP server (430) can perform intent analysis on the text (971) corresponding to the first voice input and "in the castle." At this time, the NLP server (430) can determine that the intent of the sentence corresponding to the first voice input is that the user requests the creation of a piece of writing in the genre of a fairy tale, and that "in the castle" is an adverbial phrase corresponding to the background of the piece.

[0261] The AI ​​server (440) may determine, based on the intent analysis result received from the NLP server (430), a related keyword corresponding to the keyword 'fairy tale' included in the first voice input and the 'castle' as the background of the text as recommended keywords. At this time, the AI ​​server (440) may determine the recommended keywords using a preset pattern that constitutes a sentence. For example, based on the fact that the genre of the text is 'fairy tale' and the background is 'castle', the AI ​​server (440) may determine 'prince', 'princess', and 'wizard' as recommended keywords, which are related keywords for the subject related to the 'castle' as the background of the 'fairy tale'.

[0262] The video display device (100) can output the first voice input received from the server (400) and the recommended keyword for 'in the castle' through a predetermined screen (800). At this time, the video display device (100) can output the recommended object (3210, 3220, 3230) corresponding to the recommended keyword received from the server (400) through a predetermined area (870) of the predetermined screen (800). The user can select one of the recommended objects (3210, 3220, 3230) using the pointer (205) displayed on the predetermined screen (800).

[0263] Referring to FIG. 33, when a user selects an object (3220) corresponding to 'Princess' among the recommended objects (3210, 3220, 3230), the video display device (100) can display text (972) with 'Princess' added on a predetermined screen (800).

[0264] Meanwhile, the video display device (100) can request the server (400) again for the first voice input and recommended keywords for 'in the castle' and 'the princess'. The NLP server (430) can perform intent analysis on the text (972) to which 'the princess' has been added. At this time, the NLP server (430) can determine that the intent of the sentence corresponding to the first voice input is that the user requests the creation of a piece of writing whose genre is a fairy tale, that 'in the castle' is an adverbial phrase corresponding to the background of the piece, and that 'the princess' is the subject of the sentence.

[0265] The AI ​​server (440) may determine, based on the intent analysis result received from the NLP server (430), a keyword included in the first voice input, a related keyword corresponding to the keyword 'fairy tale', the background of the text, 'castle', and the subject of the sentence, 'princess', as recommended keywords. At this time, the AI ​​server (440) may determine the recommended keywords using a preset pattern that constitutes the sentence. For example, based on the fact that the genre of the text is 'fairy tale', the background is 'castle', and the subject is 'princess', the AI ​​server (440) may determine 'ball', 'prince', and 'food', which are related keywords for the objects related to the background of the 'fairy tale', 'castle', and the subject, 'princess', as recommended keywords.

[0266] The video display device (100) can output the first voice input received from the server (400) and the recommended keywords for 'in the castle' and 'princess' through a predetermined screen (800). At this time, the video display device (100) can output the recommended objects (3310, 3320, 3330) corresponding to the recommended keywords received from the server (400) through a predetermined area (870) of the predetermined screen (800). The user can select one of the recommended objects (3310, 3320, 3330) using the pointer (205) displayed on the predetermined screen (800).

[0267] As described above, according to at least one embodiment of the present disclosure, a long text can be composed using a user's voice input.

[0268] Additionally, according to at least one embodiment of the present disclosure, text can be edited using a user's voice input.

[0269] Additionally, according to at least one embodiment of the present disclosure, keywords for structuring sentences can be recommended by taking into account the context of the text.

[0270] Referring to FIGS. 1 to 33, a video display device (100) according to one aspect of the present disclosure includes: a display (180); an external device interface unit (130) communicating with a remote control device (200); a network interface unit (135) communicating with at least one server (400); And it includes a control unit (170), and the control unit (170) outputs a predetermined screen (800) including a first object (820) corresponding to the termination of the function through the display (180) based on receiving a first command for activating a function for receiving a voice input from the remote control device (200), and outputs text corresponding to the voice input received from the remote control device (200) through the predetermined screen (800) based on receiving a voice input from the remote control device (200), and processes the entire text output through the predetermined screen (800) based on receiving a second command for selecting the first object (820).

[0271] In addition, according to one aspect of the present disclosure, when the first voice input received from the remote control device (200) corresponds to a sentence, the control unit (170) outputs a second object (830) corresponding to additional reception of the voice input through the predetermined screen (800), and when a third command for selecting the second object (830) is received from the remote control device (200), the control unit (170) can additionally receive a second voice input from the remote control device (200).

[0272] Additionally, according to one aspect of the present disclosure, the control unit (170) may initialize the entire text output through the predetermined screen (800) if the first command is received again before the second command is received.

[0273] In addition, according to one aspect of the present disclosure, when a first voice input corresponding to editing of text is received from the remote control device (200), the control unit (170) can edit a text corresponding to a second voice input output through the predetermined screen (800) before the first voice input is received, using at least one keyword included in the first voice input.

[0274] In a system (10) according to one aspect of the present disclosure, the control unit (170) outputs text corresponding to the first voice input through the predetermined screen (800) based on the first voice input being received from the remote control device (200), and when it is determined that the first voice input corresponds to editing of the text, the text corresponding to the first voice input can be removed from the predetermined screen (800).

[0275] In addition, according to one aspect of the present disclosure, the control unit (170) may edit the text corresponding to the second voice input based on the keyword when the keyword is included in the text corresponding to the second voice input, and may edit the text corresponding to the second voice input based on the sentence component corresponding to the keyword when the keyword is not included in the text corresponding to the second voice input.

[0276] In addition, according to one aspect of the present disclosure, when a predetermined time has elapsed after a predetermined voice input is received, the control unit (170) may request the server (400) to transmit at least one first keyword associated with the predetermined voice input, output the at least one first keyword received from the server (400) through the predetermined screen (800), and, when a third command for selecting one of the at least one first keyword is received from the remote control device (200), request the server (400) to transmit at least one second keyword associated with the predetermined voice input and the selected first keyword.

[0277] In addition, according to one aspect of the present disclosure, when the text corresponding to the voice input constitutes a sentence, the control unit (170) outputs a first indicator representing the sentence adjacent to the constituted sentence through the predetermined screen (800), and based on receiving an input for selecting the first indicator from the remote control device (200), the predetermined sentence corresponding to the selected first indicator can be edited.

[0278] In addition, according to one aspect of the present disclosure, the control unit (170) can output a second indicator indicating a sentence component constituting the predetermined sentence adjacent to the sentence component based on receiving an input for selecting the first indicator from the remote control device (200).

[0279] A system (10) according to one aspect of the present disclosure includes a video display device (100), a remote control device (200), and at least one server (400), wherein the remote control device (200) transmits a first command for activating a function for receiving a voice input to the video display device (100), and transmits a voice input received through a microphone to the video display device (100) in a state where the function is activated, and the video display device (100) outputs a predetermined screen (800) including a first object (820) corresponding to the termination of the function based on the reception of the first command from the remote control device (200), transmits the voice input received from the remote control device (200) to the server (400), outputs a text corresponding to the voice input received from the server (400) through the predetermined screen (800), and selects the first object (820) based on the reception of a second command for selecting the first object (820). The entire text output through the screen (800) can be processed.

[0280] In addition, according to one aspect of the present disclosure, the server (400) includes a first server (420) that converts voice into text; a second server (430) that processes text; and a third server (410) that transfers data between the first server (420), the second server (430) and the image display device (100), and one of the first server (420) and the third server (410) transmits text corresponding to a voice input received from the image display device (100) to the second server (430) when the text corresponding to the voice input corresponds to a sentence, and the second server (430) can perform intent analysis on the text corresponding to the voice input.

[0281] In addition, according to one aspect of the present disclosure, the second server (430), when the text corresponding to the voice input does not correspond to editing of the text, transmits a keyword included in the voice input and a sentence component corresponding to the keyword to the image display device (100), and when the text corresponding to the voice input corresponds to editing of the text, transmits an editing type and an editing-related keyword corresponding to the voice input to the image display device (100), and the image display device (100) outputs the text corresponding to the first voice input through the predetermined screen (800) while the first voice input is received from the remote control device (200), and when the first voice input corresponds to editing of the text, removes the text corresponding to the first voice input from the predetermined screen (800), and edits the text corresponding to the second voice input output through the predetermined screen (800) before the first voice input is received, using the editing-related keyword according to the editing type corresponding to the first voice input.

[0282] In addition, according to one aspect of the present disclosure, when a predetermined time has elapsed after a predetermined voice input is received, the image display device (100) may request the server (400) to transmit at least one first keyword associated with the predetermined voice input, output the at least one first keyword received from the server (400) through the predetermined screen (800), and when a third command for selecting one of the at least one first keyword is received from the remote control device (200), request the server (400) to transmit at least one second keyword associated with the predetermined voice input and the selected first keyword.

[0283] In addition, according to one aspect of the present disclosure, the server (400) may determine a database corresponding to a keyword included in the first voice input among a plurality of databases, determine at least one first keyword based on data on a first sentence component of the database, and determine at least one second keyword based on data on a second sentence component different from the first sentence component of the database.

[0284] In addition, according to one aspect of the present disclosure, when the text corresponding to the voice input constitutes a sentence, the image display device (100) can output a first indicator representing the sentence adjacent to the constituted sentence through the predetermined screen (800), and edit the predetermined sentence corresponding to the selected first indicator based on receiving an input for selecting the first indicator.

[0285] The attached drawings are only intended to facilitate understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, or substitutes included in the spirit and technical scope of the present disclosure.

[0286] Meanwhile, the operating method of the present disclosure can be implemented as processor-readable code on a processor-readable recording medium. A processor-readable recording medium includes all types of recording devices that store data that can be read by a processor. Examples of processor-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage devices, etc., and also include those implemented in the form of a carrier wave, such as transmission via the Internet. Furthermore, the processor-readable recording medium can be distributed across network-connected computer systems, so that the processor-readable code can be stored and executed in a distributed manner.

[0287] In addition, although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present invention pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. Display; An external device interface unit that communicates with a remote control device; A network interface unit communicating with at least one server; and Including a control unit, The above control unit, Based on receiving a first command activating a function for receiving voice input from the remote control device, outputting a predetermined screen including a first object corresponding to the termination of the function through the display, Based on the voice input received from the remote control device, the text corresponding to the voice input received from the remote control device is output through the predetermined screen, A video display device characterized in that the entire text output through the predetermined screen is processed based on the reception of a second command for selecting the first object.

2. In paragraph 1, The above control unit, When the first voice input received from the above remote control device corresponds to a sentence, a second object corresponding to the additional reception of the voice input is output through the above predetermined screen, A video display device characterized in that, when a third command for selecting the second object is received from the remote control device, a second voice input is additionally received from the remote control device.

3. In paragraph 1, The above control unit, A video display device characterized in that, if the first command is received again before the second command is received, the entire text output through the predetermined screen is initialized.

4. In paragraph 1, The above control unit, A video display device characterized in that, when a first voice input corresponding to editing of text is received from the remote control device, text corresponding to a second voice input output through the predetermined screen before the first voice input is received is edited using at least one keyword included in the first voice input.

5. The above control unit, Based on the first voice input being received from the remote control device, a text corresponding to the first voice input is output through the predetermined screen, A video display device characterized in that, if it is determined that the first voice input corresponds to editing of the text, the text corresponding to the first voice input is removed from the predetermined screen.

6. In paragraph 4, The above control unit, If the keyword is included in the text corresponding to the second voice input, the text corresponding to the second voice input is edited based on the keyword, A video display device characterized in that, if the keyword is not included in the text corresponding to the second voice input, the text corresponding to the second voice input is edited based on the sentence component corresponding to the keyword.

7. In paragraph 1, The above control unit, When a predetermined time has elapsed after a predetermined voice input is received, requesting the server to transmit at least one first keyword associated with the predetermined voice input, Outputting at least one first keyword received from the server through the predetermined screen, A video display device characterized in that, when a third command for selecting at least one of the first keywords is received from the remote control device, transmission of the predetermined voice input and at least one second keyword associated with the selected first keyword is requested to the server.

8. In paragraph 1, The above control unit, If the text corresponding to the above voice input constitutes a sentence, a first indicator indicating the sentence is output adjacent to the composed sentence through the predetermined screen, A video display device characterized in that a predetermined sentence corresponding to the selected first indicator is edited based on an input for selecting the first indicator being received from the remote control device.

9. In paragraph 8, The above control unit, A video display device characterized in that, based on an input for selecting the first indicator being received from the remote control device, a second indicator indicating a sentence component constituting the predetermined sentence is output adjacent to the sentence component.

10. In a system including a video display device, a remote control device and at least one server, The above remote control device, Transmitting a first command to the video display device to activate the function of receiving voice input, When the above function is activated, voice input received through the microphone is transmitted to the video display device, The above video display device, Based on the first command being received from the remote control device, a predetermined screen including a first object corresponding to the termination of the function is output, Transmitting the voice input received from the above remote control device to the server, Outputting text corresponding to the voice input received from the server through the predetermined screen, A system characterized in that the entire text output through the predetermined screen is processed based on the reception of a second command for selecting the first object.

11. In paragraph 10, The above server, A first server that converts voice to text; a second server that processes the text; and Including a third server that transmits data between the first server, the second server, and the video display device, Either one of the first server and the third server, If the text corresponding to the voice input received from the video display device corresponds to a sentence, the text corresponding to the voice input is transmitted to the second server, The above second server, A system characterized by performing intent analysis on text corresponding to the above voice input.

12. In paragraph 11, The above second server, If the text corresponding to the above voice input does not correspond to the editing of the text, the keyword included in the above voice input and the sentence component corresponding to the keyword are transmitted to the image display device, If the text corresponding to the above voice input corresponds to editing of the above text, the editing type and editing-related keywords corresponding to the above voice input are transmitted to the above video display device, The above video display device, While a first voice input is received from the above remote control device, a text corresponding to the first voice input is output through the predetermined screen, If the first voice input corresponds to editing of the text, the text corresponding to the first voice input is removed from the predetermined screen, A system characterized in that the text corresponding to the second voice input output through the predetermined screen before the first voice input is received is edited using the editing-related keyword according to the editing type corresponding to the first voice input.

13. In paragraph 10, The above video display device, When a predetermined time has elapsed after a predetermined voice input is received, requesting the server to transmit at least one first keyword associated with the predetermined voice input, Outputting at least one first keyword received from the server through the predetermined screen, A system characterized in that, when a third command for selecting at least one of the first keywords is received from the remote control device, transmission of the predetermined voice input and at least one second keyword associated with the selected first keyword is requested to the server.

14. In paragraph 13, The above server, Determine a database corresponding to the keyword included in the first voice input among multiple databases, Based on data on the first sentence component of the above database, determining at least one first keyword, A system characterized in that at least one second keyword is determined based on data on a second sentence component different from the first sentence component of the database.

15. In paragraph 10, The above video display device, If the text corresponding to the above voice input constitutes a sentence, a first indicator indicating the sentence is output adjacent to the composed sentence through the predetermined screen, A system characterized in that, based on receiving an input for selecting the first indicator, a predetermined sentence corresponding to the selected first indicator is edited.

Images