Image display device and control method therefor
The video display device employs AI-driven content selection and dynamic profile image synthesis to address user convenience issues, allowing seamless content playback and enhancing user experience by integrating user intentions and viewing history.
Patent Information
- Application Number
- PCT/KR2023/008987
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-28
- Publication Date
- 2025-01-02
AI Technical Summary
Users face difficulty in easily selecting and playing desired content from various options on video display devices, lacking personalized and intuitive control methods.
A video display device equipped with a communication unit, user interface, and control unit that utilizes artificial intelligence to identify user intentions, display content lists, and integrate past viewing history, including acquaintance information, allowing voice command input and dynamic profile image synthesis for enhanced content selection and playback experience.
Enables users to effortlessly select and play desired content in their intended environment, with improved user convenience through personalized content recommendations and interactive features.
Smart Images

Figure KR2023008987_02012025_PF_FP_ABST
Abstract
Description
Video display device and its control method
[0001] The present disclosure relates to a video display device and a control method thereof, which enable the use of the video display device to be implemented with greater consideration of user convenience.
[0002] A video display device is a device that receives and processes broadcast images for viewing by a user. For example, a video display device displays a broadcast signal transmitted by a broadcast station, selected by the user, on a display. Currently, broadcasting is transitioning globally from analog to digital.
[0003] Digital broadcasting refers to broadcasting that transmits digital video and audio signals. Compared to analog broadcasting, digital broadcasting is more resistant to external noise, has less data loss, is more prone to error correction, and offers higher resolution and clearer images. Furthermore, unlike analog broadcasting, digital broadcasting allows for two-way communication.
[0004] In order to utilize digital broadcasting including various contents, the performance of video display devices has been improved and their functions have been diversified. Through the improved performance of video display devices, not only can video signals be received from broadcasting stations to watch broadcasts, but also a variety of functions can be performed through video display devices such as playing games, listening to music, and shopping online using various applications.
[0005] There is a continuing need for the development of a video display device and its control method that allows a user to easily select desired content from among various contents and play the selected content in the environment intended by the user.
[0006] The purpose of the present disclosure is to provide a video display device and a control method thereof that enable a user to easily select desired content from among various contents and play the selected content in an environment intended by the user.
[0007] In order to achieve the above object, according to one aspect of the present disclosure, a video display device may be provided, including a display, a communication unit for communicating with at least one external server, a user interface unit for communicating with a remote control device, and a control unit for receiving a user command input through the remote control device, displaying a content list including at least one content that matches a user intention identified from the user command through artificial intelligence on the display, and searching for and displaying a past viewing history for a content selected from the content list, wherein the past viewing history includes viewing time information of the selected content and information on an acquaintance who viewed the selected content together.
[0008] The personal information including the above-mentioned past viewing history may be recorded in at least one of the at least one external server and at least one of the storage units within the video display device.
[0009] The above control unit can control to display search criteria according to the user's intention together when displaying the content list.
[0010] The above control unit can control the display of the profile image of the acquaintance who watched the selected content together when playing the content.
[0011] The profile image displayed above may be a profile image that matches the viewing time.
[0012] The above control unit can control, through artificial intelligence, to synthesize a profile image that matches the viewing time based on a profile image from a different time than the viewing time.
[0013] The control unit can control the search for at least one content that matches the user's intention by connecting to one of the at least one external server through the communication unit.
[0014] The above user command may be a voice command input through the remote control device.
[0015] The above control unit can, in response to the user's intention, connect to one of the external servers and download and display the acquaintance's SNS (Social Network Service) information.
[0016] The above control unit can display a user guide for guiding the occurrence of a specific event, and control the appearance of a guide agent within the user guide to change over time.
[0017] In addition, according to one aspect of the present disclosure, a method for controlling a video display device may be provided, including the steps of receiving a user command input through a remote control device, displaying a content list including at least one content that matches a user intention identified from the user command through artificial intelligence, and searching for and displaying a past viewing history for a content selected from the content list, wherein the past viewing history includes viewing time information of the selected content and information on an acquaintance who viewed the selected content together.
[0018] The effects of the video display device and its control method according to the present disclosure are described as follows.
[0019] According to at least one of the embodiments of the present disclosure, there is an advantage in that a user can easily select desired content from among various contents and play the selected content in an environment intended by the user.
[0020] Further scope of the applicability of the present disclosure will become apparent from the detailed description below. However, since various modifications and variations within the spirit and scope of the present disclosure will become apparent to those skilled in the art, it should be understood that the detailed description and specific examples, such as preferred embodiments of the present disclosure, are given by way of example only.
[0021] FIG. 1 is a schematic block diagram of a video display device according to an embodiment of the present disclosure.
[0022] FIG. 2 is a drawing illustrating a control method of a remote control device that controls a video display device according to one embodiment of the present disclosure.
[0023] FIG. 3 is a block diagram of a remote control device that controls a video display device according to one embodiment of the present disclosure.
[0024] FIG. 4 is a flowchart regarding the operation of a video display device according to one embodiment of the present disclosure.
[0025] FIGS. 5 to 9 illustrate screens displayed on a video display device according to an embodiment of the present disclosure.
[0026] FIG. 10 illustrates an example of image synthesis or generation according to one embodiment of the present disclosure.
[0027] FIG. 11 illustrates a screen displayed on a video display device according to an embodiment of the present disclosure.
[0028] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present disclosure.
[0029] The suffixes “module” and “part” used for components in the following description are given simply for the convenience of writing this specification, and the “module” and “part” may be used interchangeably.
[0030] Additionally, these components may be implemented as separate individual hardware modules, or as two or more hardware modules, or as two or more components may be implemented as one hardware module, and in some cases, they may also be implemented as software.
[0031] Meanwhile, the video display device described in this specification is an intelligent video display device that adds computer support functions to broadcast reception functions, for example. While faithful to the broadcast reception function, it can be equipped with Internet functions and other functions, and can be equipped with a more user-friendly interface such as a manual input device, touch screen, or space remote control. In addition, it can be connected to the Internet and a computer with support for wired or wireless Internet functions, and can perform functions such as email, web browsing, banking, or games. A standardized, general-purpose operating system can be used for these various functions.
[0032] Accordingly, the video display device described in this disclosure can perform a variety of user-friendly functions, for example, since various applications can be freely added or deleted on a general-purpose operating system kernel. More specifically, the video display device can be a network TV, HBB TV, smart TV, etc., and in some cases, it can also be applied to smartphones.
[0033] Furthermore, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and the contents described in the accompanying drawings, but the present disclosure is not limited or restricted by the embodiments.
[0034] The terms used in this specification have been selected from widely used and commonly accepted terms, taking into account the functions of the present disclosure. However, these terms may vary depending on the intentions or practices of those skilled in the art, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, in which case their meanings will be described in the description of the relevant disclosure. Therefore, it is to be noted that the terms used in this specification should be interpreted based on their substantive meaning and the overall content of this specification, rather than simply their names.
[0035] FIG. 1 is a schematic block diagram of a video display device according to an embodiment of the present disclosure.
[0036] Referring to FIG. 1, a video display device (100) according to an embodiment of the present disclosure may include a broadcast receiving unit (105), an external device interface unit (135), a storage unit (140), a user input interface unit (150), a control unit (170), a display unit (180), an audio output unit (185), a power supply unit (190), and a photographing unit (not shown). The broadcast receiving unit (105) and the external device interface unit (135) may be collectively referred to as a communication unit.
[0037] The broadcast receiving unit (105) may include a tuner (110), a demodulator (120), and a network interface unit (130). Of course, if necessary, it may be designed to include a tuner (110) and a demodulator (120) but not a network interface unit (130), and conversely, it may be designed to include a network interface unit (130) but not a tuner (110) and a demodulator (120).
[0038] The tuner (110) selects an RF broadcast signal corresponding to a channel selected by the user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through an antenna. In addition, it converts the selected RF broadcast signal into an intermediate frequency signal or a baseband video or audio signal.
[0039] For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband video or audio signal (CVBS / SIF). That is, the tuner (110) can process both digital broadcast signals and analog broadcast signals. The analog baseband video or audio signal (CVBS / SIF) output from the tuner (110) can be directly input to the control unit (170).
[0040] Additionally, the tuner (110) can receive an RF broadcast signal of a single carrier according to the ATSC (Advanced Television System Committee) method or an RF broadcast signal of multiple carriers according to the DVB (Digital Video Broadcasting) method.
[0041] Meanwhile, the tuner (110) can sequentially select RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna and convert them into intermediate frequency signals or baseband video or audio signals.
[0042] The demodulation unit (120) receives a digital IF signal (DIF) converted by the tuner (110) and performs a demodulation operation.
[0043] For example, if the digital IF signal output from the tuner (110) is in ATSC format, the demodulation unit (120) performs, for example, 8-VSB (8-Vestigal Side Band) demodulation. In addition, the demodulation unit (120) may also perform channel decoding. To this end, the demodulation unit (120) may be equipped with a Trellis Decoder, a De-interleaver, a Reed-Solomon Decoder, etc., and may perform Trellis decoding, deinterleaving, and Reed-Solomon decoding.
[0044] For example, if the digital IF signal output from the tuner (110) is in the DVB format, the demodulation unit (120) performs, for example, COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. In addition, the demodulation unit (120) may also perform channel decoding. To this end, the demodulation unit (120) may be equipped with a convolution decoder, a deinterleaver, a Reed-Solomon decoder, and the like, and may perform convolution decoding, deinterleaving, and Reed-Solomon decoding.
[0045] The demodulator (120) can output a stream signal (TS) after performing demodulation and channel decoding. At this time, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) in which a video signal in the MPEG-2 standard and an audio signal in the Dolby AC-3 standard are multiplexed. Specifically, the MPEG-2 TS may include a 4-byte header and a 184-byte payload.
[0046] Meanwhile, the above-described demodulation unit (120) can be provided separately according to the ATSC method and the DVB method. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.
[0047] The stream signal output from the demodulation unit (120) can be input to the control unit (170). The control unit (170) performs demultiplexing, image / audio signal processing, etc., and then outputs the image to the display unit (180) and outputs the audio to the audio output unit (185).
[0048] The external device interface unit (135) can connect an external device and a video display device (100). To this end, the external device interface unit (135) may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).
[0049] The external device interface unit (135) can be connected to external devices such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), etc., via wired / wireless connection. The external device interface unit (135) transmits a video, audio, or data signal input from the outside through the connected external device to the control unit (170) of the video display device (100). In addition, the video, audio, or data signal processed by the control unit (170) can be output to the connected external device. For this purpose, the external device interface unit (135) may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).
[0050] The A / V input / output section may include a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, etc., so as to input video and audio signals from an external device to the video display device (100).
[0051] The wireless communication unit can perform short-range wireless communication with other electronic devices. The video display device (100) can be connected to a network with other electronic devices according to communication standards such as Bluetooth, RFID (Radio Frequency Identification), IrDA (Infrared Data Association), UWB (Ultra Wideband), ZigBee, and DLNA (Digital Living Network Alliance), for example.
[0052] In addition, the external device interface unit (135) can be connected to various set-top boxes through at least one of the various terminals described above, and can perform input / output operations with the set-top box.
[0053] Meanwhile, the external device interface unit (135) can receive an application or a list of applications in an adjacent external device and transmit it to the control unit (170) or storage unit (140).
[0054] The network interface unit (130) provides an interface for connecting the video display device (100) to a wired / wireless network including the Internet. The network interface unit (130) may be equipped with, for example, an Ethernet terminal for connection to a wired network, and may use, for example, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards for connection to a wireless network.
[0055] The network interface unit (130) can transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network. In particular, it can transmit some content data stored in the video display device (100) to a selected user or electronic device among other users or other electronic devices pre-registered in the video display device (100).
[0056] Meanwhile, the network interface unit (130) can access a predetermined web page via the connected network or another network linked to the connected network. That is, it can access a predetermined web page via the network and transmit or receive data with the corresponding server. In addition, it can receive content or data provided by a content provider or network operator. That is, it can receive content such as movies, advertisements, games, VOD, broadcast signals, and other related information provided by a content provider or network provider via the network. In addition, it can receive firmware update information and update files provided by the network operator. In addition, it can transmit data to the Internet or to a content provider or network operator.
[0057] In addition, the network interface unit (130) can select and receive a desired application from among applications open to the public through the network.
[0058] According to an embodiment, the network interface unit (130) may transmit or receive predetermined data with a user terminal connected to the video display device through a network when a game application is executed on the video display device. In addition, the network interface unit may transmit or receive predetermined data with a server that stores game scores.
[0059] The storage unit (140) may store programs for each signal processing and control within the control unit (170), and may also store signal-processed images, voices, or data signals.
[0060] In addition, the storage unit (140) may perform a function for temporary storage of video, audio, or data signals input from the external device interface unit (135) or the network interface unit (130). In addition, the storage unit (140) may store information regarding a specific broadcast channel through a channel memory function.
[0061] Additionally, the storage unit (140) can store an application or a list of applications input from the external device interface unit (135) or the network interface unit (130).
[0062] Additionally, according to an embodiment, the storage unit (140) can store unique information and game play information of a user terminal used as a game controller when providing a game application on a video display device.
[0063] The storage unit (140) may include at least one type of storage medium, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory, etc.), RAM, or ROM (for example, an EEPROM). The video display device (100) may play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit (140) and provide them to the user.
[0064] Although FIG. 1 illustrates an embodiment in which the storage unit (140) is provided separately from the control unit (170), the scope of the present disclosure is not limited thereto. The storage unit (140) may also be included within the control unit (170).
[0065] The user input interface unit (150) transmits a signal input by the user to the control unit (170) or transmits a signal from the control unit (170) to the user.
[0066] For example, the user input interface unit (150) may receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as RF (Radio Frequency) communication method and infrared (IR) communication method, or may process control signals from the control unit (170) to be transmitted to the remote control device (200).
[0067] Additionally, for example, the user input interface unit (150) can transmit a control signal input from a local key (not shown) such as a power key, channel key, volume key, or setting value to the control unit (170).
[0068] In addition, for example, the user input interface unit (150) may transmit a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit (170), or transmit a signal from the control unit (170) to the sensing unit (not shown). Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, a motion sensor, etc.
[0069] The control unit (170) can demultiplex an input stream or process demultiplexed signals through a tuner (110), a demodulator (120), or an external device interface unit (135) to generate and output a signal for video or audio output.
[0070] The image signal processed by the control unit (170) can be input to the display unit (180) and displayed as an image corresponding to the image signal. In addition, the image signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).
[0071] The voice signal processed in the control unit (170) can be output as audio to the audio output unit (185). In addition, the voice signal processed in the control unit (170) can be input to an external output device through the external device interface unit (135).
[0072] Although not shown in FIG. 1, the control unit (170) may include a demultiplexing unit, an image processing unit, etc.
[0073] In addition, the control unit (170) can control the overall operation within the video display device (100). For example, the control unit (170) can control the tuner (110) to select (tune) an RF broadcast corresponding to a channel selected by a user or a pre-stored channel.
[0074] In addition, the control unit (170) can control the video display device (100) by a user command or internal program input through the user input interface unit (150). In particular, it can connect to a network and enable the user to download a desired application or application list into the video display device (100).
[0075] For example, the control unit (170) controls the tuner (110) to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit (150). Then, the control unit processes the video, audio, or data signal of the selected channel. The control unit (170) enables the channel information selected by the user to be output through the display unit (180) or the audio output unit (185) together with the processed video or audio signal.
[0076] As another example, the control unit (170) allows a video signal or audio signal from an external device, for example, a camera or camcorder, input through the external device interface unit (135) to be output through the display unit (180) or the audio output unit (185) in accordance with an external device video playback command received through the user input interface unit (150).
[0077] Meanwhile, the control unit (170) can control the display unit (180) to display an image. For example, the control unit (170) can control the display unit (180) to display a broadcast image input through the tuner (110), an external input image input through the external device interface unit (135), an image input through the network interface unit, or an image stored in the storage unit (140). At this time, the image displayed on the display unit (180) can be a still image or a moving image, and can be a 2D image or a 3D image.
[0078] Additionally, the control unit (170) can control content playback. The content may be content stored within the video display device (100), received broadcast content, or externally input content. The content may be at least one of broadcast video, externally input video, audio files, still images, connected web screens, and document files.
[0079] Meanwhile, in relation to the embodiment of the present disclosure, the control unit (170) can control the display unit (180) to display the home screen according to an input for moving to the home screen.
[0080] The home screen may include a plurality of card objects classified by content source. The card objects may include at least one of a card object representing a thumbnail list of broadcast channels, a card object representing a broadcast guide list, a card object representing a broadcast reservation list or recording list, and a card object representing a media list within the video display device or within a device connected to the video display device. In addition, the home screen may further include at least one of a card object representing a list of connected external devices and a card object representing a list related to calls.
[0081] Additionally, the home screen may further include an application menu having at least one executable application item.
[0082] Meanwhile, when there is a card object movement input, the control unit (170) can control the card object to be moved and displayed, or a card object not displayed on the display unit (180) to be moved and displayed on the display unit (180).
[0083] Meanwhile, the control unit (170) can control the display unit (180) to display an image corresponding to a card object when a certain card object is selected from among multiple card objects in the home screen.
[0084] Meanwhile, the control unit (170) can control to display an object indicating the received broadcast image and information related to the broadcast image within a card object displaying the broadcast image. In addition, the size of the broadcast image can be controlled to be fixed by a lock setting.
[0085] Meanwhile, the control unit (170) can control to display a setup object for at least one of video settings, audio settings, screen settings, reservation settings, pointer settings of a remote control device, and network settings within the home screen.
[0086] Meanwhile, the control unit (170) may also control to display objects for login, help, or exit items in one area of the home screen.
[0087] Meanwhile, the control unit (170) can control an area of the home screen to display an object indicating the number of total card objects or the number of card objects displayed on the display unit (180) among the total card objects.
[0088] Meanwhile, the control unit (170) can control the display unit (180) to display the card object in full screen mode when a card object name within a given card object is selected among the card objects displayed on the display unit (180).
[0089] Meanwhile, when an incoming call is received within a connected external device or video display device, the control unit (170) can control to focus and display a call-related card object among a plurality of card objects, or to move and display a call-related card object within the display unit (180).
[0090] Meanwhile, when entering the application view item, the control unit (170) can control to display an application or a list of applications that can be downloaded from within the video display device (100) or from an external network.
[0091] The control unit (170) can control the installation and execution of applications downloaded from an external network, along with various user interfaces. Furthermore, it can control the display unit (180) to display images related to the running applications, based on the user's selection.
[0092] Meanwhile, although not shown in the drawing, it is also possible to further include a channel browsing processing unit that generates a thumbnail image corresponding to a channel signal or external input signal.
[0093] The channel browsing processing unit can receive a stream signal (TS) output from the demodulation unit (120) or a stream signal output from the external device interface unit (135), extract an image from the input stream signal, and generate a thumbnail image. The generated thumbnail image can be input to the control unit (170) as is or after being encoded. In addition, the generated thumbnail image can also be encoded in a stream form and input to the control unit (170). The control unit (170) can display a thumbnail list including a plurality of thumbnail images on the display unit (180) using the input thumbnail images. Meanwhile, the thumbnail images in the thumbnail list can be updated sequentially or simultaneously. Accordingly, the user can easily understand the contents of a plurality of broadcast channels.
[0094] The display unit (180) converts the image signal, data signal, OSD signal processed by the control unit (170) or the image signal, data signal, etc. received from the external device interface unit (135) into R, G, and B signals to generate a driving signal.
[0095] The display unit (180) may be a PDP, LCD, OLED, flexible display, 3D display, etc.
[0096] Meanwhile, the display unit (180) is configured as a touch screen and can be used as an input device in addition to an output device.
[0097] The audio output unit (185) receives a signal processed by the control unit (170), for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as audio. The audio output unit (185) can be implemented as various types of speakers.
[0098] Meanwhile, in order to detect a user's gesture, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor, as described above, may be further provided in the image display device (100). A signal detected by the sensing unit (not shown) may be transmitted to the control unit (170) via the user input interface unit (150).
[0099] Meanwhile, a camera unit (not shown) for filming a user may be further provided. Image information captured by the camera unit (not shown) may be input to the control unit (170).
[0100] The control unit (170) may detect the user's gesture by using an image captured from a shooting unit (not shown) or a signal detected from a sensing unit (not shown), individually or in combination.
[0101] The power supply unit (190) supplies power to the entire video display device (100).
[0102] In particular, power can be supplied to a control unit (170) that can be implemented in the form of a system on chip (SOC), a display unit (180) for displaying images, and an audio output unit (185) for audio output.
[0103] For this purpose, the power supply unit (190) may be equipped with a converter (not shown) that converts AC power into DC power. Meanwhile, for example, when the display unit (180) is implemented as a liquid crystal panel equipped with a plurality of backlight lamps, an inverter (not shown) capable of PWM operation may be further equipped for brightness variable or dimming operation.
[0104] The remote control device (200) transmits user input to the user input interface unit (150). To this end, the remote control device (200) may use Bluetooth, RF (Radio Frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, etc.
[0105] In addition, the remote control device (200) can receive video, voice or data signals output from the user input interface unit (150) and display them on the remote control device (200) or output voice or vibration.
[0106] The above-described video display device (100) may be a digital broadcast receiver capable of receiving at least one of digital broadcasting in the ATSC format (8-VSB format), digital broadcasting in the DVB-T format (COFDM format), and digital broadcasting in the ISDB-T format (BST-OFDM format) as a fixed type.
[0107] Meanwhile, the block diagram of the image display device (100) illustrated in FIG. 1 is a block diagram for one embodiment of the present disclosure. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the image display device (100) actually implemented. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are intended to explain the embodiment of the present disclosure, and the specific operations or devices thereof do not limit the scope of the present disclosure.
[0108] Meanwhile, unlike the one illustrated in FIG. 1, the video display device (100) does not have the tuner (110) and demodulator (120) illustrated in FIG. 1, and can receive and play video content through the network interface unit (130) or the external device interface unit (135).
[0109] The artificial intelligence-related functions according to the present disclosure can be operated through a control unit and a memory. The control unit may include one or more processors. In this case, one or more processors may be a general-purpose processor such as a CPU, an AP, a DSP (Digital Signal Processor), a graphics-only processor such as a GPU or a VPU (Vision Processing Unit), or an artificial intelligence-only processor such as an NPU. One or more processors may be controlled to process input data according to predefined operation rules or artificial intelligence models stored in the memory. Alternatively, if one or more processors are artificial intelligence-only processors, the artificial intelligence-only processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0110] Artificial intelligence (AI) is the study of artificial intelligence or the methodologies for creating it, while machine learning (ML) defines various problems in the field of AI and studies the methodologies for solving them. Machine learning is also defined as an algorithm that improves performance on a task through consistent experience.
[0111] An artificial neural network (ANN) is a model used in machine learning. It can refer to a model with problem-solving capabilities, comprised of artificial neurons (nodes) that form a network through the connection of synapses. An ANN can be defined by the connection patterns between neurons in different layers, the learning process that updates model parameters, and the activation function that generates output values.
[0112] An artificial neural network may include an input layer, an output layer, and optionally one or more hidden layers. Each layer contains one or more neurons, and the artificial neural network may include synapses connecting neurons. In an artificial neural network, each neuron can output a function value of an activation function based on input signals, weights, and biases received through the synapses.
[0113] Model parameters are parameters determined through learning, including synaptic connection weights and neuron biases. Hyperparameters are parameters that must be set before learning in machine learning algorithms, including the learning rate, number of iterations, mini-batch size, and initialization function.
[0114] The goal of artificial neural network training can be seen as determining model parameters that minimize a loss function. The loss function can be used as an indicator for determining optimal model parameters during the artificial neural network training process.
[0115] Machine learning can be classified into supervised learning, unsupervised learning, and reinforcement learning depending on the learning method.
[0116] Supervised learning refers to a method for training an artificial neural network when given labels for the training data. The labels can refer to the correct answer (or output value) that the artificial neural network must infer when the training data is input to the artificial neural network. Unsupervised learning can refer to a method for training an artificial neural network when the training data is not given labels. Reinforcement learning can refer to a learning method in which an agent defined within a given environment is trained to select actions or action sequences that maximize the cumulative reward in each state.
[0117] Machine learning implemented with a deep neural network (DNN) containing multiple hidden layers among artificial neural networks is also called deep learning, and deep learning is a subset of machine learning. Hereinafter, the term "machine learning" is used to encompass deep learning.
[0118] Object detection models using machine learning include the single-stage YOLO (You Only Look Once) model and the two-stage Faster R-CNN (Regions with Convolution Neural Networks) model.
[0119] The YOLO (You Only Look Once) model is a model that can predict objects and their locations within an image by looking at the image only once.
[0120] The YOLO (You Only Look Once) model divides the original image into grids of equal size. For each grid, it predicts the number of bounding boxes in a predefined shape centered around the grid center, and calculates a confidence level based on this prediction.
[0121] Afterwards, whether the image contains an object or is just a background is included, and locations with high object confidence are selected so that the object category can be identified.
[0122] The Faster R-CNN (Regions with Convolution Neural Networks) model is a model that can detect objects faster than the RCNN model and the Fast RCNN model.
[0123] This article specifically explains the Faster R-CNN (Regions with Convolution Neural Networks) model.
[0124] First, feature maps are extracted from the image using a Convolution Neural Network (CNN) model. Based on the extracted feature maps, multiple regions of interest (RoIs) are extracted. RoI pooling is performed for each region of interest.
[0125] RoI pooling is a process of setting a grid to a predetermined size of H x W for the feature map onto which the region of interest is projected, extracting the largest value for each cell included in each grid, and extracting a feature map with a size of H x W.
[0126] A feature vector is extracted from a feature map having a size of H x W, and object identification information can be obtained from the feature vector.
[0127] FIG. 2 is a drawing illustrating a control method of a remote control device that controls a video display device according to one embodiment of the present disclosure.
[0128] As shown in (a) of Fig. 2, a pointer (205) corresponding to a remote control device (200) is displayed on the display unit (180).
[0129] The user can move or rotate the remote control device (200) up and down, left and right ((b) of FIG. 2), and forward and backward ((c) of FIG. 2). The pointer (205) displayed on the display unit (180) of the video display device corresponds to the movement of the remote control device (200). As shown in the drawing, the pointer (205) moves and is displayed according to the movement in 3D space, so the remote control device (200) can be called a space remote control.
[0130] Figure 2 (b) illustrates that when a user moves the remote control device (200) to the left, the pointer (205) displayed on the display unit (180) of the video display device also moves to the left in response.
[0131] Information about the movement of the remote control device (200) detected by the sensor of the remote control device (200) is transmitted to the video display device. The video display device can calculate the coordinates of the pointer (205) from the information about the movement of the remote control device (200). The video display device can display the pointer (205) to correspond to the calculated coordinates.
[0132] FIG. 2 (c) illustrates a case where a user moves the remote control device (200) away from the display unit (180) while pressing a specific button within the remote control device (200). As a result, a selection area within the display unit (180) corresponding to the pointer (205) may be zoomed in and displayed in an enlarged manner. Conversely, when the user moves the remote control device (200) closer to the display unit (180), a selection area within the display unit (180) corresponding to the pointer (205) may be zoomed out and displayed in a reduced manner. Meanwhile, when the remote control device (200) moves away from the display unit (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display unit (180), the selection area may be zoomed in.
[0133] Meanwhile, when a specific button within the remote control device (200) is pressed, recognition of up, down, left, and right movements may be excluded. That is, when the remote control device (200) moves away from or toward the display unit (180), up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When a specific button within the remote control device (200) is not pressed, only the pointer (205) moves in accordance with the up, down, left, and right movements of the remote control device (200).
[0134] Meanwhile, the movement speed or movement direction of the pointer (205) can correspond to the movement speed or movement direction of the remote control device (200).
[0135] Meanwhile, the pointer in the present disclosure refers to an object displayed on the display unit (180) in response to the operation of the remote control device (200). Accordingly, objects of various shapes other than the arrow shape illustrated in the drawing can be used as the pointer (205). For example, the pointer can be a concept including a point, a cursor, a prompt, a thick outline, etc. In addition, the pointer (205) can be displayed corresponding to one point on the horizontal or vertical axis on the display unit (180), and can also be displayed corresponding to multiple points such as lines or surfaces.
[0136] FIG. 3 is a block diagram of a remote control device that controls a video display device according to one embodiment of the present disclosure.
[0137] Referring to the drawing, the remote control device (200) may include a wireless communication unit (225), a user input unit (235), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), and a control unit (280).
[0138] The wireless communication unit (225) transmits and receives signals with any one of the image display devices according to the embodiments of the present disclosure described above. Among the image display devices according to the embodiments of the present disclosure, one image display device (100) will be described as an example.
[0139] The remote control device (200) may be equipped with an RF module (221) capable of transmitting and receiving signals with the image display device (100) in accordance with RF communication standards. In addition, the remote control device (200) may be equipped with an IR module (223) capable of transmitting and receiving signals with the image display device (100) in accordance with IR communication standards.
[0140] The remote control device (200) can transmit a signal containing information about the movement of the remote control device (200) to the video display device (100) through the RF module (221).
[0141] In addition, the remote control device (200) can receive a signal transmitted by the video display device (100) through the RF module (221). In addition, the remote control device (200) can transmit commands for power on / off, channel change, volume change, etc. to the video display device (100) through the IR module (223) as needed.
[0142] The user input unit (235) may be composed of a keypad, buttons, a touch pad, or a touch screen. The user can input commands related to the video display device (100) to the remote control device (200) by operating the user input unit (235). If the user input unit (235) has a hard key button, the user can input commands related to the video display device (100) to the remote control device (200) by pushing the hard key button. If the user input unit (235) has a touch screen, the user can input commands related to the video display device (100) to the remote control device (200) by touching a soft key of the touch screen. In addition, the user input unit (235) may be equipped with various types of input means that the user can operate, such as a scroll key or a jog key.
[0143] The user input unit (235) may include a microphone for receiving audio signals such as a user's voice. Voice data collected by the user input unit (235) may be analyzed and processed into a user's control command.
[0144] The sensor unit (240) may be equipped with a gyro sensor (241) or an acceleration sensor (243).
[0145] The gyro sensor (241) can sense information about the movement of the remote control device (200).
[0146] For example, a gyro sensor (241) can sense information about the operation of a remote control device (200) based on the x, y, and z axes. An acceleration sensor (243) can sense information about the movement speed of the remote control device (200). Meanwhile, a distance measuring sensor may be further provided, thereby sensing the distance to the display unit (180).
[0147] The output unit (250) can output a video or audio signal corresponding to the operation of the user input unit (235) or to a signal transmitted from the video display device (100). Through the output unit (250), the user can recognize whether the user input unit (235) is being operated or whether the video display device (100) is being controlled.
[0148] For example, the output unit (250) may be equipped with an LED module (251) that lights up when the user input unit (235) is operated or a signal is transmitted and received with the image display device (100) through the wireless communication unit (225), a vibration module (253) that generates vibration, an audio output module (255) that outputs audio, or a display module (257) that outputs audio.
[0149] The power supply unit (260) supplies power to the remote control device (200). The power supply unit (260) can reduce power waste by stopping the power supply when the remote control device (200) is not moved for a predetermined period of time. The power supply unit (260) can resume the power supply when a predetermined key provided on the remote control device (200) is operated.
[0150] The storage unit (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200). If the remote control device (200) wirelessly transmits and receives signals through the video display device (100) and the RF module (221), the remote control device (200) and the video display device (100) can transmit and receive signals through a predetermined frequency band. The control unit (280) of the remote control device (200) can store and refer to information regarding the frequency band through which signals can be wirelessly transmitted and received between the remote control device (200) and the paired video display device (100), etc., in the storage unit (270).
[0151] The control unit (280) controls all matters related to the control of the remote control device (200). The control unit (280) can transmit a signal corresponding to a predetermined key operation of the user input unit (235) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the video display device (100) via the wireless communication unit (225).
[0152] Meanwhile, the sensor unit (240) may further include a voice sensor (245) (e.g., a microphone) for receiving a user's voice. The user's voice input through the voice sensor (245) may be transmitted to the video display device (100) through the wireless communication unit (225).
[0153] Hereinafter, with reference to FIG. 4, the operation of a video display device according to an embodiment of the present disclosure will be described. FIG. 4 is a flowchart regarding the operation of a video display device according to an embodiment of the present disclosure.
[0154] The storage unit (140) of the video display device (100) may include a personal information database (145) for storing personal information. The personal information may include personal profile information of a user (or viewer) of the video display device (100), schedule / event information, viewing history information, personal profile information of each of the user's acquaintances (e.g., friends or family), and profile images (photos or videos) of the user and each of the acquaintances.
[0155] The personal information DB (145) does not necessarily have to be implemented within the video display device (100), and may be implemented on an external server. That is, the personal information DB (145) may be implemented in at least one of the storage unit (140) and the external server. In this case, the video display device (100) can access the external server to obtain the personal information.
[0156] The information in the above personal information DB (145) may be input directly by the user or may be automatically generated by the use of the video display device (100), or may be received from another external server that stores personal information of the user and / or his / her acquaintances, such as SNS (Social Network Service) [S41].
[0157] The above profile image may be stored for each user and each acquaintance. As the profile image is updated, outdated profile images may not be deleted but may be stored as is. Previously used profile images of the user and each acquaintance may be stored by period. The profile image is an image for visually identifying the user and each acquaintance. It may be a photograph or corresponding image of the user and each acquaintance, or a 2D or 3D avatar, and there is no limitation on the type.
[0158] The control unit (170) of the video display device (100) can learn the personal information through artificial intelligence. Accordingly, the control unit (170) learns the personal information of each user and each acquaintance, and when any information is entered, it can easily infer to whom the entered information belongs. Furthermore, based on the learned personal information, the control unit (170) can also predict past or future personal information (e.g., profile images) that is not recorded in the personal information database (145).
[0159] The control unit (170) can receive a user command through the remote control device (200) [S42]. The user command may be a user's voice command input through the voice sensor (245) of the remote control device (200). The user's voice command may be a natural language command. However, the user command is not limited to the voice command. For example, the user command may be a text command input through a virtual keyboard displayed on the display (180).
[0160] The above control unit (170) can analyze the user's intention according to the user command through artificial intelligence [S43]. The control unit (170) can transmit the user's intention to an external server for artificial intelligence intention analysis and can also receive the user's intention from the external server [S41].
[0161] The analysis of the user's intent may involve extracting information related to the meaning of sentences or texts based on the user's command. To achieve this, artificial intelligence can understand and infer sentence structure, word relationships, and semantic similarities.
[0162] To analyze the user's intention based on natural language understanding, syntactic parsing, semantic parsing, named entity recognition, semantic linking, and sentiment analysis can be performed.
[0163] The above syntax analysis analyzes the structure of a sentence to identify the grammatical roles and relationships between words. This allows for tasks such as part-of-speech tagging and syntax tree generation.
[0164] The above semantic analysis aims to understand and infer the meaning of a sentence. It extracts the meaning of words and identifies relationships and connections within sentences, allowing for the identification of semantically similar words or sentences.
[0165] Named entity recognition can recognize and extract specific types of named entities (such as people, places, and dates) from sentences. This allows for the identification and analysis of important information within a sentence.
[0166] The above semantic connection is intended to analyze the semantic connection between words or objects within a sentence.
[0167] The above sentiment analysis aims to determine whether a sentence or text is positive, negative, or neutral. This allows for understanding and inferring the emotions implicit in the text.
[0168] The above control unit (170) can search for content that matches the user's intention [S44]. The above control unit (170) can also connect to an external server that provides content for searching and downloading the content.
[0169] The above control unit (170) can display a list screen of the searched content on the display (180) [S45].
[0170] The control unit (170) can play content selected by the user on the list screen and display it on the display (180). At this time, the control unit (170) can also display profile pictures of the user and / or the acquaintance. Selection of the content on the list screen can be performed through the operation of the remote control device (200).
[0171] The displayed profile picture may be downloaded from the personal information database (145). Alternatively, the displayed profile picture may be an image synthesis or generated through artificial intelligence based on profile pictures stored in the personal information database (145) [S46]. This will be further explained later.
[0172] Hereinafter, the operation of a video display device according to an embodiment of the present disclosure will be described with reference to FIGS. 5 to 7. FIGS. 5 to 7 illustrate a screen displayed on a video display device according to an embodiment of the present disclosure.
[0173] As illustrated in FIG. 5, for example, the user can input a natural language voice command, such as “Find me a popular drama when I was in my 40s,” into the video display device (100) via the voice sensor. The voice sensor may be of the video display device (100) or of the remote control device (200).
[0174] The above control unit (170) can determine the user's intention of the voice command based on the user's profile information (e.g., current age) and content viewing history.
[0175] The above control unit (170) can search for at least one content that matches the user's intention and control the display (180) to display a list (1000) of the searched content. The list (1000) can include thumbnails (C1 to C7) of each of the searched content.
[0176] Additionally, the control unit (170) can display search criteria (1100) according to the user's intention together with the content list (1000).
[0177] One content (e.g., C3 content) from the above content list (1000) can be selected by the user through the remote control device (200).
[0178] Then, as shown in FIG. 6, the control unit (170) can control the information screen (2000) of the selected content to be displayed on the display (180).
[0179] The above content information screen (2000) may include at least one piece of information about the selected content, such as the name, poster, synopsis, production company, production year, genre, cast, production crew, and rating.
[0180] In addition, the control unit (170) can display a viewing history (2100) in which the user has viewed the selected content and a selection menu (2200) for selecting whether to play the selected content. Although not shown, in addition to the viewing history (2100) and the selection menu (2200), the control unit (170) can also display schedule / event information corresponding to a time period that matches the user's intention.
[0181] The above viewing history (2100) may include information about when the user viewed the content and with whom the user viewed the content.
[0182] A front image of the video display device (100) can be captured during playback of the content by a camera provided to face the front of the video display device (100), and a person in the captured front image can be identified through the artificial intelligence. For this purpose, a profile image of an acquaintance in the personal information DB (145) can be utilized. Through this, the control unit (170) can cumulatively store, in the personal information DB (145), information on the playback time and the person who watched the content together with the user when the content is played. This can be utilized to create the viewing history (2100).
[0183] Meanwhile, the above selection menu (2200) may include a viewing alone option (2210) and a viewing together option (2220).
[0184] When the above-described viewing alone option (2210) is selected by the user through operation of the remote control device (200), the control unit (170) can play the selected content and display the played content (3000) on the display (180), as shown in (7-1) of FIG. 7.
[0185] On the other hand, when the above-mentioned viewing together option (2220) is selected by the user through the operation of the remote control device (200), the control unit (170) can display the selected content (3000) on the display (180) by playing the content, as shown in (7-2) of FIG. 7, and can also display profile images (P1 to P5) of people (i.e., acquaintances) who have watched the content together in the past.
[0186] The profile image displayed for each acquaintance may not be the current profile image, but may be a profile image of each acquaintance from a past time with whom the content was viewed. Accordingly, if the profile image of each acquaintance from a past time is stored in the personal information database (145), the control unit (170) may call up and display the profile image of each acquaintance from a past time.
[0187] However, if there is no profile image of an acquaintance at the past time, the control unit (170) can synthesize or create a new profile image of the past time (e.g., 10 years ago from the present) based on a profile image of the acquaintance at another time (e.g., the present time) stored in the personal information DB (145) through the artificial intelligence. That is, the control unit (170) can newly synthesize or create and display the profile image of the past time by reflecting the time difference (e.g., 10 years) between the other time and the past time in the profile image of the present time. That is, the control unit (170) can newly synthesize or create the profile image of the past time so that the person in the profile image of the past time is the same as the person in the profile image of the present time, but looks 10 years younger.
[0188] In the above, it has been described that when the user selects a content from the content list (1000) displayed according to the user command, the video display device (100) displays an information screen (2000) regarding the selected content and then plays the selected content. However, content may be selected and played only with the user command without displaying at least one of the content list (1000) and the content information screen (2000). This will be further described with reference to FIG. 8. FIG. 8 illustrates a screen displayed on a video display device according to an embodiment of the present disclosure.
[0189] As illustrated in FIG. 8, for example, the user can input a natural language voice command, “I want to see the youngest son of a conglomerate family with Su-ah and his mother,” into the video display device (100) via the voice sensor. Here, “the youngest son of a conglomerate family” refers to the name of a content.
[0190] The above control unit (170) can determine the user's intention of the voice command based on the user's personal information.
[0191] In addition, the control unit (170) can search for and play content that matches the user's intention and control the display (180) to display the played content (4000).
[0192] In addition, the control unit (170) can call up the profile images (P7, P8) of acquaintances (i.e., Sua, Mom) that match the user's intention from the personal information DB (145) and display them together with the reproduced content (4000). The profile images can be the profile images of each acquaintance at the current time.
[0193] If the personal information DB (145) above does not have a profile image of the present time but only a profile image of a past time (e.g., 5 years ago from the present time), the control unit (170) may newly generate or synthesize a profile image of the present time based on the profile image of the past time and display it. That is, the control unit (170) may newly synthesize or generate a profile image of the present time so that the person in the profile image of the present time is the same as the person in the profile image of the past time, but appears 5 years older.
[0194] The above profile image may also be displayed without a multimedia content playback screen. This will be further explained with reference to FIG. 9. FIG. 9 illustrates a screen displayed on a video display device according to one embodiment of the present disclosure.
[0195] As illustrated in FIG. 8, for example, the user can input a natural language voice command such as “How is Sua doing these days?” into the video display device (100) through the voice sensor.
[0196] The above control unit (170) can determine the user's intention of the voice command based on the user's personal information.
[0197] In addition, the control unit (170) can identify an acquaintance that matches the user's intention and obtain personal information of the identified acquaintance that matches the user's intention from the personal information DB (145). If personal information that matches the user's intention is not stored in the personal information DB (145), the control unit (170) can access an external server (e.g., an SNS server) that stores personal information that matches the user's intention and obtain the personal information.
[0198] In addition, the control unit (170) can display a screen (5000) regarding personal information of an acquaintance that matches the user's intention on the display (180).
[0199] The image synthesis or generation described above will be further described with reference to FIG. 10. FIG. 10 illustrates an example of image synthesis or generation according to one embodiment of the present disclosure.
[0200] As illustrated in FIG. 10, the control unit (170) can change, synthesize, or create a past image (P12) or a future image (P14) of a person based on the person's current image (P13) through the artificial intelligence. Alternatively, the control unit (170) can synthesize or create a present image (P13) or a future image (P14) of a person based on the person's past image (P12) through the artificial intelligence. This can be implemented by adjusting facial features and skin tones in a person image, smoothing or roughening the skin, and removing or creating wrinkles.
[0201] Hereinafter, with reference to FIG. 11, we will examine the user login and the user guide for the video display device. FIG. 11 illustrates a screen displayed on the video display device according to one embodiment of the present disclosure.
[0202] As shown in (11-1) of FIG. 11, when entering the setting menu of the video display device (100), the control unit (170) can display a login screen (or account setting screen) (6000) on the display (180).
[0203] The above login screen may display at least one icon (6010, 6020) of a preset account and an icon (6030) for adding an account.
[0204] The user can log in by selecting his / her account icon from among at least one account icon (6010, 6020).
[0205] Alternatively, the user may log in by creating a new account through the add account icon (6030).
[0206] Meanwhile, as illustrated in (11-2) of FIG. 11, the control unit (170) can display a user guide (6100) on the display (180) to guide the user in using the video display device (100). The user guide (6100) can be displayed when the user manipulates a menu and / or when a specific event occurs (e.g., an external device connection event). A guide agent (6110) can be displayed on the user guide (6100). The guide agent (6110) can be, for example, a virtual human.
[0207] However, the control unit (170) can change, create, or synthesize the appearance of the guide agent (6110) so that the appearance of the guide agent (6110) appears to age naturally over time. The change, creation, or synthesis of the appearance is as described in FIG. 10. Accordingly, the user can feel as if the image display device (100) is a companion device while watching the appearance changes of the guide agent (6110).
[0208] The above-described present disclosure can be implemented as computer-readable code on a program-recorded medium. The computer-readable medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc., and also include media implemented in the form of carrier waves (e.g., transmission via the Internet). In addition, the computer may include a control unit (170) of an image display device and a control unit (280) of a remote control device. Therefore, the above detailed description should not be construed as limiting in all respects, but should be considered as illustrative. The scope of the present disclosure should be determined by a reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present disclosure are intended to be included in the scope of the present disclosure.
Claims
1. Display; A communication unit for communicating with at least one external server; A user interface unit for communicating with a remote control device; and Receive user commands input through the above remote control device, Displaying a content list including at least one content that matches the user's intent as determined from the user command through artificial intelligence on the display; A video display device comprising a control unit that searches for and displays past viewing history for content selected from the content list, and controls the past viewing history to include viewing time information for the selected content and information on acquaintances who viewed the selected content together.
2. In paragraph 1, A video display device, characterized in that the personal information including the above-mentioned past viewing history is recorded in at least one of the at least one external server and at least one of the storage units within the video display device.
3. In the first paragraph, the control unit, A video display device characterized in that it controls the display of search criteria according to the user's intention when displaying the above content list.
4. In the first paragraph, the control unit, A video display device characterized in that, when playing the selected content, it controls to display the profile image of the acquaintance who watched it together.
5. In paragraph 4, A video display device characterized in that the displayed profile image is a profile image that matches the viewing time.
6. In the fifth paragraph, the control unit, A video display device characterized in that it controls to synthesize a profile image that matches the viewing time based on profile images from a different time than the viewing time through artificial intelligence.
7. In the first paragraph, the control unit, A video display device characterized in that it controls to search for at least one content that matches the user's intention by connecting to one of the at least one external server through the communication unit.
8. In paragraph 1, A video display device characterized in that the user command is a voice command input through the remote control device.
9. In paragraph 1, the control unit, A video display device characterized in that it controls to connect to one of the external servers in response to the user's intention and download and display the acquaintance's SNS (Social Network Service) information.
10. In the first paragraph, the control unit, A video display device characterized in that it displays a user guide for guiding the occurrence of a specific event, and controls the appearance of a guide agent within the user guide to change over time.
11. A step of receiving a user command input through a remote control device; A step of displaying a content list including at least one content that matches the user's intention as determined from the user command through artificial intelligence; and A method for controlling a video display device, comprising: a step of searching and displaying a past viewing history for content selected from the above content list, wherein the past viewing history includes information on the viewing time of the selected content and information on acquaintances who viewed the selected content together.
12. In paragraph 11, A method for controlling a video display device, characterized in that personal information including the above-mentioned past viewing history is recorded in at least one of the external servers communicating with the video display device and in at least one of the storage units within the video display device.
13. In paragraph 11, A method for controlling a video display device, characterized in that it includes a step of displaying search criteria according to the user's intention together when displaying the content list.
14. In paragraph 11, A method for controlling a video display device, characterized in that it comprises a step of displaying a profile image of an acquaintance who watched the selected content together when playing the selected content.
15. In paragraph 14, A control method for a video display device, characterized in that the displayed profile image is a profile image that matches the viewing time.
16. In paragraph 15, A method for controlling a video display device, comprising: a step of synthesizing a profile image matching the viewing time based on profile images from a different viewing time using artificial intelligence; 17. In paragraph 11, A method for controlling a video display device, comprising: a step of accessing at least one of the above-described external servers and searching for at least one content that matches the user's intention.
18. In paragraph 11, A method for controlling a video display device, characterized in that the user command is a voice command input through the remote control device.
19. In paragraph 11, A method for controlling a video display device, comprising: a step of connecting to one of the external servers in response to the user's intention, downloading and displaying the acquaintance's SNS (Social Network Service) information.
20. In paragraph 11, A method for controlling a video display device, comprising: a step of displaying a user guide for guiding the occurrence of a specific event; wherein the appearance of a guide agent in the user guide changes over time.
Citation Information
Patent Citations
Information processing device, method, and program
JP2020155064A
System and method for recommending contents basesed on personal network information
KR1020140125939A
Injection needle set
KR1020200117475A
Pharmaceutical compositions for treating a SARS coronavirus infection disease and medical-use thereof
KR1020210129613A
Real-time encryption / decryption security system and method for data in network based storage
KR102542213B1