Video display apparatus and operating method thereof

Abstract

The present disclosure relates to a video display apparatus and an operating method thereof. The video display apparatus according to one embodiment of the present disclosure comprises: a network interface unit allowing communication with a server that provides a stream segment using adaptive bitrate streaming; a display; a memory for storing bitrate data; and a control unit for outputting, through the display, a video corresponding to the stream segment, wherein the control unit can determine, if a streaming target is set, whether a first bitrate managed by the control unit is present, determine, if the first bitrate is present, a target bitrate on the basis of the first bitrate, determine, if the first bitrate is not present, the target bitrate on the basis of a second bitrate included in the bitrate data, and request the server to transmit the stream segment corresponding to the target bitrate.

Description

Video display device and its operating method

[0001] The present disclosure relates to a video display device and an operating method thereof.

[0002] A video display device is a device that displays images for the user to view. For example, a video display device may include a television (TV), monitor, or notebook computer equipped with a liquid crystal display (LCD) using liquid crystals or an organic light-emitting diode (OLED) display using organic light-emitting diodes (OLED).

[0003] With the recent rapid growth of the Internet, multimedia services providing content using IP (Internet Protocol) networks as their primary transmission network are becoming increasingly active. Digital broadcasting is evolving toward solutions requiring greater transmission capacity, such as stereo 3D video broadcasting, UHD (Ultra High Definition) broadcasting, multi-view 3D video broadcasting, and hologram broadcasting.

[0004] Meanwhile, due to advancements in display technology and the growing demand from media consumers, adaptive bitrate streaming is being utilized to effectively transmit content according to network bandwidth. Adaptive bitrate streaming creates segments corresponding to various bitrates for a single piece of content, stores them on a server, and transmits the segments corresponding to a selected bitrate based on the bandwidth and performance of the receiving device that receives the content. Since content is mostly transmitted using the HTTP protocol in the open Internet environment, it is referred to as HTTP adaptive streaming.

[0005] Conventionally, a receiving device receives a segment of a specific content at the lowest bitrate among various bitrates, and then selects the optimal bitrate based on network bandwidth, etc. However, according to the conventional method, when an application providing a streaming service is executed to select or change a streaming target, a low-quality image corresponding to the lowest bitrate is initially output, regardless of the network environment or the performance of the receiving device. In addition, as the bitrate for receiving a stream segment gradually increases, there is a problem that it takes time until the optimal quality image corresponding to the network environment or the performance of the receiving device is output.

[0006] The present disclosure aims to solve the above-mentioned and other problems.

[0007] Another purpose is to provide a video display device and its operating method that can provide high-quality video from the beginning when using an adaptive bitrate streaming method.

[0008] Another purpose is to provide a video display device and its operating method that can select a bitrate optimized for the network environment in which content is provided from the beginning when using an adaptive bitrate streaming method.

[0009] In order to achieve the above object, an image display device according to one embodiment of the present disclosure includes a network interface unit that communicates with a server that provides a stream segment using an adaptive bitrate streaming method; a display; a memory that stores bitrate data; and a control unit that outputs an image corresponding to the stream segment through the display, wherein the control unit, when a streaming target is set, determines whether a first bitrate managed by the control unit exists, and if the first bitrate exists, determines a target bitrate based on the first bitrate, and if the first bitrate does not exist, determines the target bitrate based on a second bitrate included in the bitrate data, and requests the server to transmit a stream segment corresponding to the target bitrate.

[0010] In order to achieve the above object, an operating method of an image display device according to an embodiment of the present disclosure may include an operating method of an image display device that receives a stream segment using an adaptive bitrate streaming method, wherein, when a streaming target is set, the operating method may include an operation of determining whether a first bitrate managed by a control unit exists; an operation of determining a target bitrate based on the first bitrate if the first bitrate exists; an operation of determining the target bitrate based on a second bitrate included in bitrate data stored in a memory if the first bitrate does not exist; an operation of requesting the server to transmit a stream segment corresponding to the target bitrate; and an operation of outputting an image corresponding to the stream segment corresponding to the target bitrate through a display.

[0011] The effects of the video display device and its operating method according to the present disclosure are described as follows.

[0012] According to at least one embodiment of the present disclosure, when using an adaptive bitrate streaming method, high-quality video can be provided from the beginning.

[0013] According to at least one embodiment of the present disclosure, when using an adaptive bitrate streaming method, a bitrate optimized for a network environment in which content is provided can be selected from the beginning.

[0014] Further scope of the applicability of the present disclosure will become apparent from the detailed description below. However, since various modifications and variations within the spirit and scope of the present disclosure will become apparent to those skilled in the art, it should be understood that the detailed description and specific examples, such as preferred embodiments of the present disclosure, are given by way of example only.

[0015] FIG. 1 is a diagram illustrating an image display system according to one embodiment of the present disclosure.

[0016] FIG. 2 is an internal block diagram of an image display device according to one embodiment of the present disclosure.

[0017] FIG. 3 is an internal block diagram of a control unit according to one embodiment of the present disclosure.

[0018] FIG. 4 is a drawing illustrating a method for controlling a remote control device according to one embodiment of the present disclosure.

[0019] FIG. 5 is a diagram illustrating a webOS architecture according to one embodiment of the present disclosure.

[0020] FIG. 6 is a diagram illustrating the architecture of a webOS device according to one embodiment of the present disclosure.

[0021] FIG. 7 is a diagram illustrating a graphic composition flow in a webOS device according to one embodiment of the present disclosure.

[0022] FIG. 8 is a diagram illustrating a media server according to one embodiment of the present disclosure.

[0023] FIG. 9a is a drawing for explaining a block diagram of a media server according to one embodiment of the present disclosure, and FIG. 9b is a drawing for explaining a relationship between a media server and a TV service according to one embodiment of the present disclosure.

[0024] FIG. 10 is an internal block diagram of an image display device according to one embodiment of the present disclosure.

[0025] FIG. 11 is a flowchart of an operation method of an image display device according to one embodiment of the present disclosure.

[0026] FIGS. 12 and 13 are diagrams illustrating graphs of bitrates for receiving stream segments according to one embodiment of the present disclosure.

[0027] FIG. 14 and FIG. 15 are drawings illustrating a screen output through a video display device according to one embodiment of the present disclosure.

[0028] Hereinafter, the present disclosure will be described in detail with reference to the drawings. In the drawings, portions irrelevant to the description are omitted to clearly and concisely describe the present disclosure, and the same reference numerals are used for identical or extremely similar portions throughout the specification.

[0029] The suffixes "module" and "part" used in the following description are given solely for the convenience of writing this specification and do not impart any particularly significant meaning or role to the components themselves. Therefore, the terms "module" and "part" may be used interchangeably.

[0030] In this application, it should be understood that terms such as “may include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0031] Additionally, while terms such as "first" and "second" may be used in this specification to describe various elements, these elements are not limited by these terms. These terms are used only to distinguish one element from another.

[0032] FIG. 1 is a diagram illustrating an image display system according to various embodiments of the present invention.

[0033] Referring to FIG. 1, the image display system (10) may include an image display device (100) and / or a remote control device (200).

[0034] The image display device (100) may be a device that processes and outputs an image. The image display device (100) is not particularly limited as long as it can output a screen corresponding to an image signal, such as a TV, a notebook computer, or a monitor.

[0035] The video display device (100) can receive a broadcast signal, process the signal, and output the processed broadcast image. When the video display device (100) receives a broadcast signal, the video display device (100) may correspond to a broadcast receiving device.

[0036] The video display device (100) can receive broadcast signals wirelessly via an antenna, or can receive broadcast signals wired via a cable. For example, the video display device (100) can receive terrestrial broadcast signals, satellite broadcast signals, cable broadcast signals, IPTV (Internet Protocol Television) broadcast signals, etc.

[0037] The remote control device (200) can be connected to the image display device (100) by wire and / or wirelessly, and can provide various control signals to the image display device (100). At this time, the remote control device (200) can include a device that establishes a wired or wireless network with the image display device (100), and transmits various control signals to the image display device (100) through the established network, or receives signals related to various operations processed in the image display device (100) from the image display device (100).

[0038] For example, various input devices such as a mouse, keyboard, space remote control, trackball, joystick, etc. can be used as the remote control device (200). The remote control device (200) can be referred to as an external device, and it is to be noted in advance that external devices and remote control devices can be used interchangeably as needed.

[0039] The video display device (100) can be connected to only a single remote control device (200) or can be connected to two or more remote control devices (200) simultaneously, and can change objects displayed on the screen or adjust the status of the screen based on control signals provided from each remote control device (200).

[0040] Meanwhile, the video display system (10) may further include at least one server (400). The video display device (100) may transmit and receive data with the server (400). For example, the video display device (100) may transmit and receive data with the server (400) via a network such as the Internet.

[0041] The video display device (100) can transmit data related to an operation performed according to a user input to the server (400), and the server (400) can store the data received from the video display device (100).

[0042] Figure 2 is an internal block diagram of the image display device of Figure 1.

[0043] Referring to FIG. 2, the video display device (100) may include a broadcast receiving unit (105), an external device interface unit (130), a network interface unit (135), a storage unit (140), a user input interface unit (150), an input unit (160), a control unit (170), a display (180), an audio output unit (185), and / or a power supply unit (190).

[0044] The broadcast receiving unit (105) may include a tuner unit (110) and a demodulator unit (120).

[0045] Meanwhile, unlike the drawing, the image display device (100) may include only the broadcast reception unit (105) and the external device interface unit (130) among the broadcast reception unit (105), the external device interface unit (130), and the network interface unit (135). That is, the image display device (100) may not include the network interface unit (135).

[0046] The tuner unit (110) can select a broadcast signal corresponding to a channel selected by the user or all previously stored channels among broadcast signals received via an antenna (not shown) or a cable (not shown). The tuner unit (110) can convert the selected broadcast signal into an intermediate frequency signal or a baseband video or audio signal.

[0047] For example, the tuner unit (110) can convert the selected broadcast signal into a digital IF signal (DIF) if it is a digital broadcast signal, and can convert it into an analog baseband video or audio signal (CVBS / SIF) if it is an analog broadcast signal. That is, the tuner unit (110) can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit (110) can be directly input to the control unit (170).

[0048] Meanwhile, the tuner unit (110) can sequentially select broadcast signals of all broadcast channels stored through the channel memory function among the received broadcast signals and convert them into intermediate frequency signals or baseband video or audio signals.

[0049] Meanwhile, the tuner unit (110) may be equipped with multiple tuners to receive broadcast signals of multiple channels. Alternatively, a single tuner that simultaneously receives broadcast signals of multiple channels is also possible.

[0050] The demodulation unit (120) can perform a demodulation operation by receiving a digital IF signal (DIF) converted by the tuner unit (110).

[0051] The demodulation unit (120) can output a stream signal (TS) after performing demodulation and channel decoding. At this time, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed.

[0052] The stream signal output from the demodulation unit (120) can be input to the control unit (170). The control unit (170) can output an image through the display (180) and output an audio through the audio output unit (185) after performing demultiplexing, image / audio signal processing, etc.

[0053] The external device interface unit (130) can transmit or receive data with a connected external device. To this end, the external device interface unit (130) may include an A / V input / output unit (not shown).

[0054] The external device interface unit (130) can be connected to external devices such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), set-top box, etc., via wired / wireless connection, and can also perform input / output operations with the external devices.

[0055] In addition, the external device interface unit (130) can establish a communication network with various remote control devices (200) as illustrated in FIG. 1, and receive a control signal related to the operation of the image display device (100) from the remote control device (200) or transmit data related to the operation of the image display device (100) to the remote control device (200).

[0056] The A / V input / output unit can receive video and audio signals from an external device. For example, the A / V input / output unit can include an Ethernet terminal, a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an MHL (Mobile High-definition Link) terminal, an RGB terminal, a D-SUB terminal, an IEEE 1394 terminal, an SPDIF terminal, a Liquid HD terminal, etc. Digital signals input through these terminals can be transmitted to the control unit (170). At this time, analog signals input through the CVBS terminal and the S-video terminal can be converted into digital signals through an analog-to-digital converter (not shown) and transmitted to the control unit (170).

[0057] The external device interface unit (130) may include a wireless communication unit (not shown) for short-range wireless communication with other electronic devices. Through this wireless communication unit, the external device interface unit (130) can exchange data with an adjacent mobile terminal. For example, in mirroring mode, the external device interface unit (130) may receive device information, running application information, application images, etc. from the mobile terminal.

[0058] The external device interface unit (130) can perform short-range wireless communication using Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra-Wideband), ZigBee, etc.

[0059] The network interface unit (135) can provide an interface for connecting the video display device (100) to a wired / wireless network including the Internet.

[0060] The network interface unit (135) may include a communication module (not shown) for connection to a wired / wireless network. For example, the network interface unit (135) may include a communication module for WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), etc.

[0061] The network interface unit (135) can transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.

[0062] The network interface unit (135) can receive web content or data provided by a content provider or network operator. That is, the network interface unit (135) can receive content such as movies, advertisements, games, VOD, broadcasts, etc., and related information provided from a content provider or network provider via a network.

[0063] The network interface unit (135) can receive firmware update information and update files provided by the network operator, and transmit data to the Internet or content provider or network operator.

[0064] The network interface unit (135) can select and receive a desired application from among applications open to the public through a network.

[0065] The storage unit (140) may store programs for signal processing and control within the control unit (170), or may store processed video, audio, or data signals. For example, the storage unit (140) may store application programs designed for the purpose of performing various tasks that can be processed by the control unit (170), and may selectively provide some of the stored application programs upon request from the control unit (170).

[0066] Programs stored in the storage unit (140) are not particularly limited as long as they can be executed by the control unit (170).

[0067] The storage unit (140) may also perform a function for temporarily storing video, audio, or data signals received from an external device through the external device interface unit (130).

[0068] The storage unit (140) can store information about a specific broadcast channel through a channel memory function such as a channel map.

[0069] Although the storage unit (140) of FIG. 2 is provided separately from the control unit (170), the scope of the present invention is not limited thereto, and the storage unit (140) may be included within the control unit (170).

[0070] The storage unit (140) may include at least one of volatile memory (e.g., DRAM, SRAM, SDRAM, etc.) or non-volatile memory (e.g., flash memory, hard disk drive (HDD), solid-state drive (SSD), etc.). In various embodiments of the present invention, the storage unit (140) and memory may be used interchangeably.

[0071] The user input interface unit (150) can transmit a signal input by the user to the control unit (170) or transmit a signal from the control unit (170) to the user.

[0072] For example, a user input signal such as power on / off, channel selection, screen setting, etc. may be transmitted / received from a remote control device (200), a user input signal input from a local key (not shown) such as a power key, a channel key, a volume key, a setting value, etc. may be transmitted to the control unit (170), a user input signal input from a sensor unit (not shown) that senses a user's gesture may be transmitted to the control unit (170), or a signal from the control unit (170) may be transmitted to the sensor unit.

[0073] The input unit (160) may be provided on one side of the main body of the video display device (100). For example, the input unit (160) may include a touch pad, a physical button, etc.

[0074] The input unit (160) can receive various user commands related to the operation of the image display device (100) and transmit a control signal corresponding to the input command to the control unit (170).

[0075] The input unit (160) may include at least one microphone (not shown) and may receive the user's voice through the microphone.

[0076] The control unit (170) may include at least one processor, and may control the overall operation of the image display device (100) using the processor included therein. Here, the processor may be a general processor such as a central processing unit (CPU). Of course, the processor may be a dedicated device such as an ASIC or another hardware-based processor.

[0077] The control unit (170) can demultiplex a stream input through the tuner unit (110), the demodulator unit (120), the external device interface unit (130), or the network interface unit (135), or process the demultiplexed signals to generate and output a signal for video or audio output.

[0078] The display (180) can generate a driving signal by converting a video signal, data signal, OSD signal, control signal, etc. processed by the control unit (170) or a video signal, data signal, control signal, etc. received from the external device interface unit (130).

[0079] The display (180) may include a display panel (not shown) having a plurality of pixels.

[0080] The plurality of pixels provided on the display panel may have RGB sub-pixels. Alternatively, the plurality of pixels provided on the display panel may have RGBW sub-pixels. The display (180) may convert image signals, data signals, OSD signals, control signals, etc. processed by the control unit (170) to generate driving signals for the plurality of pixels.

[0081] The display (180) can be a PDP (Plasma Display Panel), an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode), a flexible display, etc., and may also be a 3D display. The 3D display (180) can be divided into a glasses-free type and a glasses type.

[0082] Meanwhile, the display (180) is configured as a touch screen and can be used as an input device in addition to an output device.

[0083] The audio output unit (185) receives a signal processed by the control unit (170) and outputs it as voice.

[0084] The image signal processed by the control unit (170) can be input to the display (180) and displayed as an image corresponding to the image signal. In addition, the image signal processed by the control unit (170) can also be input to an external output device through the external device interface unit (130).

[0085] The voice signal processed in the control unit (170) can be output as sound to the audio output unit (185). In addition, the voice signal processed in the control unit (170) can be input to an external output device through the external device interface unit (130).

[0086] Although not shown in FIG. 2, the control unit (170) may include a demultiplexing unit, an image processing unit, etc. This will be described later with reference to FIG. 3.

[0087] In addition, the control unit (170) can control the overall operation within the video display device (100). For example, the control unit (170) can control the tuner unit (110) to select (tune) a broadcast corresponding to a channel selected by the user or a previously stored channel.

[0088] In addition, the control unit (170) can control the image display device (100) by a user command or internal program input through the user input interface unit (150).

[0089] Meanwhile, the control unit (170) can control the display (180) to display an image. At this time, the image displayed on the display (180) may be a still image or a moving image, and may be a 2D image or a 3D image.

[0090] Meanwhile, the control unit (170) can cause a predetermined 2D object to be displayed within an image displayed on the display (180). For example, the object can be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

[0091] Meanwhile, the image display device (100) may further include a camera (not shown). The camera can capture images of a user. The camera can be implemented with a single camera, but is not limited thereto, and may also be implemented with multiple cameras. Meanwhile, the camera can be embedded in the image display device (100) above the display (180) or can be separately positioned. Image information captured by the camera can be input to the control unit (170).

[0092] The control unit (170) can recognize the user's location based on the image captured by the camera. For example, the control unit (170) can determine the distance (z-axis coordinate) between the user and the image display device (100). In addition, the control unit (170) can determine the x-axis coordinate and y-axis coordinate within the display (180) corresponding to the user's location.

[0093] The control unit (170) can detect the user's gesture based on an image captured from the camera unit, a signal detected from the sensor unit, or a combination thereof.

[0094] The power supply unit (190) can supply power to the entire image display device (100). In particular, it can supply power to a control unit (170) that can be implemented in the form of a system on chip (SOC), a display (180) for image display, and an audio output unit (185) for audio output.

[0095] Specifically, the power supply unit (190) may be equipped with a converter (not shown) that converts AC power into DC power and a Dc / Dc converter (not shown) that converts the level of DC power.

[0096] The remote control device (200) can transmit user input to the user input interface unit (150). To this end, the remote control device (200) can use Bluetooth, RF (Radio Frequency) communication, infrared (Infrared Radiation) communication, UWB (Ultra-wideband), ZigBee, etc. In addition, the remote control device (200) can receive images, voices, or data signals output from the user input interface unit (150) and display or output the same as voice on the remote control device (200).

[0097] Meanwhile, the above-described video display device (100) may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasts.

[0098] Meanwhile, the block diagram of the image display device (100) illustrated in FIG. 2 is only a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted depending on the specifications of the image display device (100) actually implemented.

[0099] That is, two or more components may be combined into a single component, or a single component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments of the present invention, and their specific operations or devices do not limit the scope of the present invention.

[0100] Figure 3 is an internal block diagram of the control unit of Figure 2.

[0101] Referring to FIG. 3, a control unit (170) according to one embodiment of the present invention may include a demultiplexer (310), an image processing unit (320), a processor (330), an OSD generation unit (340), a mixer (345), a frame rate conversion unit (350), and / or a formatter (360). In addition, an audio processing unit (not shown) and a data processing unit (not shown) may be further included.

[0102] The demultiplexer (310) can demultiplex an input stream. For example, when MPEG-2 TS is input, it can be demultiplexed to separate it into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer (310) may be a stream signal output from the tuner (110), the demodulator (120), or the external device interface (130).

[0103] The image processing unit (320) can perform image processing of a demultiplexed image signal. To this end, the image processing unit (320) may be equipped with an image decoder (325) and a scaler (335).

[0104] The video decoder (325) can decode a demultiplexed video signal, and the scaler (335) can perform scaling so that the resolution of the decoded video signal can be output on the display (180).

[0105] The video decoder (325) may include decoders of various standards. For example, it may include an MPEG-2, H.264 decoder, a 3D video decoder for color images and depth images, a decoder for multi-view images, etc.

[0106] The processor (330) can control the overall operation within the video display device (100) or the control unit (170). For example, the processor (330) can control the tuner (110) to select (tune) a broadcast corresponding to a channel selected by the user or a pre-stored channel.

[0107] In addition, the processor (330) can control the image display device (100) by a user command or internal program input through the user input interface unit (150).

[0108] Additionally, the processor (330) can perform data transmission control with the network interface unit (135) or the external device interface unit (130).

[0109] Additionally, the processor (330) can control the operation of the demultiplexing unit (310), the image processing unit (320), the OSD generation unit (340), etc. within the control unit (170).

[0110] The OSD generation unit (340) can generate OSD signals based on user input or on its own. For example, based on a user input signal input through the input unit (160), it can generate signals for displaying various information in the form of graphics or text on the screen of the display (180).

[0111] The generated OSD signal may include various data such as the user interface screen of the video display device (100), various menu screens, widgets, icons, etc. In addition, the generated OSD signal may include a 2D object or a 3D object.

[0112] Additionally, the OSD generation unit (340) can generate a pointer that can be displayed on the display (180) based on a pointing signal input from the remote control device (200).

[0113] The OSD generation unit (340) may include a pointing signal processing unit (not shown) that generates a pointer. It is also possible for the pointing signal processing unit (not shown) to be provided separately rather than within the OSD generation unit (240).

[0114] The mixer (345) can mix the OSD signal generated by the OSD generation unit (340) and the decoded image signal processed by the image processing unit (320). The mixed image signal can be provided to the frame rate conversion unit (350).

[0115] The frame rate converter (FRC) (350) can convert the frame rate of an input video. Meanwhile, the frame rate converter (350) can also output the video as is without a separate frame rate conversion.

[0116] The formatter (360) can arrange left-eye image frames and right-eye image frames of a frame rate-converted 3D image. In addition, it can output a synchronization signal (Vsync) for opening the left-eye glasses and right-eye glasses of a 3D viewing device (not shown).

[0117] Meanwhile, the formatter (360) can change the format of the input video signal into a video signal for display on the display (180) and output it.

[0118] Additionally, the formatter (360) can change the format of a 3D video signal. For example, it can change the format to any one of various 3D formats, such as a side-by-side format, a top-down format, a frame sequential format, an interlaced format, and a checker box format.

[0119] Meanwhile, the formatter (360) can also convert a 2D image signal into a 3D image signal. For example, according to a 3D image generation algorithm, an edge or a selectable object can be detected within a 2D image signal, and an object or a selectable object according to the detected edge can be separated and generated as a 3D image signal. At this time, the generated 3D image signal can be separated and aligned into a left-eye image signal (L) and a right-eye image signal (R), as described above.

[0120] Meanwhile, although not shown in the drawing, a 3D processor (not shown) for 3D effect signal processing may be further placed after the formatter (360). This 3D processor may process brightness, tint, and color adjustments of the image signal to improve the 3D effect. For example, it may perform signal processing to make the image clear at a close distance and blurry at a long distance. Meanwhile, the function of this 3D processor may be incorporated into the formatter (360) or incorporated into the image processing unit (320).

[0121] Meanwhile, the audio processing unit (not shown) within the control unit (170) can perform audio processing of the demultiplexed audio signal. For this purpose, the audio processing unit (not shown) can be equipped with various decoders.

[0122] Additionally, the audio processing unit (not shown) within the control unit (170) can process bass, treble, volume control, etc.

[0123] A data processing unit (not shown) within the control unit (170) can perform data processing of a demultiplexed data signal. For example, if the demultiplexed data signal is an encoded data signal, it can be decoded. The encoded data signal may be electronic program guide information (EPG) information that includes broadcast information such as the start time and end time of a broadcast program broadcast on each channel.

[0124] Meanwhile, the block diagram of the control unit (170) illustrated in FIG. 3 is only a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted depending on the specifications of the control unit (170) actually implemented.

[0125] In particular, the frame rate conversion unit (350) and the formatter (360) are not provided within the control unit (170), but may be provided separately, or may be provided separately as one module.

[0126] Fig. 4 is a drawing illustrating a control method of the remote control device of Fig. 2, and Fig. 4b is an example of an internal block diagram of the remote control device of Fig. 2.

[0127] Referring to FIG. 4, it can be confirmed that a pointer (205) corresponding to a remote control device (200) is displayed on the display (180) of the video display device (100).

[0128] Referring to (a) of FIG. 4, the user can move or rotate the remote control device (200) up and down, left and right, forward and backward. At this time, the pointer (205) displayed on the display (180) of the image display device (100) can be displayed in response to the movement of the remote control device (200). As shown in the drawing, the pointer (205) of this remote control device (200) is moved and displayed according to the movement in 3D space, so it can be called a space remote control or a 3D pointing device.

[0129] Referring to (b) of FIG. 4, when the user moves the remote control device (200) to the left, it can be confirmed that the pointer (205) displayed on the display (180) of the image display device (100) also moves to the left in response to the movement of the remote control device (200).

[0130] Information about the movement of the remote control device (200) detected through the sensor of the remote control device (200) can be transmitted to the image display device (100). The image display device (100) can calculate the coordinates of the pointer (205) from the information about the movement of the remote control device (200). The image display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0131] Referring to (c) of FIG. 4, a user can move the remote control device (200) away from the display (180) while pressing a specific button provided on the remote control device (200). As a result, a selection area within the display (180) corresponding to the pointer (205) can be zoomed in and displayed in an enlarged manner. Conversely, when a user moves the remote control device (200) closer to the display (180) while pressing a specific button provided on the remote control device (200), a selection area within the display (180) corresponding to the pointer (205) can be zoomed out and displayed in a reduced manner.

[0132] Meanwhile, when the remote control device (200) moves away from the display (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selection area may be zoomed in.

[0133] Meanwhile, when the user presses a specific button within the remote control device (200), recognition of up, down, left, and right movements may be excluded. That is, when the remote control device (200) moves away from or toward the display (180), up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When the user does not press a specific button within the remote control device (200), only up, down, left, and right movements of the remote control device (200) may be recognized, and accordingly, only the pointer (205) may be moved.

[0134] Meanwhile, the movement speed or movement direction of the pointer (205) can correspond to the movement speed or movement direction of the remote control device (200).

[0135] Meanwhile, the image display device (100) can utilize a standardized general-purpose OS (Operating System), but in particular, the image display device (100) described in this specification utilizes a web OS as an example. Accordingly, the image display device (100) can process adding, deleting, amending, updating, etc., various services or applications on a general-purpose OS kernel or Linux kernel, thereby providing a more user-friendly environment.

[0136] In addition, even if it is described only as an application below, the meaning may include not only the application but also the service based on the context, etc.

[0137] FIG. 5 is a diagram illustrating a webOS architecture according to an embodiment of the present disclosure.

[0138] Referring to Figure 5, the architecture of the webOS platform is described as follows.

[0139] The platform can be broadly divided into the kernel, the Web OS core platform based on system libraries, applications, and services.

[0140] The architecture of the webOS platform is a layered structure, with the OS at the lowest layer, system library(s) at the next layer, and applications at the top.

[0141] First, the lowest layer includes the Linux Kernel as the OS layer, and thus can include Linux as the OS of the video display device (100).

[0142] Above the OS layer, there can be sequentially the BSP (Board Support Package) / HAL (Hardware Abstraction Layer) layer, the Web OS core modules layer, the service layer, the Luna-Service Bus layer, the Enyo framework / NDK (Native Developer Kit) / QT layer, and the application layer at the top layer.

[0143] Meanwhile, some layers in the above-described webOS layer structure can be omitted, multiple layers can be combined into one layer, or conversely, one layer can be combined into a multiple layer structure.

[0144] The webOS core module layer may include LSM (Luna Surface Manager), which manages surface windows, SAM (System & Application Manager), which manages application execution and execution status, and WAM (Web Application Manager), which manages web applications based on WebKit.

[0145] LSM can manage application windows visible on the screen. LSM manages display hardware, provides buffers for applications to render the content they need, and can compose and display the rendered results of multiple applications on the screen.

[0146] SAM can manage various condition-based execution policies for systems and applications.

[0147] Meanwhile, WAM can be based on the Enyo Framework, as webOS can view web applications as basic applications.

[0148] Applications use services through the Luna-service Bus. New services can be registered on the bus, and applications can find and use the services they need.

[0149] The service layer can include services at various service levels, such as TV services and webOS services. Meanwhile, webOS services can include media servers, Node.JS, and more specifically, Node.JS services can support JavaScript, for example.

[0150] WebOS services are Linux processes that implement functional logic and can communicate via a bus. These can be broadly divided into four parts: the TV process, services migrated from existing TVs to WebOS or differentiated by manufacturers, common WebOS services, and Node.js services developed in JavaScript and used via Node.js.

[0151] The application layer may include all applications that can be supported by the video display device (100), such as TV applications, showcase applications, native applications, and web applications.

[0152] Applications on webOS can be categorized into web applications, PDK (Palm Development Kit) applications, and QML (Qt Meta Language or Qt Modeling Language) applications depending on their implementation method.

[0153] Web applications can be based on the WebKit engine and run on the WAM runtime. These web applications can be based on the Enyo framework or developed and run using standard HTML5, CSS (Cascading Style Sheets), and JavaScript.

[0154] PDK applications may include native applications developed in C / C++ based on a PDK provided for third-party or external developers. PDK may refer to a set of development libraries and tools provided to enable third-party developers, such as games, to develop native applications (C / C++). For example, PDK applications can be used to develop performance-critical applications.

[0155] QML applications are native applications based on Qt and can include basic applications provided with the webOS platform, such as card views, the home dashboard, and the virtual keyboard. Here, QML can be a script-style markup language instead of C++.

[0156] Meanwhile, as mentioned above, a native application refers to an application that is developed and compiled in C / C++ and executed in binary form, and such a native application has the advantage of being fast in execution speed.

[0157] FIG. 6 is a diagram illustrating the architecture of a webOS device according to an embodiment of the present disclosure.

[0158] Figure 6 is a block diagram based on the runtime of a webOS device, which can be understood by referring to the layered structure of Figure 5. The following description will be given with reference to Figures 5 and 6.

[0159] Referring to Figure 6, services, applications, and webOS core modules are included on the system OS (Linux) and system libraries, and communication between them can be done through the Luna-Service Bus.

[0160] Node.js services based on HTML5, CSS, and Javascript, such as e-mail, contact, and calendar; webOS services such as logging, backup, file notify, database, activity manager, system policy, AudioD (Audio Daemon), update, and media server; TV services such as EPG (Electronic Program Guide), PVR (Personal Video Recorder), and data broadcasting; CP services such as voice recognition, Now on, Notification, search, ACR (Auto Content Recognition), CBOX (Contents List Browser), wfdd, DMR, Remote Application, download, and SDPIF (Sony Philips Digital Interface Format); native services such as PDK applications, browsers, and QML applications. Applications, and UI-related TV applications and web applications based on the Enyo framework, can be processed through the aforementioned webOS core modules, such as SAM, WAM, and LSM, via the Luna service bus. Meanwhile, the TV applications and web applications described above may not necessarily be based on the Enyo framework or UI-related.

[0161] CBOX can manage lists and metadata for content from external devices connected to a TV, such as USB, DLNA, and cloud storage. Meanwhile, CBOX can display content listings from various content containers, such as USB, DMS, DVR, and cloud storage, in a unified view. CBOX can also display content listings of various types, such as pictures, music, and videos, and manage their metadata. Furthermore, CBOX can display content from attached storage devices in real time. For example, when a storage device, such as a USB, is plugged in, CBOX can immediately display a list of the contents of the storage device. A standardized method for processing content listings can also be defined. CBOX can also accommodate various connection protocols.

[0162] SAM may be intended to improve module complexity and enhance scalability. For example, the existing System Manager handles multiple functions, such as system UI, window management, web application runtime, and UX constraint handling, within a single process, resulting in high implementation complexity. To alleviate this complexity, SAM separates key functions and clarifies interfaces between them, thereby reducing implementation complexity.

[0163] LSM supports the independent development and integration of system UX implementations, such as card views and launchers, and can easily respond to changes in product requirements. Meanwhile, LSM can provide a window management mechanism for multi-window and 21:9, enabling multitasking by maximizing hardware resources when compositing multiple application screens, such as App-on-App.

[0164] LSM supports the implementation of system UIs based on QML, improving development productivity. QML UX, based on MVC, allows for easy configuration of screen layouts and UI components, as well as the development of code to process user input. Meanwhile, the interface between QML and webOS components is achieved through QML extension plug-ins, and the application's graphical operations can be based on the Wayland protocol, Luna service calls, and other protocols.

[0165] As mentioned above, LSM is an abbreviation for Luna Surface Manager and can function as an Application Window Compositor.

[0166] LSM composites and outputs independently developed applications, UI components, etc. onto the screen. In this regard, when components such as the Recents application, the Showcase application, and the Launcher application each render their own content, LSM, as a compositor, can define the output area, linking method, etc. In other words, LSM, as a compositor, can handle graphic composition, focus management, input events, etc. At this time, LSM receives events, focus, etc. from the input manager, and this input manager can include remote controllers, HIDs such as mouse & keyboard, joysticks, game pads, application remotes, pen touch, etc.

[0167] In this way, LSM supports multiple window models, which can be performed simultaneously in all applications due to the nature of the system UI. In this regard, LSM can support launchers, licenses, settings, notifications, system keyboards, volume UI, search, finger gestures, voice recognition (STT (Sound to Text), TTS (Text to Sound), NLP (Natural Language Processing), etc.), pattern gestures (camera, MRCU (Mobile Radio Control Unit)), live menus, ACR (Auto Content Recognition), etc.

[0168] FIG. 7 is a diagram illustrating a graphic composition flow in a webOS device according to an embodiment of the present disclosure.

[0169] Referring to FIG. 7, graphic composition processing can be performed through a web application manager (910) in charge of the UI process, a webkit (920) in charge of the web process, an LSM (930), and a graphic manager (GM: Graphic Manager) (940).

[0170] When graphic data (or application) based on a web application is created as a UI process in the web application manager (910), the created graphic data can be transmitted to the LSM (930) if it is not a full-screen application. Meanwhile, the web application manager (910) can receive an application created in the web kit (920) to share the GPU (Graphic Processing Unit) memory for graphic management between the UI process and the web process, and transmit it to the LSM (930) if it is not a full-screen application as described above. In the case of the full-screen application described above, the LSM (930) can be bypassed, in which case it can be directly transmitted to the graphic manager (940).

[0171] The LSM (930) can transmit the received UI application to the Wayland Compositor via the Wayland Surface, and the Wayland Compositor can process it appropriately and transmit it to the Graphics Manager. The graphics data transmitted from the LSM (930) can be transmitted to the Graphics Manager Compositor via, for example, the LSM GM Surface of the Graphics Manager (940).

[0172] Meanwhile, full-screen applications, as described above, are passed directly to the graphics manager (940) without going through the LSM (930), and such applications can be processed in the graphics manager compositor through the WAM GM surface.

[0173] The graphics manager processes all graphic data within the webOS device, and can receive all graphic data that has passed through the aforementioned LSM GM surface, the WAM GM surface, as well as graphic data that has passed through the GM surface, such as data broadcasting applications and caption applications, and process them to be properly displayed on the screen. Here, the function of the GM compositor may be the same as or similar to the function of the aforementioned compositor.

[0174] FIG. 8 is a diagram illustrating a media server according to an embodiment of the present disclosure. FIG. 9a is a diagram illustrating a block diagram of a media server according to an embodiment of the present disclosure, and FIG. 9b is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present disclosure.

[0175] A media server can support the execution of various multimedia within a video display device (100) and manage the necessary resources. The media server can efficiently utilize the hardware resources required for media play. For example, the media server requires audio / video hardware resources for multimedia execution, and can manage resource usage to utilize them efficiently. Generally, fixed devices with larger screens than mobile devices require more hardware resources for multimedia execution, and due to the large amount of data, encoding / decoding and graphic data transfer speeds must also be fast. Meanwhile, the media server must be able to handle tasks such as broadcasting, recording, and tuning, recording while watching, or simultaneously displaying the sender and receiver screens during a video call, in addition to streaming and file-based playback. However, since the hardware resources of the media server, such as the encoder, decoder, tuner, and display engine, are limited by chipset, it is difficult to execute multiple tasks simultaneously. For example, the media server may restrict usage scenarios or process user selections.

[0176] Media servers can enhance system robustness by, for example, removing and restarting individual pipelines that encounter errors during media playback. This ensures that even when such errors occur, they do not affect other media playback. These pipelines are chains that connect individual functions, such as decoding, analysis, and output, when a media playback request is made. The required individual functions may vary depending on the media type, for example.

[0177] A media server can be extensible, allowing for the addition of new types of pipelines without affecting the existing implementation. For example, a media server can accommodate camera pipelines, video conferencing (Skype) pipelines, and third-party pipelines.

[0178] A media server can handle general media playback and TV task execution as separate services, as the interface for the TV service differs from that for media playback. As mentioned above, the media server supports operations such as setchannel, channelup, channeldown, channeltuning, and recordstart for the TV service, and operations such as play, pause, and stop for general media playback. Thus, the two can be supported as separate services, supporting distinct operations.

[0179] The media server can control or integrate resource management functions. The media server comprehensively manages hardware resource allocation and retrieval within the device. In particular, the TV service process can transmit information such as the current task and resource allocation status to the media server. The media server secures resources and executes pipelines whenever each media is executed. Based on the resource status occupied by each pipeline, the media server can allow execution based on priority (e.g., policy) and reclaim resources from other pipelines when a media execution request is made. Here, predefined execution priorities and required resource information for specific requests are managed by a policy manager, and the resource manager can communicate with the policy manager to handle resource allocation and retrieval, etc.

[0180] A media server can maintain an identifier (ID) for all playback-related operations. For example, the media server can issue commands to specific pipelines based on the identifier. For playback of multiple media, the media server can issue commands to two distinct pipelines.

[0181] The media server can handle playback of HTML 5 standard media.

[0182] Additionally, the media server may be a separate service process for the TV pipeline, depending on the scope of the TV restructuring. The media server can be designed and implemented regardless of the scope of the TV restructuring. However, if the TV is not a separate service process, problems with a specific task may require the entire TV to be re-implemented.

[0183] The media server can be called a uMS, or micro media server. Here, the media player is a media client, which can mean, for example, Webkit for the HTML5 video tag, Camera, TV, Skype, and Second Screen.

[0184] A media server can manage micro-resources, such as a resource manager and a policy manager. Furthermore, the media server can also control playback of web standard media content. In this regard, the media server can also manage a pipeline controller resource.

[0185] Such media servers can support, for example, extensibility, reliability, and efficient resource usage.

[0186] In other words, the uMS, or media server, can perform the function of managing and controlling the overall use of resources for appropriate processing within webOS devices, such as resources such as cloud gaming, MVPD (pay service, etc.), camera preview, second screen, Skype, etc., and TV resources, so as to enable efficient use. Meanwhile, each resource uses a pipeline when it is used, for example, and the media server can manage and control the overall creation, deletion, use, etc. of pipelines for resource management.

[0187] Here, a pipeline can be created, for example, when media related to a task initiates a series of operations, such as parsing a request, decoding a stream, or video output. For example, in relation to a TV service or application, watching, recording, channel tuning, etc. can each be individually processed through a pipeline created according to the request, with resource usage, etc., controlled.

[0188] Referring to Figure 8, the processing structure of the media server is described in more detail as follows.

[0189] In FIG. 8, an application or service is connected to a media server (1020) through a Luna-Service Bus (1010), and the media server (1020) can be connected to and manage pipelines re-created through the Luna-Service Bus (1010).

[0190] An application or service may have various clients depending on its characteristics and may exchange data with a media server (1020) or pipeline through them.

[0191] Clients may include, for example, a uMedia client (WebKit) for connecting to a media server (1020) and a RM (resource manager) client (C / C++).

[0192] An application including a uMedia client can be connected to a media server (1020), as described above. More specifically, a uMedia client corresponds to, for example, a video object, which will be described later, and such a client can utilize the media server (1020) to operate a video upon request, etc.

[0193] Here, video actions refer to video states, and may include all state data related to video actions, such as loading, unloading, play, playback, or reproduction, pause, and stop. Each of these video actions or states can be processed through the creation of a separate pipeline. Accordingly, the uMedia client can transmit state data related to video actions to the pipeline manager (1022) within the media server.

[0194] The pipeline manager (1022) can obtain information about the resources of the current device through data communication with the resource manager (1024) and request allocation of resources corresponding to the status data of the uMedia client. At this time, the pipeline manager (1022) or the resource manager (1024) can control resource allocation through data communication with the policy manager (1026) when necessary in relation to resource allocation, etc. For example, if the resource manager (1024) does not have or is insufficient resources to allocate at the request of the pipeline manager (1022), the policy manager (1026) can ensure that appropriate resource allocation, etc. is performed at the request based on priority comparison, etc.

[0195] Meanwhile, the pipeline manager (1022) can request the media pipeline controller (1028) to create a pipeline for operation according to a request from a uMedia client for resources allocated according to the resource allocation of the resource manager (1024).

[0196] The media pipeline controller (1028) can create the necessary pipelines under the control of the pipeline manager (1022). As illustrated, the generated pipelines may include not only a media pipeline and a camera pipeline, but also pipelines related to playback, pause, and pause. Meanwhile, the pipelines may include pipelines for HTML5, Web CP, SmartShare playback, thumbnail extraction, NDK, Cinema, and MHEG (Multimedia and Hypermedia Information coding Experts Group).

[0197] Additionally, pipelines can include, for example, service-based pipelines (self-pipelines) and URI-based pipelines (media pipelines).

[0198] Referring to FIG. 8, an application or service including an RM client may not be directly connected to a media server (1020). This is because the application or service may process media directly. In other words, if the application or service directly processes media, it may not go through a media server. However, in this case, resource management is required for pipeline creation and its use, and the uMS connector may function for this purpose. Meanwhile, when a resource management request for direct media processing of an application or service is received, the uMS connector may communicate with the media server (1020), including the resource manager (1024). For this purpose, the media server (1020) may also be equipped with a uMS connector.

[0199] Accordingly, applications or services can respond to requests from RM clients by receiving resource management from the resource manager (1024) via the uMS connector. These RM clients can handle services such as native CP, TV services, second screens, Flash Player, YouTube Media Source Extensions (MSE), cloud gaming, and Skype. In this case, as described above, the resource manager (1024) can manage resources through appropriate data communication with the policy manager (1026) when necessary for resource management.

[0200] Meanwhile, the URI-based pipeline is not processed directly by the media, as in the aforementioned RM client, but is performed through a media server (1020). Such a URI-based pipeline may include a player factory, Gstreamer, a streaming plug-in, a DRM (Digital Rights Management) plug-in pipeline, etc.

[0201] Meanwhile, the interface method between applications and media services can be as follows.

[0202] This is a method for interfacing with services in web applications. This can be done through a Luna call using the Palm Service Bridge (PSB) or by using Cordova, which can extend the display with a video tag. Alternatively, you can use the HTML5 standard for video tags or media elements.

[0203] And, this is how to interface using services in PDK.

[0204] Alternatively, you can utilize services from existing CPs. This can be achieved by extending existing platform plug-ins to a Luna-based platform for backward compatibility.

[0205] Finally, here's how to interface with non-webOS systems. In this case, you can interface by directly calling the Luna bus.

[0206] Seamless change is handled by a separate module (e.g., TVWIN), which may be a process to display the TV on the screen first and handle it seamlessly without webOS before or during webOS boot. This may be used to provide basic TV service functions first to quickly respond to the user's power-on request due to the slow boot time of webOS. In addition, the module may support seamless change, factory mode, etc., which provide fast boot and basic TV functions as part of the TV service process. The module may also be responsible for switching from non-webOS mode to webOS mode.

[0207] Referring to Figure 9a, the processing structure of the media server is illustrated.

[0208] In this case, in Figure 9a, the solid box represents the process processing configuration, and the dotted box represents an internal processing module during the process. Additionally, the solid arrow represents an inter-process call, i.e., a Luna service call, and the dotted arrow represents a notification or data flow, such as a register / notify.

[0209] A service or web application or PDK application (hereinafter referred to as an application) is connected to various service processing components through the Luna-Service Bus, and the application can be operated or controlled through it.

[0210] Depending on the type of application, the data processing path may vary. For example, if the application is image data related to a camera sensor, it may be transmitted to the camera processing unit (1130) and processed. At this time, the camera processing unit (1130) may process the image data of the application received by including a gesture, face detection module, etc. Here, if the data requires the use of a pipeline, etc., for example, by a user's selection or automatic use, the camera processing unit (1130) may create a pipeline through the media server processing unit (1110) and process the data.

[0211] Alternatively, if the application includes audio data, the audio can be processed through the audio processing unit (AudioD) (1140) and the audio module (PulseAudio) (1150). For example, the audio processing unit (1140) can process audio data received from the application and transmit it to the audio module (1150). At this time, the audio processing unit (1140) can determine the processing of the audio data by including an audio policy manager. The audio data processed in this way can be processed in the audio module (1160). Meanwhile, the application can notify data related to audio data processing to the audio module (1160), and this can also be notified to the audio module (1160) in the related pipeline. The audio module (1150) can include ALSA (Advanced Linux Sound Architecture).

[0212] Alternatively, if the application includes or processes (hereinafter included) content subject to DRM, the content data may be transmitted to the DRM service processing unit (1160), and the DRM service processing unit (1170) may create a DRM instance to process the content data subject to DRM. Meanwhile, the DRM service processing unit (1160) may be connected to the DRM pipeline within the media pipeline via the Luna service bus to process the content data subject to DRM.

[0213] Below, we describe processing when the application is media data or TV service data (e.g., broadcast data).

[0214] Figure 9b is a drawing to explain in more detail only the media server processing unit and the TV service processing unit in the aforementioned Figure 9a.

[0215] First, if the application includes TV service data, it is processed by the TV service processing unit (1120 / 1220).

[0216] Here, the TV service processing unit (1120) may include at least one of, for example, a DVR / channel manager, a broadcast module, a TV pipeline manager, a TV resource manager, a data broadcast module, an audio setting module, a path manager, etc. Alternatively, in FIG. 9b, the TV service processing unit (1220) may include a TV broadcast handler, a TV broadcast interface, a service processing unit, a TV middleware (TV MW), a path manager, and a BSP (e.g., NetCast). Here, the service processing unit may refer to a module including, for example, a TV pipeline manager, a TV resource manager, a TV policy manager, and a USM connector.

[0217] In the present disclosure, the TV service processing unit may be implemented with a configuration as in FIG. 9a or 9b or a combination of both, and some of the configurations above may be omitted or some configurations not shown may be added.

[0218] The TV service processing unit (1120 / 1220) can generate and process a TV pipeline by transmitting the TV service data received from the application, based on the properties or types thereof, to a DVR (Digital Video Recorder) or channel-related data, to a DVR / channel manager, and then to a TV pipeline manager. Meanwhile, if the properties or types of the TV service data are broadcast content data, the TV service processing unit (1120) can generate and process a TV pipeline by passing the data through a broadcast module to a TV pipeline manager for processing.

[0219] Alternatively, a JSON (Javascript standard object notation) file or a file written in C can be processed by the TV broadcast handler, passed through the TV broadcast interface, and then sent to the TV pipeline manager to create a TV pipeline for processing. In this case, the TV broadcast interface can send data or files passed through the TV broadcast handler to the TV pipeline manager based on the TV service policy, and use it as a reference when creating a pipeline.

[0220] Meanwhile, the TV pipeline manager may be controlled by the TV resource manager in creating one or more pipelines in response to a TV pipeline creation request from a processing module or manager within the TV service. Meanwhile, the TV resource manager may be controlled by the TV policy manager in order to request the status and allocation of resources allocated for the TV service in response to the TV pipeline creation request of the TV pipeline manager, and may communicate data with the media server processing unit (1110 / 1210) through the uMS connector. The resource manager within the media server processing unit (1110 / 1210) may transmit the status and allocation availability of resources for the current TV service in response to the request of the TV resource manager. For example, if the resource manager within the media server processing unit (1110 / 1210) confirms that all resources for the TV service have already been allocated, the resource manager may notify the TV resource manager that all resources have been allocated. At this time, the resource manager within the media server processing unit may, together with the above notification, remove a designated TV pipeline from among the TV pipelines allocated for the TV service according to priority or a predetermined standard, and request or allocate the creation of a TV pipeline for the requested TV service. Alternatively, the TV resource manager may appropriately control the removal, addition, or creation of a TV pipeline based on a status report from the resource manager within the media server processing unit (1110 / 1210).

[0221] Meanwhile, BSP can support backward compatibility with existing digital devices, for example.

[0222] The TV pipelines generated in this manner can be appropriately operated during the processing process under the control of the path manager. The path manager can determine and control the processing path or process of the pipelines by considering not only the TV pipelines but also the operation of the pipelines generated by the media server processing unit (1110 / 1210) during the processing process.

[0223] Next, if the application includes media data rather than TV service data, it can be processed in the media server processing unit (1110 / 1210). Here, the media server processing unit (1110 / 1210) may include a resource manager, a policy manager, a media pipeline manager, a media pipeline controller, etc. Meanwhile, various pipelines may be created under the control of the media pipeline manager and the media pipeline controller, such as a camera preview pipeline, a cloud game pipeline, and a media pipeline. Meanwhile, the media pipeline may include a streaming protocol, an auto / static gstreamer, a DRM, etc., and the processing flow of these may be determined under the control of the path manager. The specific processing process within the media server processing unit (1110 / 1210) is based on the description of FIG. 7 described above, and will not be described again herein.

[0224] In the present disclosure, the resource manager in the media server processing unit (1110 / 1210) can manage resources, for example, using a counter base.

[0225] Fig. 10 is an internal block diagram of a video display device according to one embodiment of the present disclosure. Detailed descriptions of content overlapping with those described in Figs. 1 to 9b will be omitted.

[0226] Referring to FIG. 10, the video display device (100) can receive content from the server (400) using an adaptive bitrate streaming method.

[0227] Adaptive bitrate streaming refers to a method of transmitting partial content with a quality level that the bandwidth of the client side (e.g., the receiving side) can handle based on network conditions or transmission speed, etc.

[0228] The server (400) can encode content to be streamed into stream segments of various bit rates. For example, when servicing 1-minute content via adaptive bit rate streaming, the server (400) can divide the entire stream into stream segments of 2 to 10 seconds each, and store each segmented stream segment by encoding it at three different bit rates. Each bit rate can correspond to the resolution of the content. In other words, a stream segment encoded at a high bit rate can mean that the resolution of the video data within the stream segment is high.

[0229] Types of these adaptive bitrate streaming protocols include MPEG-DASH (Dynamic Adaptive Streaming over HTTP), Adobe Dynamic Streaming for Flash (HDS), QuavStreams Adaptive Streaming over HTTP, Apple HTTP Adaptive Streaming for iPhone / iPad / STB (HLS), Microsoft Smooth Streaming, and upLynk.

[0230] The control unit (170) of the video display device (100) may include a streaming application (171) and / or a media player (172).

[0231] The streaming application (171) may be an application that provides a streaming service. The streaming service corresponding to the streaming application (171) may be a service that utilizes an adaptive bitrate streaming method.

[0232] The media player (172) may be a pipeline managed by a media server (1020). The media player (172) may be a media pipeline.

[0233] When a streaming application (171) is executed, the video display device (100) can output a screen corresponding to the streaming service through the display (180). The screen corresponding to the streaming service may include content provided through the streaming service. In this case, when one of the contents provided through the streaming service is selected by user input, the video display device (100) can perform an operation related to streaming for the selected specific content.

[0234] A streaming application (171) can generate a media player (172) for streaming specific content. For example, the streaming application (171) can request the media server (1020) to generate a media player (172) corresponding to specific content. At this time, the media server (1020) can generate a media player (172) corresponding to specific content according to the request received from the streaming application (171).

[0235] The streaming application (171) can delete a media player (172) for streaming specific content. For example, when playback of specific content ends, the streaming application (171) can request the media server (1020) to delete the media player (172) for streaming specific content. At this time, the media server (1020) can delete the media player (172) corresponding to the specific content according to the request received from the streaming application (171).

[0236] The media player (172) can transmit and receive data with the server (400) through the network interface unit (135).

[0237] The media player (172) can receive metadata including information about encoded stream segments from the server (400). The metadata can include a manifest file. The manifest file can include information about the type of bitrate of the stream segments, the identification method of the stream segments, the location of the stream segments on the network, etc. Hereinafter, the bitrate used for receiving the stream segments can be referred to as a target bitrate.

[0238] The media player (172) may request the server (400) to transmit a stream segment corresponding to a target bitrate. For example, the media player (172) may set one of a plurality of bitrates as the target bitrate based on a manifest file. In this case, the media player (172) may request the server (400) to transmit a stream segment corresponding to the target bitrate.

[0239] The media player (172) can receive a stream segment corresponding to a target bitrate from the server (400). The media player (172) can process the stream segment received from the server (400). A video signal corresponding to the stream segment processed by the media player (172) can be transmitted to the display (100). The display (100) can output a video of specific content based on the video signal corresponding to the stream segment processed by the media player (172).

[0240] The media player (172) can determine a target bitrate. The media player (172) can calculate a bitrate corresponding to the reception of a stream segment (hereinafter, referred to as a download bitrate). The media player (172) can calculate the download bitrate based on network bandwidth, network throughput, etc. For example, the media player (172) can calculate the current bandwidth based on the size of data received from the server (400) and the time required to receive the data.

[0241] The media player (172) can calculate the download bitrate using the ABR (Adaptive BitRate) algorithm. The media player (172) can determine the target bitrate by comparing the bitrate included in the manifest file with the download bitrate.

[0242] The media player (172) can transmit the download bitrate to the streaming application (171). For example, the media player (172) can transmit the most recently calculated download bitrate to the streaming application (171).

[0243] According to one embodiment, the media player (172) may transmit the download bitrate to the streaming application (171) based on a result of comparing the average of a predetermined number of recently calculated download bitrates with the most recently calculated download bitrate. The media player (172) may transmit the most recently calculated download bitrate to the streaming application (171) if the most recently calculated download bitrate is greater than or equal to the average of the predetermined number of recently calculated download bitrates, for example, if the most recently calculated download bitrate is 1.6 Mbps and the average of three recently calculated download bitrates is 1.0 Mbps. The media player (172) may transmit the average of the three most recently calculated download bitrates to the streaming application (171) when the most recently calculated download bitrate is less than the average of a predetermined number of recently calculated download bitrates, for example, when the most recently calculated download bitrate is 1.0 Mbps and the average of the three most recently calculated download bitrates is 1.3 Mbps. Through this, the reliability of the download bitrate transmitted to the streaming application (171) can be further improved when the resolution of the content streamed in real time is changed.

[0244] The streaming application (171) can manage the download bitrate transmitted from the media player (172). The streaming application (171) can determine a representative value of the bitrate based on the download bitrate transmitted from the media player (172). Here, the representative value can include an average value, a median value, a mode value, etc. For example, the streaming application (171) can calculate an average value of the bitrate based on the download bitrate transmitted from the media player (172) and the number of times the download bitrate has been transmitted from the media player (172) (hereinafter, the number of updates).

[0245] The streaming application (171) can update data on the download bitrate (hereinafter, bitrate data) stored in the storage (140). For example, the streaming application (171) can add a representative value of the bitrate and the number of updates to the bitrate data. For example, the streaming application (171) can calculate the overall representative value and the number of updates based on the representative value of the bitrate and the number of updates included in the bitrate data stored in the storage (140) and the representative value of the bitrate and the number of updates calculated by the streaming application (171). At this time, the streaming application (171) can change the representative value of the bitrate and the number of updates included in the bitrate data stored in the storage (140) to the overall representative value and the number of updates.

[0246] When a streaming application (171) generates a media player (172), it can transmit a bitrate to the generated media player (172). For example, when there is no representative value of the currently calculated bitrate, the streaming application (171) can transmit a representative value of the bitrate included in the bitrate data stored in the storage unit (140) to the media player (172). For example, when there is a representative value of the currently calculated bitrate, the streaming application (171) can transmit the representative value of the calculated bitrate to the media player (172).

[0247] The media player (172) can set a target bitrate based on the bitrate delivered from the streaming application (171). For example, the media player (172) can determine the largest bitrate among the bitrates included in the manifest file that are smaller than the bitrate delivered from the streaming application (171) as the target bitrate.

[0248] FIG. 11 is a flowchart of an operation method of an image display device according to one embodiment of the present disclosure.

[0249] Referring to FIG. 11, the video display device (100) can receive a playback command for specific content in operation S1101. For example, the video display device (100) can output a screen corresponding to a streaming service through the display (180) based on the execution of a streaming application (171). At this time, when a user selects one of the contents provided through the streaming service as a streaming target through a remote control device (200), the video display device (100) can receive a playback command for the specific content from the remote control device (200).

[0250] Meanwhile, the video display device (100) can generate a media player (172) for streaming specific content based on receiving a playback command for specific content.

[0251] The video display device (100) can receive metadata for specific content in operation S1102. For example, the media player (172) can request the server (400) to transmit metadata for specific content. At this time, the server (400) can transmit metadata for specific content to the video display device (100) in response to the request received from the video display device (100). In the present disclosure, the types of bit rates included in the manifest file are 700 kbps, 1.5 Mbps, and 3 Mbps, as examples.

[0252] The video display device (100) can determine, in operation S1103, whether there is a bitrate being managed by the streaming application (171). The bitrate being managed by the streaming application (171) may be a representative value of the bitrate calculated by the streaming application (171).

[0253] In operation S1104, the video display device (100) can determine a target bitrate based on the bitrate managed by the streaming application (171), if there is a bitrate being managed by the streaming application (171). For example, the media player (172) can determine the target bitrate based on a representative value of the bitrate calculated by the streaming application (171). If the bitrate being managed by the streaming application (171) is utilized, a target bitrate more optimized for the current network environment can be set.

[0254] In operation S1105, the video display device (100) can determine whether bitrate data is stored in the storage unit (140) when there is no bitrate being managed by the streaming application (171).

[0255] The video display device (100), in operation S1106, can determine a target bitrate based on bitrate data if bitrate data is stored in the storage unit (140). For example, the media player (172) can determine a target bitrate based on a representative value of the bitrate included in the bitrate data.

[0256] Meanwhile, in operation S1107, if bitrate data is not stored in the storage unit (140), the video display device (100) may determine the minimum bitrate as the target bitrate. Here, the minimum bitrate may be the smallest bitrate among the bitrates included in the manifest file.

[0257] The video display device (100) can receive a stream segment corresponding to a target bit rate from the server (400) in operation S1108. At this time, the video display device (100) can process the stream segment received from the server (400) and output a video of specific content.

[0258] The video display device (100) can calculate the download bitrate in operation S1109. For example, the media player (172) can calculate the download bitrate using an ABR algorithm.

[0259] The video display device (100) can update bitrate data stored in the storage unit (140) in operation S1110. For example, the media player (172) can determine a representative value of the bitrate based on the download bitrate transmitted from the media player (172). At this time, the media player (172) can update the bitrate data stored in the storage unit (140) based on the calculated representative value of the bitrate and the number of updates.

[0260] The video display device (100) can determine, in operation S1111, whether a change in the target bitrate is necessary. For example, when the target bitrate is set to 1.5 Mbps and the download bitrate is 3 Mbps or more or less than 1.5 Mbps, the video display device (100) can determine that a change in the target bitrate is necessary;

[0261] The video display device (100) can change the target bitrate in operation S1112 if a change in the target bitrate is required. For example, if the download bitrate is 3 Mbps or higher, the video display device (100) can change the target bitrate to 3 Mbps. For example, if the download bitrate is less than 1.5 Mbps, the video display device (100) can change the target bitrate to 700 kbps.

[0262] The video display device (100) can determine, in operation S1113, whether to terminate playback of specific content. For example, the video display device (100) can terminate playback of specific content when execution of the streaming application (171) is terminated. For example, the video display device (100) can terminate playback of specific content when the streaming target changes to content different from the specific content.

[0263] Meanwhile, when playback of a specific content is terminated, the media player (172) for streaming the specific content may be deleted. Additionally, when execution of a streaming application (171) is terminated, the bitrate being managed by the streaming application (171) may be deleted.

[0264] FIGS. 12 and 13 are diagrams illustrating graphs of bitrates for receiving stream segments according to one embodiment of the present disclosure.

[0265] Referring to FIG. 12, according to a conventional adaptive bitrate streaming method, when playback of the first content is initially initiated, the minimum bitrate corresponding to the first content can be set to a target bitrate (G1210) for the first content.

[0266] The target bitrate (G1210) for the first content can be increased in stages. Depending on network bandwidth, network throughput, etc., the target bitrate (G1210) for the first content can be set to 3 Mbps and then maintained. That is, after the target bitrate (G1210) for the first content increases to 3 Mbps, the video of the first content can be output through the display (180) at optimal quality.

[0267] Meanwhile, if the streaming target changes from the first content to the second content, the target bitrate (G1220) for the second content may be set to the minimum bitrate corresponding to the second content. This may cause the quality of the video output through the display (180) to change from high quality to low quality.

[0268] The target bitrate (G1220) for the second content may be increased in stages. Depending on network bandwidth, network throughput, etc., the target bitrate (G1220) for the second content may be set to 5 Mbps and then maintained. That is, after the target bitrate (G1220) for the second content increases to 5 Mbps, the video of the second content can be output through the display (180) at optimal quality.

[0269] Meanwhile, referring to FIG. 13, according to one embodiment of the present disclosure, based on bitrate data stored in the storage unit (140), the target bitrate (G1310) for the first content can be set to 3 Mbps from the beginning of playback of the first content. As a result, from the beginning of playback of the first content, the image of the first content can be output through the display (180) at optimal quality.

[0270] Additionally, when the streaming target changes from the first content to the second content, the target bitrate (G1220) for the second content may be set to 5 Mbps based on the bitrate managed by the streaming application (171). Accordingly, even when the streaming target changes to the second content, the video of the second content can be output through the display (180) at optimal quality from the beginning of playback of the second content.

[0271] FIG. 14 and FIG. 15 are drawings illustrating a screen output through a video display device according to one embodiment of the present disclosure.

[0272] Referring to FIG. 14, according to a conventional adaptive bitrate streaming method, while a high-quality image (1410) of first content is output through a display (180) of a video display device (100), the streaming target may be changed from the first content to the second content. At this time, as the target bitrate for the second content is set to the minimum bitrate corresponding to the second content, a low-quality image (1510) of the second content may be output through the display (180).

[0273] In contrast, referring to FIG. 15, according to one embodiment of the present disclosure, even when a streaming target is changed from the first content to the second content while a high-quality image (1410) of the first content is output, a high-quality image (1520) of the second content can be output through the display (180) as the target bitrate for the second content is set to an optimal bitrate corresponding to the second content.

[0274] As described above, according to at least one embodiment of the present disclosure, when using an adaptive bitrate streaming method, it is possible to provide high-quality images from the beginning.

[0275] Additionally, according to at least one embodiment of the present disclosure, when using an adaptive bitrate streaming method, a bitrate optimized for the network environment in which content is provided can be selected from the beginning.

[0276] Referring to FIGS. 1 to 15, a video display device (100) according to one aspect of the present disclosure includes a network interface unit (135) for communicating with a server (400) that provides a stream segment using an adaptive bitrate streaming method; a display (180); a memory (140) for storing bitrate data; and a control unit (170) for outputting an image corresponding to the stream segment through the display (180). When a streaming target is set, the control unit (170) determines whether a first bitrate managed by the control unit (170) exists, and if the first bitrate exists, determines a target bitrate based on the first bitrate, and if the first bitrate does not exist, determines the target bitrate based on a second bitrate included in the bitrate data, and requests the server (400) to transmit a stream segment corresponding to the target bitrate.

[0277] In addition, according to one aspect of the present disclosure, if the bitrate data is not stored in the memory (140), the control unit (170) may determine the third bitrate, which is the minimum value among at least one bitrate included in the metadata received from the server (400), as the target bitrate.

[0278] In addition, according to one aspect of the present disclosure, the control unit (170) includes an application (171) that provides a streaming service, and the application (171) creates a media player (172) corresponding to the predetermined content when the streaming target is set to the predetermined content, and deletes the media player (172) when the playback of the predetermined content is terminated, and the media player (172) requests the server (400) to transmit a stream segment corresponding to the target bit rate, and processes the stream segment received from the server (400).

[0279] In addition, according to one aspect of the present disclosure, the media player (172) calculates a fourth bitrate corresponding to the reception of a stream segment, transmits the calculated fourth bitrate to the application (171), and the application (171) can calculate the first bitrate based on the fourth bitrate received from the media player (172).

[0280] In addition, according to one aspect of the present disclosure, the media player (172) calculates an average value of a predetermined number of recently calculated fifth bitrates among the fourth bitrates, and if the most recently calculated sixth bitrate among the fourth bitrates is equal to or greater than the average value, transmits the sixth bitrate to the application (171), and if the sixth bitrate is less than the average value, transmits the average value to the application (171), and the sixth bitrate can be included in the fifth bitrate.

[0281] In addition, according to one aspect of the present disclosure, the application (171) may determine a representative value of the fourth bitrate received from the media player (172) as the first bitrate, and update the bitrate data stored in the memory (140) based on the number of times the first bitrate and the fourth bitrate have been transmitted.

[0282] Additionally, according to one aspect of the present disclosure, the application (171) may add the number of times the first bitrate and the fourth bitrate were transmitted to the bitrate data.

[0283] In addition, according to one aspect of the present disclosure, the application (171) may calculate a total bitrate and a total number of times based on the second bitrate included in the bitrate data and the number of times corresponding to the second bitrate and the number of times the first bitrate and the fourth bitrate are transmitted, and may change the second bitrate included in the bitrate data and the number of times corresponding to the second bitrate to the total bitrate and the total number of times.

[0284] According to one aspect of the present disclosure, a method of operating a video display device (100) that receives a stream segment using an adaptive bitrate streaming method may include, when a streaming target is set, an operation of determining whether a first bitrate managed by a control unit (170) exists; an operation of determining a target bitrate based on the first bitrate when the first bitrate exists; an operation of determining the target bitrate based on a second bitrate included in bitrate data stored in a memory (140) when the first bitrate does not exist; an operation of requesting transmission of a stream segment corresponding to the target bitrate to the server (400); and an operation of outputting an image corresponding to the stream segment corresponding to the target bitrate through a display (180).

[0285] In addition, according to one aspect of the present disclosure, if the bitrate data is not stored in the memory (140), an operation of determining a third bitrate, which is the minimum value among at least one bitrate included in metadata received from the server (400), as the target bitrate may be further included.

[0286] In addition, according to one aspect of the present disclosure, when the streaming target is set to a predetermined content, the application (171) providing the streaming service may further include an operation of generating a media player (172) corresponding to the predetermined content; and when the playback of the predetermined content is terminated, the application (171) may further include an operation of deleting the media player (172), and the operation of requesting the server (400) may include an operation of requesting the server (400) to transmit a stream segment corresponding to the target bitrate, and the operation of outputting the image through the display (180) may include an operation of the media player (172) processing the stream segment received from the server (400).

[0287] In addition, according to one aspect of the present disclosure, the media player (172) may further include an operation of calculating a fourth bitrate corresponding to reception of a stream segment; an operation of the media player (172) transmitting the calculated fourth bitrate to the application (171); and an operation of the application (171) calculating the first bitrate based on the fourth bitrate received from the media player (172).

[0288] In addition, according to one aspect of the present disclosure, the operation of the media player (172) transmitting the fourth bitrate to the application (171) includes: calculating an average value of a predetermined number of fifth bitrates that have been recently calculated among the fourth bitrates; transmitting the sixth bitrate to the application (171) when the most recently calculated sixth bitrate among the fourth bitrates is equal to or greater than the average value; and transmitting the average value to the application (171) when the sixth bitrate is less than the average value, wherein the sixth bitrate may be included in the fifth bitrate.

[0289] In addition, according to one aspect of the present disclosure, the application (171) may further include an operation of determining a representative value of the fourth bitrate received from the media player (172) as the first bitrate; and an operation of the application (171) adding the number of times the first bitrate and the fourth bitrate were transmitted to the bitrate data.

[0290] In addition, according to one aspect of the present disclosure, the application (171) may further include an operation of determining a representative value of the fourth bitrate received from the media player (172) as the first bitrate; an operation of the application (171) calculating a total bitrate and a total number of times based on the second bitrate included in the bitrate data and the number of times corresponding to the second bitrate and the number of times the first bitrate and the fourth bitrate are transmitted; and an operation of the application (171) changing the second bitrate included in the bitrate data and the number of times corresponding to the second bitrate to the total bitrate and the total number of times.

[0291] The attached drawings are only intended to facilitate understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, or substitutes included in the spirit and technical scope of the present disclosure.

[0292] Meanwhile, the operating method of the present disclosure can be implemented as processor-readable code on a processor-readable recording medium. The processor-readable recording medium may include any type of recording device that stores data readable by the processor. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and may also include a recording medium implemented in the form of a carrier wave, such as transmission via the Internet. Furthermore, the processor-readable recording medium may be distributed across network-connected computer systems, so that the processor-readable code can be stored and executed in a distributed manner.

[0293] In addition, although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present invention pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. A network interface unit that communicates with a server that provides stream segments using the Adaptive Bitrate Streaming method; display; Memory for storing bitrate data; and A control unit is included that outputs an image corresponding to the above stream segment through the display, The above control unit, When a streaming target is set, it is determined whether the first bitrate managed by the control unit exists, If the first bitrate exists, the target bitrate is determined based on the first bitrate, If the first bitrate does not exist, the target bitrate is determined based on the second bitrate included in the bitrate data, A video display device characterized in that it requests the server to transmit a stream segment corresponding to the target bit rate.

2. In paragraph 1, The above control unit, A video display device characterized in that, when the bitrate data is not stored in the memory, a third bitrate, which is the minimum value among at least one bitrate included in metadata received from the server, is determined as the target bitrate.

3. In paragraph 1, The above control unit, Includes applications that provide streaming services, The above application, When the above streaming target is set to a predetermined content, a media player corresponding to the predetermined content is created, When the playback of the above content ends, delete the media player, The above media player, Requesting the server to transmit a stream segment corresponding to the target bitrate; A video display device characterized by processing the stream segment received from the server.

4. In paragraph 3, The above media player, Calculate the fourth bitrate corresponding to the reception of the above stream segment, The fourth bitrate calculated above is transmitted to the application, The above application, A video display device characterized in that the first bitrate is calculated based on the fourth bitrate received from the media player.

5. In paragraph 4, The above media player, Calculate the average value of a predetermined number of recently produced fifth bitrates among the above fourth bitrates, If the most recently calculated sixth bitrate among the fourth bitrates is greater than or equal to the average value, the sixth bitrate is transmitted to the application, If the above 6th bitrate is less than the average value, the average value is transmitted to the application, A video display device, characterized in that the sixth bitrate is included in the fifth bitrate.

6. In paragraph 4, The above application, A representative value of the fourth bitrate received from the media player is determined as the first bitrate, A video display device characterized in that the bit rate data stored in the memory is updated based on the number of times the first bit rate and the fourth bit rate are transmitted.

7. In paragraph 6, The above application, A video display device characterized in that the number of times the first bit rate and the fourth bit rate are transmitted is added to the bit rate data.

8. In paragraph 6, The above application, Based on the second bitrate included in the bitrate data and the number of times corresponding to the second bitrate and the number of times the first bitrate and the fourth bitrate are transmitted, the total bitrate and the total number of times are calculated, A video display device characterized in that the second bitrate and the number of times corresponding to the second bitrate included in the bitrate data are changed to the total bitrate and the total number of times.

9. In the operating method of a video display device that receives a stream segment using an adaptive bitrate streaming method, When a streaming target is set, an action is taken to determine whether a first bitrate managed by the control unit exists; An operation of determining a target bitrate based on the first bitrate when the first bitrate exists; If the first bitrate does not exist, an operation of determining the target bitrate based on a second bitrate included in bitrate data stored in memory; An operation of requesting the server to transmit a stream segment corresponding to the target bitrate; and An operating method of a video display device, including an operation of outputting a video corresponding to a stream segment corresponding to the target bitrate through a display.

10. In paragraph 9, An operating method of a video display device, characterized in that it further includes an operation of determining a third bitrate, which is the minimum value among at least one bitrate included in metadata received from the server, as the target bitrate, when the bitrate data is not stored in the memory.

11. In paragraph 9, When the above streaming target is set to a predetermined content, an application providing a streaming service generates a media player corresponding to the predetermined content; and When the playback of the above content is terminated, the application further includes an action of deleting the media player, The action of requesting the server includes an action of the media player requesting the server to transmit a stream segment corresponding to the target bitrate, A method for operating a video display device, characterized in that the operation of outputting the video through the display includes an operation of the media player processing the stream segment received from the server.

12. In paragraph 11, The media player calculates a fourth bitrate corresponding to the reception of the stream segment; The media player transmits the fourth bitrate to the application; An operating method of a video display device, characterized in that the application further includes an operation of calculating the first bitrate based on the fourth bitrate received from the media player.

13. In paragraph 12, The above media player transmits the fourth bitrate to the application, An operation of calculating an average value of a predetermined number of recently produced fifth bitrates among the above fourth bitrates; If the most recently calculated sixth bitrate among the fourth bitrates is greater than or equal to the average value, an operation of transmitting the sixth bitrate to the application; and If the sixth bitrate is less than the average value, the operation of transmitting the average value to the application is included. A method of operating a video display device, characterized in that the sixth bitrate is included in the fifth bitrate.

14. In paragraph 12, The above application determines a representative value of the fourth bitrate received from the media player as the first bitrate; and An operating method of a video display device, characterized in that the application further includes an operation of adding the number of times the first bitrate and the fourth bitrate were transmitted to the bitrate data.

15. In paragraph 13, An operation in which the application determines a representative value of the fourth bitrate received from the media player as the first bitrate; An operation in which the application calculates a total bitrate and a total number of times based on the second bitrate included in the bitrate data and the number of times corresponding to the second bitrate and the number of times the first bitrate and the fourth bitrate are transmitted; and An operating method of a video display device, characterized in that the application further includes an operation of changing the second bitrate and the number of times corresponding to the second bitrate included in the bitrate data to the total bitrate and the total number of times.

Images