Control server interworking with display device and content server

Abstract

This control server comprises: a communication interface for establishing a session with a display device on the basis of an input, from the display device, for executing content of an IP-based broadcast service; a processor for controlling the communication interface such that a request for metadata required to play back pieces of content of channels associated with the broadcast service is transmitted to a content server; and a caching storage for storing, in response to the request, the metadata received from the content server.

Description

Control server that interacts with display devices and content servers

[0001] The present disclosure relates to a method and apparatus for improving channel switching time. More specifically, the present disclosure relates to a control server that interacts with a display device and a content server to improve channel switching time.

[0002] Recently, digital TV services using wired or wireless communication networks have become commonplace. Digital TV services can provide a variety of services that were not available through existing analog broadcasting services.

[0003] For example, IPTV (Internet Protocol Television) and SMART TV services, which are types of digital TV services, provide interactivity that allows users to actively select the types of programs and viewing time.

[0004] Meanwhile, a low-latency streaming caching method and an edge server may be provided between the content server and the display device to perform this. The edge server receives a manifest file from the origin server in response to a request from the media device and can transmit the received manifest file to the media device. The media device can request a segment file from the origin server based on the manifest file.

[0005] The edge server can cache a segment file received from the origin server, receive a segment file request from a media device, and transmit the cached segment file to the media device. Meanwhile, this caching process can be performed autonomously by the edge server before receiving a segment file request from the media device.

[0006] However, caching of metadata, such as manifest files, may be initiated upon the request of the client media device. Therefore, a delay may still occur in playing the channel's content when first entering each channel of the media device.

[0007] The present disclosure aims to solve the aforementioned problems and other problems by providing a control server that interacts with a display device and a content server to improve channel switching time.

[0008] The present disclosure is intended to resolve an issue in which, as metadata caching is performed in response to a request from a client device, there is still a delay in playing the content of a channel upon the first entry into each channel of a media device.

[0009] The present disclosure is intended to present a technical solution for minimizing time delays occurring during channel switching and providing users with a fast and seamless channel switching experience.

[0010] A control server that interacts with a display device and a content server according to the present disclosure to achieve the above or other purposes comprises: a communication interface configured to connect a session with the display device based on an input executing content of an IP-based broadcasting service from the display device; a processor that controls the communication interface to transmit a request for metadata necessary to play content of channels associated with the broadcasting service to the content server; and a caching storage configured to store the metadata received from the content server in response to the request. The processor controls the display device so that metadata stored in the caching storage is transmitted to and stored in the display device through the connected session, and may receive a switching request from the display device to switch from a first channel providing first content to a second channel providing second content. In response to the switching request, the processor controls the display device to extract second metadata associated with the second content from the metadata stored in the display device, and may control the display device so that the second content provided on the second channel is played on the screen of the display device using the extracted second metadata.

[0011] According to an embodiment, the processor may transmit to the display device information associated with the location where the second metadata of the second channel, which plays the second content, is stored in the first channel, which plays the first content. Based on the second metadata extracted based on the information associated with the location where the second metadata is stored, the display device may play the second content of the second channel.

[0012] According to an embodiment, the processor can extract all metadata for all channels associated with the broadcasting service from the caching storage. The processor can control the communication interface and the display device to transmit and store all metadata to the display device.

[0013] According to an embodiment, the processor can sort channels based on customer information transmitted by the display device to the control server, a list of preferred channels, a list of channels displayed on the initial screen, a list of frequently watched channels, a list of channels selected in order of high viewing time, and viewing patterns by time of day. The processor can control the communication interface and the display device to transmit and store a list of selected metadata in the order of the sorted channels to the display device in conjunction with the caching storage.

[0014] According to an embodiment, the number and order of the sorted channels may be selected based on the priority of the preferred channel list, the viewing pattern by time of day, information on channels with high viewing time, the list of frequently watched channels, and the customer information. The channels with high viewing time may be selected as the top number of channels in order of the viewing time of a specific channel. The list of frequently watched channels may be selected as the top number of channels in order of the number of views, by considering that if the content of a specific channel is played for a threshold time or a certain percentage or more during a certain period, it is watched once.

[0015] According to an embodiment, the processor can detect a selection input for a first icon of a first application program that plays multiple contents through multiple channels on the screen of the display device. When the first media player of the first application program is first executed while the display device is powered on, the processor can allocate hardware resources capable of playing all contents to the display device. When the first application program is executed again while the display device is powered on, the processor can allocate hardware resources based on content information by codec of the first media player to the display device. The hardware resources may include first codec information of a first codec that decodes at a first resolution and second codec information of a second codec that decodes at a second resolution higher than the first resolution.

[0016] According to an embodiment, the processor may transmit and store a list of selected metadata to the display device in the order of channels sorted based on the selected channel list and time-based viewing patterns. The processor may detect a switch from the first channel of the first application program to the second channel. When the switch to the second channel occurs, the processor may control the playback of the second content through the first media program of the first application program using metadata extracted from the stored list of metadata. The first content of the first channel may be decoded through either the first codec or the second codec. The second content of the second channel may be decoded through the other of the first codec and the second codec.

[0017] According to an embodiment, the processor may transmit and store a list of selected metadata to the display device in the order of channels sorted based on the selected channel list and time-based viewing patterns. The first content of the first channel may be decoded through the first codec, and the second content of the second channel may be decoded through the first codec or the second codec. When a request to play the second content on the entire screen of the display device is received, the processor may play the second content through the first media program of the first application program using the metadata extracted from the list of stored metadata and the second codec. When a request to play the second content on a partial screen of the display device is received, the processor may play the second content through the first media program using the metadata and the first codec.

[0018] According to an embodiment, the processor can detect a second selection input for a second icon of a second application program that causes a live broadcast to be played on the screen of the display device. The processor can detect a switch between a first channel of the first application program and a third channel of the second application program. The processor can receive codec bell content information from a second media player of the second application program. The processor can reallocate hardware resources including third metadata according to the codec bell content information received from the second media player. The reallocated hardware resources may include first codec information of a first codec decoding at a first resolution, second codec information of a second codec decoding at a second resolution higher than the first resolution, and third codec information of a third codec decoding at a third resolution higher than the second resolution.

[0019] According to an embodiment, the processor may transmit and store a list of selected metadata to the display device in the order of channels sorted based on the selected channel list and time-based viewing patterns. The processor may detect a transition from the first channel of the first application program to the third channel of the second application program. When the transition to the third channel occurs, the processor may control the playback of the third content through the second media program of the second application program using metadata extracted from the stored list of metadata. The first content of the first channel provided from the first server may be decoded through either the first codec or the second codec. The third content of the third channel provided from the second server may be decoded through any one of the first codec, the second codec, and the third codec.

[0020] According to an embodiment, when a request to play the third content on a part of the screen of the display device is received, the processor may control the playback of the second content through the second media program of the second application program using metadata extracted from the list of stored metadata and the first codec. When a request to play the third content on the entire screen of the display device is received, the processor may play the third content through the second media program using the second codec or the third codec.

[0021] According to an embodiment, the processor can control the playback of the third content through the second media program using the second codec when a request to play the third content on the full screen is received and the processor is connected to the second server. The processor can play the third content through the second media program using the third codec when a request to play the third content on the full screen is received and the processor is connected to the first server and the second server.

[0022] According to an embodiment, the processor may reclaim hardware resources associated with the metadata from the first media player of the first application based on the switching of the second application program to the third channel. According to an embodiment, the processor may reallocate separate hardware resources associated with the third metadata to the second media player.

[0023] According to an embodiment, the processor can detect a switch between channels of the first application program or a switch to the second channel of the second application program while an advertisement video is being played on the screen through the first channel. While the advertisement video is being played, the processor may allocate hardware resources based on content information by codec of the first media player of the first application, or reallocate separate hardware resources associated with the third metadata to the second media player. When the allocation of the hardware resources is completed or the reallocation of the separate hardware resources is completed, the processor may display an icon on the screen related to whether to stop the advertisement being played.

[0024] A display device linked with a content server according to another aspect of the present disclosure comprises: a communication interface configured to connect a session with a control server or a content server based on an input executing content of an IP-based broadcasting service from a remote control device; a processor that controls the control server to transmit to the content server a request for metadata necessary to play content of channels associated with the broadcasting service; a display configured to play the content on a screen; and a storage unit configured to store the metadata received from the control server or the content server in response to the request. The processor controls the reception of metadata stored in the caching storage of the control server or the content server through the connected session and may receive a switching request from the remote control device to switch from a first channel providing a first content to a second channel providing a second content. In response to the switching request, the processor may extract second metadata associated with the second content from the metadata stored in the storage unit and control the display to play the second content provided on the second channel on the screen of the display using the extracted second metadata.

[0025] According to the present specification, the channel switching time following channel switching in the display device can be improved through a control server linked with the display device and the content server.

[0026] According to the present specification, since caching of metadata is performed without a request from the display device, the issue of still experiencing delays in playing the content of a channel upon first entering each channel of the display device can be resolved.

[0027] According to the present specification, metadata can be pre-fetched without a request from the display device. Accordingly, a technical solution can be presented to minimize time delays occurring during the channel switching process and to provide the user with a fast and seamless channel switching experience.

[0028] According to the present specification, by shortening channel switching times and minimizing the delay time perceived by the user between switches, it is possible to improve the perceived quality of the customer and contribute to extending the total service usage time.

[0029] According to the present specification, content switching between IP-based channels considering image quality is possible through a metadata extraction method considering content switching between IP-based channels.

[0030] According to the present specification, content switching between channels of other services considering picture quality is possible through a metadata extraction method that considers content switching between IP-based channels and digital TV-based channels.

[0031] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure.

[0032] FIG. 2 is a drawing for explaining a content server according to an embodiment of the present disclosure.

[0033] FIG. 3 is a drawing for explaining a content provision system according to an embodiment of the present disclosure.

[0034] FIG. 4 shows the configuration of a content provision system including a plurality of display devices, a caching server, and a content server according to the present disclosure.

[0035] FIG. 5 shows a flowchart of a control method performed by a control server that interacts with a display device and a content server according to the present disclosure.

[0036] Figure 6 shows a flowchart of a control method in which a control server interacts with a display device to transmit metadata.

[0037] FIG. 7 shows a screen in which a selection input is granted to a first icon of a first application that plays multiple contents through multiple channels on a display device.

[0038] FIG. 8 shows a screen in which a selection input for a first icon or a selection input for a second icon of a second application that plays a live broadcast is authorized through an external input on a display device.

[0039] Figures 9 and 10 are drawings showing screen configurations according to channel switching within an app and channel switching between apps.

[0040] FIG. 11 shows a flowchart of a control method for optimally playing a first content according to the execution of a first application program and a second content according to channel switching.

[0041] FIGS. 12 and FIGS. 13 show screen configurations in which the switched content is played on a second screen, which is part of the screen of the display.

[0042] FIG. 14 shows a flowchart of a control method for optimally playing third content according to the execution of a second application program and channel switching.

[0043] FIG. 15 shows a flowchart of a control method performed by a display device that interacts with a content server through a control server according to the present disclosure. The control method may be performed by a processor of the display device.

[0044] Figure 16 shows a structure in which a display device receives metadata from a content server through a control server and a structure in which it receives metadata directly from a content server without a control server.

[0045] It should be noted that technical terms used in this specification are used merely to describe specific embodiments and are not intended to limit the invention. Additionally, singular expressions used in this specification include plural expressions unless the context clearly indicates otherwise. The suffixes "module" and "part" for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not inherently possess distinct meanings or roles.

[0046] In this specification, terms such as "composed of" or "comprising" should not be interpreted as necessarily including all of the various components or steps described in the specification, and should be interpreted as potentially excluding some of the components or steps, or including additional components or steps.

[0047] In addition, when describing the technology disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the technology disclosed in this specification, such detailed description is omitted.

[0048] In addition, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification, and the technical concept disclosed in this specification is not limited by the attached drawings; it should be understood that they include all modifications, equivalents, and substitutions that fall within the concept and technical scope of the present invention. Furthermore, not only each of the embodiments described below, but also combinations of embodiments may fall within the concept and technical scope of the present invention as modifications, equivalents, and substitutions that fall within the concept and technical scope of the present invention.

[0049] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings.

[0050] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure.

[0051] Referring to FIG. 1, the display device (100) may include a broadcast receiver (130), an external device interface (135), a storage unit (140), a user input interface (150), a processor (170), a wireless communication unit (173), a voice acquisition unit (175), a display unit (180), an audio output unit (185), and a power supply unit (190).

[0052] The broadcast receiving unit (130) may include a tuner (131), a demodulating unit (132), and a network interface unit (133).

[0053] The tuner (131) can tune to a specific broadcast channel according to a channel tuning command. The tuner (131) can receive a broadcast signal for the tuned specific broadcast channel.

[0054] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0055] The network interface unit (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet network. The network interface unit (133) may transmit or receive data to or from other users or other electronic devices through the connected network or another network linked to the connected network.

[0056] The network interface unit (133) can access a specific web page through a connected network or another network linked to the connected network. That is, it can access a specific web page through a network and transmit or receive data with the corresponding server.

[0057] In addition, the network interface unit (133) can receive content or data provided by a content provider or network operator. That is, the network interface unit (133) can receive content such as movies, advertisements, games, VOD, broadcast signals, and related information provided by a content provider or network provider through a network.

[0058] Additionally, the network interface unit (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the internet, content provider, or network operator.

[0059] The network interface unit (133) can select and receive a desired application among the applications that are open to the public through the network.

[0060] The external device interface unit (135) can receive an application or a list of applications within an adjacent external device and transmit it to a processor (170) or a storage unit (140).

[0061] The external device interface section (135) can provide a connection path between the display device (100) and an external device. The external device interface section (135) can receive one or more of video and audio output from an external device connected to the display device (100) wirelessly or via a wired connection, and transmit them to the processor (170). The external device interface section (135) may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0062] The video signal of an external device input through the external device interface unit (135) can be output through the display unit (180). The voice signal of an external device input through the external device interface unit (135) can be output through the audio output unit (185).

[0063] The external device that can be connected to the external device interface section (135) may be any one of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB memory, or home theater, but this is merely an example.

[0064] In addition, some of the content data stored in the display device (100) can be transmitted to another user or other electronic device selected among other users or other electronic devices that are previously registered in the display device (100).

[0065] The storage unit (140) can store programs for each signal processing and control within the processor (170), and can store signal-processed video, audio, or data signals.

[0066] Additionally, the storage unit (140) may perform the function of temporarily storing video, audio, or data signals input from the external device interface unit (135) or the network interface unit (133), and may also store information regarding a predetermined image through a channel memory function.

[0067] The storage unit (140) can store an application or a list of applications input from an external device interface unit (135) or a network interface unit (133).

[0068] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit (140) and provide them to the user.

[0069] The user input interface (150) can transmit a signal input by the user to the processor (170) or transmit a signal from the processor (170) to the user. For example, the user input interface (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (UWB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication, or process to transmit control signals from the processor (170) to the remote control device (200).

[0070] Additionally, the user input interface (150) can transmit control signals input from local keys (not shown), such as a power key, channel key, volume key, and setting value, to the processor (170).

[0071] The image signal processed by the processor (170) can be input to the display unit (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the processor (170) can be input to an external output device through the external device interface unit (135).

[0072] The voice signal processed by the processor (170) can be output as audio to the audio output unit (185). Additionally, the voice signal processed by the processor (170) can be input to an external output device through the external device interface unit (135).

[0073] In addition, the processor (170) can control the overall operation within the display device (100).

[0074] Additionally, the processor (170) can control the display device (100) by means of user commands or internal programs input through the user input interface (150). The processor (170) can connect to a network to enable the user to download desired applications or application lists into the display device (100). The processor (170) may be configured to execute at least one application program to control the display device (100). A first application program (10) may execute to determine whether a specific content has been purchased, played, refunded, or resold based on the viewing history and playback time of the specific content. A second application program (20) may execute to store and manage information regarding the playback history and playback time of the specific content.

[0075] The processor (170) enables the processed video or audio signal, such as channel information selected by the user, to be output through the display unit (180) or audio output unit (185).

[0076] Additionally, the processor (170) enables a video signal or audio signal from an external device, such as a camera or camcorder, which is input through the external device interface unit (135), to be output through the display unit (180) or audio output unit (185) in accordance with an external device video playback command received through the user input interface (150).

[0077] Meanwhile, the processor (170) can control the display unit (180) to display an image, for example, a broadcast image input through the tuner (131), an external input image input through the external device interface unit (135), an image input through the network interface unit, or an image stored in the storage unit (140) can be controlled to be displayed on the display unit (180). In this case, the image displayed on the display unit (180) may be a still image or a video, and may be a 2D image or a 3D image.

[0078] Additionally, the processor (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from the outside, and the content may be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0079] The wireless communication unit (173) can communicate with an external device via wired or wireless communication. The wireless communication unit (173) can perform short-range communication with an external device. To this end, the wireless communication unit (173) can support short-range communication by using at least one of Bluetooth™, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. Such wireless communication unit (173) can support wireless communication between a display device (100) and a wireless communication system, between a display device (100) and another display device (100), or between a display device (100) and a network where a display device (100, or an external server) is located, through a wireless area network. The wireless area network may be a wireless personal area network.

[0080] Here, another display device (100) may be a wearable device (e.g., a smartwatch, smart glass, head-mounted display, or mobile terminal such as a smartphone) capable of exchanging (or interacting with) data with the display device (100) according to the present invention. A wireless communication unit (173) may detect (or recognize) a wearable device capable of communicating around the display device (100). Furthermore, if the detected wearable device is an authenticated device to communicate with the display device (100) according to the present invention, the processor (170) may transmit at least a portion of the data processed in the display device (100) to the wearable device through the wireless communication unit (173). Accordingly, the user of the wearable device may use the data processed in the display device (100) through the wearable device.

[0081] The voice acquisition unit (175) can acquire audio. The voice acquisition unit (175) may include at least one microphone (not shown) and can acquire audio around the display device (100) through the microphone (not shown).

[0082] The display unit (180) can generate a driving signal by converting the video signal, data signal, OSD signal processed by the processor (170) or the video signal, data signal, etc. received from the external device interface unit (135) into R, G, and B signals, respectively.

[0083] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present invention, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the actual implemented display device (100).

[0084] That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. In addition, the functions performed in each block are intended to explain embodiments of the present invention, and the specific operations or devices do not limit the scope of the present invention.

[0085] FIG. 2 is a drawing for explaining a content server according to an embodiment of the present disclosure.

[0086] The content server (300) can provide a recommendation service that recommends content that a viewer using the display device (100) may prefer.

[0087] The content server (300) may include a communication interface (310), memory (320), and a processor (330).

[0088] The content server (300) can transmit and receive data to and from at least one display device (100) via wired or wireless communication through the communication interface (310).

[0089] The memory (320) may include a content information database (321). The content information database (321) may store information related to content played on each device. For example, the content information database (321) may store content playback information, content setting information, or application installation information in association with the identification information of each device.

[0090] When the processor (330) receives a content recommendation request from a display device (100) or an external device, it can recommend content optimized for each device based on data stored in the content information database (321).

[0091] FIG. 3 is a drawing for explaining a content provision system according to an embodiment of the present disclosure.

[0092] The content provision system (1000) may include at least one display device (100), at least one remote control device (200), and a content server (300).

[0093] The processor (170) of the display device (100) can play content.

[0094] Additionally, the processor (170) can generate content playback information regarding the played content. Additionally, the processor (170) can generate content setting information, which is information regarding the quality, volume, and preferred channel status set when playing the content.

[0095] Content playback information may include at least one of content identification information, content genre information, content playback start time information, content playback end time information, and content total playback time information for the played content.

[0096] Content setting information may include at least one of quality information set for the content when playing the content, volume information, and preferred channel information regarding whether the user has registered the channel providing the content as a preferred channel.

[0097] The processor (170) can transmit device identification information of the display device (100), generated content playback information, and generated content setting information to the content server (300) through the communication interface (173). The device identification information may be unique identification information for distinguishing it from other devices.

[0098] The content server (300) can store content playback information and content setting information received from the display device (100) in the content information database (321) in association with device identification information.

[0099] Meanwhile, the processor (170) can receive a content recommendation command through the user input interface unit (150) or the voice acquisition unit (175).

[0100] When the processor (170) receives a content recommendation command, it can transmit device identification information of the display device (100) and a content recommendation request to the content server (300) through the communication interface (173).

[0101] The communication interface (310) of the content server (300) can receive device identification information and a content recommendation request from the display device (100).

[0102] The processor (430) of the content server (300) can obtain content playback information and content setting information associated with the display device (100) from the content information database (321) based on device identification information.

[0103] The processor (330) can generate content recommendation information and recommendation setting information for the display device (100) based on content playback information and content setting information. The content recommendation information may include recommended content identification information and recommended content genre information for at least one recommended content. Additionally, the recommendation setting information may include recommended image quality setting information and preferred channel information.

[0104] The processor (330) can transmit content recommendation information and recommendation setting information to the display device (100) through the communication interface (310).

[0105] The processor (170) can receive content recommendation information and recommendation setting information from the content server (300) through the communication interface (173).

[0106] The processor (170) can display at least one recommended content based on the received content recommendation information. Additionally, when a playback command for the recommended content is input through the user input interface unit (150) or the voice acquisition unit (175), the processor (170) can set the quality of the recommended content to be played based on the received recommendation setting information and play it.

[0107] The quality of recommended content is set for playback, and if a user requests a change to a preferred channel, a channel change to the preferred channel can be performed based on the preferred channel information.

[0108] Meanwhile, the display device (100) can mirror the content currently being played to an external device. The external device may include another display device or a mobile device. In this case, the mirrored content can be viewed through the external device. Therefore, viewing information regarding the mirrored content needs to serve as basic data for recommending content to the external device.

[0109] Meanwhile, when the display device (100) performs a mirroring operation to an external device, it may receive a control command from the external device to control the display device (100). The control command may include a content change command to change the content being played from the first content to the second content. When the display device (100) receives the content change command, it may play the changed content. In this case, the display device (100) needs to transmit content playback information regarding the changed content to the content server (300) as information for content recommendation to the external device.

[0110] Hereinafter, a control server (caching server) that interacts with a display device and a content server according to the present disclosure will be described. In this regard, FIG. 4 shows the configuration of a content providing system including a plurality of display devices, a caching server, and a content server according to the present disclosure. Referring to FIG. 4, the content providing system (1000) may include display devices (100-1 to 100-N), a content server (300), and a control server (400).

[0111] Referring to FIGS. 1 and FIGS. 4, the content server (300) may be implemented as a Contents Delivery Network (CDN) including an origin server. The content server (300) may provide metadata and media data for content playback to a display device (100). The content server (300) may transmit metadata to the display device (100) upon a request from the control server (400). The content server (300) may be directly connected to the display device (100) and transmit metadata to the display device (100) without a request from the display device (100).

[0112] The content server (300) may include a first server (300a) that provides IP / VOD-based content through a first application program (10). The content server (300) may include a second server (300b) that provides digital TV-based content through a second application program (20).

[0113] The first server (300a) may include a first video content server (300-1) and a second video content server (300-2). The first video content server (300-1) may be configured to transmit the first video content of a specific content in live playback mode via an IP-based live channel. The second video content server (300-2) may be configured to transmit the second video content based on VOD.

[0114] Meanwhile, the display devices (100) may be referred to as client devices as they operate as client devices that interact with a server. The display devices (100) may be referred to as media devices as they play media. Meanwhile, the display devices (100) may be implemented as electronic devices placed in a fixed location or as movable mobile terminals.

[0115] A control server (400) may be positioned between a content server (300) and display devices (100). The control server (400) may request and receive metadata for at least one piece of content from the content server (300) and store it in a caching storage (430). The control server (400) may continuously transmit the stored metadata through a session connected to the display device (100).

[0116] The control server (400) can receive metadata, such as a manifest file, from the content server (300). In this regard, during live streaming, media (video / audio) is transmitted in the form of segments with a length of 2 to 6 seconds. Since these segments undergo a process of being encoded, transmitted, downloaded, buffered, and then rendered in a media player, there is a delay of several seconds from transmission to playback. In all these processes, there are limitations to minimizing the delay due to the segment size. Meanwhile, HLS (HTTP Live Streaming) and DASH (Dynamic Adaptive Streaming over HTTP) adopt the CMAF (Common Media Application Framework) format as a low-latency method.

[0117] DASH or low-latency HLS can include segment information being generated in a manifest file when transmitting CMAF low-latency chunks. Meanwhile, metadata such as a manifest file can be provided to the display device (100) upon the request of the control server (400) without a request from the display device (100). Therefore, when the display device (100) is set to low-latency mode, it can perform chunk-based decoding and rendering using metadata such as a manifest file without waiting for the entire segment to be downloaded.

[0118] Meanwhile, VoD-based video files are single, pre-stored files in which a manifest file and a list of entire chunk files can be defined in advance. The manifest file defines the content required to render a broadcast program. As a pre-produced media file, a list of segments or chunk files—units of time intervals that can be played independently—is determined in advance along with media attribute information. In other words, a VoD file is a file format in which the file size and the list of chunks are fixed.

[0119] In this regard, the processor (170) can receive all metadata from the control server (400). Meanwhile, if the total number of metadata is greater than a threshold (or the total capacity of all metadata is greater than a threshold capacity), the processor (170) can receive a list of metadata selected according to a certain standard from the control server (400). If the total number of metadata is greater than a threshold, the processor (170) can transmit customer information, a list of preferred channels, a list of channels displayed on the initial screen, a list of frequently watched channels, a list of channels selected in order of channels with high viewing time, and viewing patterns by time of day to the control server (400). The processor (170) can receive a list of metadata selected according to the order of channels sorted based on the aforementioned channel lists and viewing patterns by time of day from the control server (400).

[0120] The control server (400) can pre-transmit the received manifest file to the display devices (100) so that the display devices (100) can play the content. Thus, the display devices (100) can play the content using pre-fetched metadata, and the control server (400) can be referred to as a caching server.

[0121] The display device (100) is a client device capable of running the first and second media players of the first and second application programs (10, 20) capable of playing content. The display device (100) can initiate preparation for content playback using pre-patched metadata when the user starts a content switching operation through interaction with the user.

[0122] Meanwhile, FIG. 5 shows a flowchart of a control method performed by a control server that interacts with a display device and a content server according to the present disclosure. The control method may be performed by a processor of the control server. Referring to FIGS. 1 to 5, a control server that interacts with a display device and a content server according to the present disclosure will be described. The control server (400) may be configured to include a communication interface (410), a caching storage (420), and a processor (430).

[0123] Based on an input executing content of an IP-based broadcasting service from a display device (100), a communication interface (410) may be configured to establish a session with the display device (100). In this regard, a processor (430) may receive an input executing content of an IP-based broadcasting service from the display device (100) (S110). A user may execute an IP-based broadcasting service (e.g., Free Ad-Supported Streaming TV) on the display device (100) via a remote control device (200). Based on the content execution input, the processor (430) may control the communication interface (410) to establish a session with the display device (100) (S120). The display device (100) and the control server (400) may perform bidirectional communication based on a session connection (e.g., WebSocket communication) rather than HTTP communication.

[0124] The processor (430) can control the communication interface (410) to transmit a request for metadata required to play content of channels associated with the broadcasting service to the content server (300). In this regard, the control server (400) may request metadata for one or more contents from the content server (300) (S130). The control server (400) may request metadata that is essential for content playback from the content server (300) in advance.

[0125] The caching storage (420) may be configured to store metadata received from the content server (300) in response to a request for metadata from the control server (400). In this regard, the metadata received by the request for metadata from the control server (400) may be stored (S140) in the caching storage (420).

[0126] The processor (430) can control the display device (100) so that metadata stored in the caching storage (420) is transmitted to and stored in the display device (100) through a connected session. In this regard, the control server (400) can transmit (S150) the metadata stored in the caching storage to the display device (100), which is a client device.

[0127] The processor (430) may receive a switching request from the display device (100) to switch from a first channel providing content to a second channel providing second content. In response to the switching request, the processor (430) may control the display device (100) to extract second metadata associated with the second content from the metadata stored in the display device (100). In this regard, the control server (400) may control (S160) the client of the display device (100) to play content using prefetched metadata when switching channels. When a user attempts to switch content, the switching time can be shortened by using prefetched metadata on the client device.

[0128] The processor (430) can control the display device (100) using the second metadata extracted by the display device (100) so that the second content provided in the second channel is played on the screen of the display device (100).

[0129] The processor (430) can transmit information associated with the location where the second metadata of the second channel, which plays the second content, is stored to the display device (100) in the first channel, which plays the content. Accordingly, the display device (100) can extract the second metadata based on the information associated with the location where the second metadata is stored. Based on the extracted second metadata, the display device (100) can play the second content of the second channel.

[0130] Meanwhile, metadata received from and stored by the caching storage (420) in the display device (100) may be configured differently depending on the number and information of the channels of the display device (100). In this regard, FIG. 6 shows a flowchart of a control method in which a control server transmits metadata in conjunction with the display device. The control server (400) can extract metadata in conjunction with the display device (100).

[0131] The processor (170) can store the metadata received in response to a request for metadata from the control server (400) in the caching storage (420) (S140). The processor (170, 430) can determine whether the number of all metadata for all channels associated with the broadcast service is less than a threshold (S210). In this regard, the number of metadata is not limited to the file size of the metadata and the threshold can be compared.

[0132] If the number (file size) of all metadata is less than a threshold, the caching storage (420) may transmit all metadata for all channels associated with the broadcast service to the display device (100) for storage (S220). In this regard, the processor (170, 430) may extract all metadata for all channels associated with the broadcast service from the caching storage (420). The processor (170, 430) may control the communication interface (410) and the display device (100) to transmit all metadata to the display device (100) for storage (S220).

[0133] As previously mentioned, metadata may be a manifest file. Meanwhile, receiving manifest files for all channels has the advantage that performance improvement effects are applied to all channels during channel switching without separate channel selection from the device's perspective. However, to reduce the amount of data transmitted by the device and server, manifest files may be provided only for selected channels rather than receiving all channel information. In this regard, the control server (300) can connect sessions between clients of the display device (100) based on the following various factors.

[0134] - Channel selection based on the big data judgment criteria of the control server (300) and customer information (gender, age, etc.) transmitted by the display device (100) to the control server (300).

[0135] - Transmit the list of preferred channels explicitly specified by the customer (user logged into the channel service) of the display device (100) to the control server (300).

[0136] - Transmit the list of channels displayed on the initial screen of a channel service app (application program) that operates VOD services or live broadcasts of multiple contents to the control server (300).

[0137] - A list of the top N channels (e.g., Top 10) frequently watched by a customer (user logged into the channel service) is transmitted to the control server (300) (if a specific channel is stayed on for a threshold time (e.g., N minutes) or longer, it is determined that it has been watched)

[0138] - Transmit a list of the top N channels (e.g., Top 10) by viewing time of the customer (user logged into the channel service) to the control server (300).

[0139] - Transmit a list of channels based on the channel viewing patterns of customers (users logged into the channel service) by time of day to the control server (300) (e.g., transmit information that at 9 PM, news content of news channel 190 is always watched)

[0140] Based on the elements described above, the control server (400) can transmit metadata (manifest file) to the display device (100). In this regard, the display device (100) can transmit customer information, a list of preferred channels, a list of channels displayed on the initial screen, a list of frequently watched channels, and information about channels with high viewing times to the control server (400). The processor (170, 430) can sort the channels (S230) based on the selected channel list and viewing patterns by time period in the order of the transmitted channel information. The processor (430) can control the communication interface (410) and the display device (100) to transmit and store (S240) a list of selected metadata to the display device (100) in conjunction with the caching storage (420) according to the order of the sorted channels.

[0141] In this regard, the number and order of sorted channels may be selected based on the priority of the preferred channel list, viewing patterns by time of day, information on channels with high viewing times, the list of frequently watched channels, and customer information. Meanwhile, the channels with high viewing times may be selected as the top number of channels in order of the viewing time of a specific channel. For the list of frequently watched channels, content of a specific channel may be considered as watched once if it is played for a threshold time (e.g., 3 minutes, 5 minutes) or longer during a certain period (e.g., 1 week, 1 month). Additionally, content of a specific channel may be considered as watched once if it is played for a certain percentage or more (in terms of episodes or program installments). Therefore, the list of frequently watched channels may be selected as the top number of channels in order of the number of views.

[0142] Meanwhile, the control server according to the present disclosure can control resource allocation and metadata extraction, etc., in different ways depending on the execution of a first application that plays content on a display device or a second application that plays a live broadcast. In this regard, FIG. 7 shows a screen in which a selection input for a first icon of a first application that plays multiple contents through multiple channels on a display device is applied. Meanwhile, FIG. 8 shows a screen in which a selection input for a first icon or a selection input for a second icon of a second application that plays a live broadcast is applied through an external input on a display device.

[0143] Referring to FIG. 7, when the home button (201) of the remote control device (200) is pressed, a home screen may be displayed on the display (180) of the display device. On the home screen of the display (180), a selection input may be detected on the first icon (181) of the first application program displayed as "LG Channels". The processor of the display device or the processor of the control server connected to the display device may detect the selection input on the first icon (181) of the first application program.

[0144] Referring to FIG. 8, when the external input button (202) of the remote control device (200) is pressed, icons of a plurality of application programs may be displayed on the screen of the display (180) of the display device. A second selection input may be detected for the second icon (182) of the second application program that causes a live broadcast to be played on the screen of the display (180). Meanwhile, a selection input may be detected for the first icon (181b) of the first application program displayed as "LG Channels" on the screen of the display (180).

[0145] Control methods such as resource allocation and metadata extraction during channel switching based on selection input to the first icon (181, 181b) of the first application program and second selection input to the second icon (182) of the second application program are as follows. Resource allocation and metadata extraction, etc. may be controlled differently for each playable LG channel based on selection to "LG Channels" on the first icon (181, 181b).

[0146] Meanwhile, the channel played through the first icon (181, 181b) labeled "LG Channels" can be configured together with the channel played through the second icon (182) of the live app that plays the live broadcast. Through the user's channel list management, the first channels played through the first icon (181, 181b) of the first application program (10) and the second channels played through the second icon (182) of the second application can be arranged together.

[0147] In this regard, the first channels played through the first icon (181, 181b) and the second channels played through the second icon (182) each use a media player. Meanwhile, the switching between the channels of the first and second applications can be classified into two types. In this regard, the first application may be referred to as the live TV app and the second application as the LG Channel app. Type 1 is a switching within the same app, such as a switching between the LG Channel app and the LG Channel app or between the live TV app and the live TV app. Type 2 is a switching between different apps, such as a switching between the LG Channel app and the live TV app.

[0148] In this regard, FIGS. 9 and 10 are drawings illustrating screen configurations based on channel switching within an app and channel switching between apps. FIG. 9 shows a screen in which a second application is executed and a second content is executed through channel switching within an app while the first content is being played through the first application. FIG. 10 shows a screen in which a second application is executed and a third content is executed through channel switching between apps while the first content is being played through the first application.

[0149] Referring to FIGS. 1 through 9, the first content of the first channel can be played through the first media player of the first application program (10) of the display (180). The first icon (181, 181b) of the first application program of FIGS. 7 and 8 can be selected to play the first content. When an input for switching channels within the app is received, the display device (100) can play the second content of the second channel through the first media player of the first application program (10) of the display (180).

[0150] Referring to FIGS. 1 through 8 and FIG. 10, the first content of the first channel can be played through the first media player of the first application program (10) of the display (180). When an input for switching between apps is received, the display device (100) can play the third content of the third channel through the second media player of the second application program (20) of the display (180). In this regard, the second icon (182) of the second application program of FIG. 8 can be selected to play the third content.

[0151] Referring to FIGS. 9 and 10, if the first content is VOD-based content, a progressive bar (180b) indicating the streaming time point of the video of the specific content may be displayed in the lower area of ​​the display (180). The ratio of the position of the progress bar to the total length of the progressive bar (180b) may correspond to the ratio of the streaming time point (Ts) to the total playback time of the video of the second content.

[0152] Meanwhile, content through the channels of the LG Channel app can be provided from an IP-based content server (300). The content server (300) may include a first server (300a) that provides IP / VOD-based content through a first application program (10). The content server (300) may include a second server (300b) that provides digital TV-based content through a second application program (20). Broadcast content of the channels of the Live TV app can be transmitted from the second server (300b), which is a broadcast server, via cable or antenna.

[0153] The first server (300a) may include a first video content server (300-1) and a second video content server (300-2). The first video content server (300-1) may be configured to transmit the first video content of a specific content in live playback mode via an IP-based live channel. The second video content server (300-2) may be configured to transmit the second video content based on VOD. Meanwhile, the second server (300b) may be implemented as a broadcast server in the ATSC (Advanced Television Systems Committee) 3.0 format.

[0154] The content of the channels of the Live TV app can be transmitted from the second server (300b) in the ATSC 3.0 digital broadcasting standard. The ATSC 3.0 standard uses an IP-based MMT (MPEG Media Transport) protocol or ROUTE (Real-time Object delivery over Unidirectional Transport) protocol instead of MPEG-2 TS in the content transport layer. Therefore, the ATSC standard enables various services such as IP-based transmission as well as existing broadcasting services. Meanwhile, the content of the channels of the LG Channel app can be transmitted from the content server (300) in the MPEG-DASH (Dynamic Adaptive Streaming over HTTP) or HLS (HTTP Live Streaming) manner.

[0155] When switching within an app in Type 1, the media player currently in use by the app is reused. When switching between apps in Type 2, a switch is also performed between the media players used by each app for content playback. When switching from the Live TV app to the LG Channel app, it is necessary to release the hardware resources (such as decoders) used by the media player for the Live TV app and allocate them to the media player for the LG Channel app.

[0156] Ensure that hardware resource reallocation is not required when performing in-app channel switching in Type 1. Meanwhile, minimize the latency associated with hardware resource reallocation when performing inter-app channel switching in Type 2.

[0157] To avoid the need for hardware resource reallocation when performing channel switching within a Type 1 app, hardware resources must be allocated to enable playback of all in-app content upon the initial launch of the media player. To achieve this, the media player allocates hardware resources based on codec-specific content information received from the app, rather than using content information extracted from the content itself.

[0158] For example, hardware resources such as {H.264: 1920x1080, 60 fps, hdr, H.265: 3840x2160, 60 fps, hdr} can be allocated based on codec-specific content information received from an app. H.264 and H.265 are video compression standards referred to as Advanced Video Coding (AVC) and High Efficiency Video Coding (HEVC), respectively. AVC / H.264 can encode high-quality video at lower bitrates than previous compression standards. AVC / H.264 is used in various streaming services, including VOD and live TV. Meanwhile, H.265 offers significantly better image quality than H.264. Many video hosting servers use H.265 in addition to H.264.

[0159] Content based on AVC / H.264, providing HDR (High Dynamic Range) at 60 fps (60 frames per second) based on 1920x1080 pixels, may be provided. Meanwhile, some content based on HEVC / H.265, providing HDR at 60 fps based on 3840x2160 pixels, may be provided. Since some content may be provided based on HEVC / H.265, the media player allocates hardware resources based on codec-specific content information received from the app, rather than content information extracted from the content.

[0160] Meanwhile, when a channel switch occurs between Type 2 apps, the second media player intending to start content playback uses codec-specific content information received from the app, rather than using information extracted from the content. In this regard, hardware resource requests and allocations may be performed in parallel rather than sequentially during the content playback process.

[0161] The hardware resource manager, upon receiving a request for hardware resources, immediately reclaims the hardware resources from the first media player currently using them and notifies the first media player that the hardware resources have been reclaimed. In other words, the hardware resource manager does not wait for a response from the first media player to reclaim the hardware resources. As the hardware resource manager immediately reclaims the hardware resources without waiting for a response from the first media player, the channel switching speed can be achieved quickly even when switching channels between apps.

[0162] Meanwhile, a control server linked with a display device and a content server according to the present disclosure can optimally play content according to channel switching in a first application program. In this regard, FIG. 11 shows a flowchart of a control method for optimally playing a first content according to the execution of a first application program and a second content according to channel switching.

[0163] With reference to FIGS. 1 to 11, a control server that interacts with a display device and a content server according to the present disclosure will be described. A processor (170, 430) can detect a selection input associated with content playback in conjunction with a display device (100). The processor (430) can detect (S310) a selection input for a first icon (181, 181b) of a first application program (10) that plays multiple contents through multiple channels on the screen of the display device (100).

[0164] When the first application program (10) is executed for the first time (S320), the processor (170, 430) can allocate hardware resources capable of playing all content to the display device (100) (S330). In this regard, the processor (430) can detect whether the first application program (10) is executed for the first time while the display device (100) is powered on. When a switching between channels of the first application program (10) is detected, hardware resources can be allocated based on the content information by codec of the first media player of the first application program (10).

[0165] In this regard, some channels may provide some content based on HEVC / H.265. Accordingly, hardware resources such as {H.264: 1920x1080, 60 fps, hdr, H.265: 3840x2160, 60 fps, hdr} may be allocated based on codec-specific content information received from the app. Accordingly, the hardware resources may include first codec information of a first codec decoding at a first resolution and second codec information of a second codec decoding at a second resolution higher than the first resolution. For example, the first resolution may be expressed as a resolution of 1920x1080 pixels, and the second resolution may be expressed as a resolution of 3840x2160 pixels. The first resolution may be expressed as a 2K video, and the second resolution may be expressed as a 4K video.

[0166] The processor (430) does not separately reallocate hardware resources to the display device (100) when switching between channels of the first application. The display device (100) can allocate hardware resources independently based on codec-specific content information received from the app.

[0167] The processor (430) can transmit and store a list of selected metadata to the display device (100) according to the order of channels sorted based on the selected channel list and viewing patterns by time period. The processor (170, 430) can detect a transition from the first channel of the first application program (10) to the second channel (S340). When a transition to the second channel is detected, the processor (170, 430) can control (S360) to play the second content through the first media program of the first application program (10) using the extracted metadata. As a transition to the second channel is detected, the metadata can be extracted from the list of stored metadata. Meanwhile, if a transition to the second channel is not detected, the processor (170, 430) can control (S345) to play the first content of the first channel.

[0168] The first content of the first channel can be decoded through either the first codec or the second codec. For example, the first content of the first channel can use the first codec capable of decoding 2K video. The second content of the second channel can be decoded through the other of the first codec or the second codec. For example, the second content of the second channel can use the second codec capable of decoding 4K video. In this regard, the processor (170, 430) can control (S360) to play the second content through the first media program using the second codec of the first application program (10).

[0169] As another example, even if the second content can be reproduced at a second resolution, the second content can be played at a first resolution lower than the second resolution on a second screen with a smaller screen size. In this regard, FIGS. 12 and 13 show screen configurations in which the switched content is played on a second screen, which is a part of the screen of the display.

[0170] Referring to FIG. 12, a second content may be displayed on a portion of the screen of the display (180). In this regard, the second content may be decoded with a first codec and played back as a 2K video on the second screen of the first area (R1) of the display (180). A "View in Full Screen" button may be displayed in the lower area of ​​the first area (R1) of the display (180). When the "View in Full Screen" button is selected, the second content may be played back on the first screen, which is the full screen. The second content played back on the first screen, which is the full screen, may be decoded with a second codec and played back as a 4K video.

[0171] Additional information regarding the second content may be displayed in the second area (R2) of the display (180). Additional information regarding the second content may be displayed in the second area (R2) of the display (180). A program schedule capable of channel switching may be displayed in the third area (R3a) of the display (180). The first and second areas (R1, R2) of the display (180) constitute the upper screen, and the third area (R3a) constitutes the lower screen.

[0172] Referring to FIG. 13, a second content may be played through a portion of the screen of the display (180). In this regard, the content of multiple channels may be displayed simultaneously. The second content may be played on the second screen of the first area (R1) of the display (180). Different content may be played in the second area (R2), third area (R3), and fourth area (R4) of the display (180) to form a multi-view screen. For example, the content of channels IP-116, IP-118, IP-120, and IP-121 may be played in the first to fourth areas (R1, R2, R3, R4) of the display (180), respectively.

[0173] Referring to FIGS. 1 through 13, the operation of a control server that interacts with a display device and a content server according to the present disclosure is described. A processor (430) can transmit and store a list of selected metadata to the display device (100) according to the order of channels sorted based on a selected channel list and a viewing pattern by time period. The processor (170, 430) can detect (S350) that a request to play the second content of the second channel on the full screen of the display device (100) is received.

[0174] In response to a playback request in full screen, the processor (170, 430) can play (S360) the second content through the first media program of the first application program (10) using the second codec. The first content of the first channel is decoded through the first codec, and the second content of the second channel can be decoded through the first codec or the second coding.

[0175] Meanwhile, the processor (170, 430) can detect (S370) that a request is received to play the second content of the second channel on the second screen of the first area (R1), which is a part of the screen of the display device (100). The processor (170, 430) can play the second content through the first media program of the first application program (10) using metadata extracted from the list of stored metadata and the first codec (S380). Accordingly, screen optimization is possible by playing the second content at a low resolution on a part of the screen in the channel search screen of the channel schedule or in the multi-view screen configuration.

[0176] Meanwhile, a control server linked with a display device and a content server according to the present disclosure can optimally play content according to channel switching between a first and a second application program. In this regard, FIG. 14 shows a flowchart of a control method for optimally playing third content according to the execution of a second application program and channel switching.

[0177] With reference to FIGS. 1 to 10 and FIGS. 12 to 14, a control method for optimally playing third content according to the execution of a second application program and channel switching is described. A processor (170, 430) can detect (S410) a second selection input for a second icon (182) of a second application program (20) that causes a live broadcast to be played on the screen of a display device (100). The processor (430) can detect a switch between the first channel of the first application program (10) and the third channel of the second application program (20).

[0178] The processor (430) can receive codec bell content information from the second media player of the second application program (20). The processor (430) can reallocate hardware resources including third metadata according to the codec bell content information received from the second media player of the second application program (20).

[0179] The reallocated hardware resources may include first codec information, second codec information, and third codec information. The first and second codec information reallocated while the second application program (20) is executed may differ in part from the first and second codec information allocated while the first application program (10) is executed. For example, the reallocated first and second codec information may be implemented in H.264 and H.265, respectively, but the pixel configuration or fps value may differ in part. The first codec information may be information of a first codec that decodes at a first resolution, and the second codec information may be information of a second codec that decodes at a second resolution higher than the first resolution. Using the first and second codec information, 2K video and 4K video may be decoded and played back, respectively. The third codec information may be information of a third codec that decodes at a third resolution higher than the second resolution. 8K video can be decoded and played back using third codec information.

[0180] Meanwhile, depending on the transition between apps, the processor (170, 430) can play the third content of the third channel through the second media player of the second application program (20) (S440). The processor (170, 430) can transmit and store a list of selected metadata to the display device (10) according to the order of channels sorted based on the selected channel list and viewing patterns by time period. The processor (170, 430) can detect a transition from the first channel of the first application program (10) to the third channel of the second application program (20). When the transition to the third channel occurs, the processor (170, 430) can play the third content through the second media program of the second application program (20) using metadata extracted from the list of stored metadata. The first content of the first channel provided from the first server (300a) can be decoded through either the first codec or the second codec. The second content of the second channel provided from the second server (300b) can be decoded through any one of the first to third codecs.

[0181] Meanwhile, when switching between apps, the third content may be played at a different resolution through the full screen or a part of the display (180) of the display device. The processor (430) may transmit and store a list of selected metadata to the display device (100) according to the order of channels sorted based on the selected channel list and viewing patterns by time period. The processor (170, 430) may detect (S460) that a request to play the third content of the third channel is received on the second screen of the first area (R1), which is a part of the screen of the display device (100).

[0182] In response to a playback request on some screens, the processor (170, 430) can play the third content through the first media program of the second application program (20) using the extracted metadata and the first codec (S470). In response to a switch to the third channel, the corresponding metadata can be extracted from the list of stored metadata. Thus, screen optimization is possible by playing the third content at a low resolution on some screens in a channel search screen of a channel schedule or a multi-view screen configuration.

[0183] Meanwhile, the processor (170, 430) can detect (S440) that a request to play the third content of the third channel on the full screen of the display device (100) is received. The processor (170, 430) can play the third content through the second media program of the second application program (20) using the second codec or the third codec (S450).

[0184] When a request to play the third content in full screen is received and the connection with the first server (300a) is disconnected and the connection with the second server (300b) is established, the processor (170, 430) can play the third content through the second media program using the second codec. Meanwhile, when a request to play the third content in full screen is received (S440), the processor (170, 430) can determine (S445) whether the connection with the first server (300a) is maintained. In this regard, the processor (170, 430) receives a request to play the third content in full screen (S440) and can detect that the first server (300a) and the second server (300b) are connected (S445).

[0185] The processor (170, 430) can play the third content through the second media program using the third codec while connected to the first server (300a) and the second server (300b) (S450b). Accordingly, an 8K-UHD service based on the SHVC (Scalable HEVC) codec can be provided. To this end, dependency information of the scalable codec is provided as service signaling information, and the base layer and enhancement layer can be transmitted to the display device (100) in a converged transmission form based on a communication network through the first server and a broadcast network through the second server. On the other hand, when the connection with the first server (300a) is disconnected, the processor (170, 430) can play the third content through the second media program using the second codec (S450a).

[0186] Meanwhile, the processor (430) can recover hardware resources associated with metadata from the first media player of the first application program (10) based on the transition of the second application program (20) to the third channel. The processor (430) can reallocate separate hardware resources associated with the third metadata to the second media player of the second application program (20).

[0187] The processor (430) can detect a transition between channels of the first application program (10) while the advertisement video is playing on the screen of the display (180) through the first channel. Additionally, the processor (430) can detect a transition to the third channel of the second application program (20) while the advertisement video is playing on the screen of the display (180) through the first channel. The processor (430) can allocate hardware resources based on the content information by codec of the first media player while the advertisement video is playing. Additionally, the processor (430) can reallocate separate hardware resources associated with the third metadata to the second media player. Once the allocation of hardware resources is complete, the processor (430) can display an icon associated with whether to stop the advertisement being played on the screen of the display (180). Once the reallocation of separate hardware resources associated with the third metadata is complete, the processor (430) can display an icon associated with whether to stop the advertisement being played on the screen of the display (180).

[0188] In the foregoing, a control server linked with a display device and a content server has been described according to one aspect of the present disclosure. In this regard, playback of content may be performed on the display device in conjunction with the control server. However, upon receiving metadata from the control server, the display device may be configured to play content independently without linking with the control server.

[0189] In this regard, FIG. 15 shows a flowchart of a control method performed by a display device that interacts with a content server through a control server according to the present disclosure. The control method may be performed by a processor of the display device. With reference to FIGS. 1, 5 to 15, a display device (100) that interacts with a content server through a control server according to the present disclosure will be described.

[0190] The display device (100) may be configured to include a communication interface (135), a processor (170), a display (180), and a storage unit (140). The communication interface (135) may be configured to establish a session with a control server (400) based on an input from a remote control device (200) that executes content of an IP-based broadcasting service.

[0191] The processor (170) can receive an input (S510) from the remote control device (200) to execute content of an IP-based broadcasting service. Based on the input executing content of the broadcasting service, the processor (170) can control the communication interface (135) (S520) to establish a session connection with the control server (400).

[0192] The processor (170) can control (S530) the control server (400) to transmit a request for metadata required to play content of channels associated with the broadcasting service to the content server (300). As another example, the processor (170) can also interact (S530) with the content server (300) so that the content server (300) voluntarily transmits the metadata.

[0193] The display (180) may be configured to display content on the screen. The processor (170) may be configured to store (S540) metadata received from the control server (400) in the storage unit (140) in response to a request for metadata. The processor (170) may control the reception of metadata stored in the caching storage (420) of the control server (400) through a connected session.

[0194] The processor (170) may receive a switching request from the remote control device (200) to switch from a first channel providing first content to a second channel providing second content. In response to the switching request, the processor (170) may extract / pre-patch (S550) second metadata associated with the second content among the metadata stored in the storage unit (140). The processor (170) may control (S560) the display (180) so that the second content provided from the second channel is played on the screen of the display (180) using the extracted / pre-patchched second metadata.

[0195] Meanwhile, the processor (170) can receive information from the control server (400) associated with the location where the second metadata of the second channel, which plays the second content, is stored in the first channel, which plays the content. The processor (170) can extract based on the information associated with the location where the second metadata is stored. Based on the extracted second metadata, the processor (170) can control the display (180) to play the second content of the second channel.

[0196] The processor (170) can determine whether the number of all metadata for all channels associated with the broadcast service is less than a threshold. If the number of all metadata is less than the threshold, the processor (170) can receive all metadata from the control server (400).

[0197] Meanwhile, if the total number of metadata is greater than or equal to a threshold, a list of metadata selected according to a certain standard can be received from the control server (400). If the total number of metadata is greater than or equal to a threshold, the processor (170) can transmit customer information, a list of preferred channels, a list of channels displayed on the initial screen, a list of frequently watched channels, a list of channels selected in order of channels with high viewing time, and viewing patterns by time of day to the control server (400). The processor (170) can receive a list of metadata selected according to the order of channels sorted based on the aforementioned channel lists and viewing patterns by time of day from the control server (400).

[0198] The processor (170) can detect a selection input for a first icon (181, 181b) of a first application program (10) that plays multiple contents through multiple channels on the screen of the display (180). The processor (170) can detect whether the first application is executed for the first time while the power is on. When switching between channels of the first application, hardware resources can be allocated from the control server (400) based on the content information by codec of the first media player of the first application program (10).

[0199] The processor (170) can detect a transition from the first channel of the first application program (10) to the second channel. When the transition to the second channel occurs, the processor (170) can control the playback of the second content through the first media program of the first application program (10) using metadata extracted from a list of stored metadata. The first content of the first channel can be decoded through either the first codec or the second codec. The second content of the second channel can be decoded through the other of the first codec and the second codec.

[0200] Meanwhile, the processor (170) can detect a second selection input for a second icon (182) of a second application program (20) that causes a live broadcast to be played on the screen of the display (180). The processor (170) can detect a switch between the first channel of the first application program (10) and the third channel of the second application program (20). The processor (170) can receive codec bell content information from the second media player of the second application program (20). The processor (170) can reallocate hardware resources including third metadata from the control server (400) according to the codec bell content information received from the second media player of the second application program (20).

[0201] The reallocated hardware resources may include first codec information, second codec information, and third codec information. The first codec information is information of a first codec that decodes at a first resolution, and the second codec information may be information of a second codec that decodes at a second resolution higher than the first resolution. The third codec information may be information of a third codec that decodes at a third resolution higher than the second resolution.

[0202] Meanwhile, depending on the transition between apps, the processor (170) can play the third content through the second media player of the second application program (20). The processor (170) can receive and store a list of selected metadata from the control server (400) according to the order of channels sorted based on the selected channel list and viewing patterns by time period. The processor (170) can detect a transition from the first channel of the first application program (10) to the third channel of the second application program (20). When the transition to the third channel occurs, the processor (170, 430) can play the third content through the second media program of the second application program (20) using metadata extracted from the list of stored metadata. The first content of the first channel provided by the first server (300a) can be decoded through either the first codec or the second codec. The second content of the second channel provided from the second server (300b) can be decoded through any one of the first to third codecs.

[0203] Meanwhile, when switching between apps, the third content may be played at a different resolution through the entire screen or a portion of the display (180) of the display device. The processor (170) may detect that a request is received to play the third content of the third channel on the second screen of the first area (R1), which is a portion of the screen of the display (180). The processor (170) may play the third content through the first media program of the second application program (20) using metadata extracted from a list of stored metadata and the first codec. Accordingly, screen optimization is possible by playing the third content at a lower resolution on a portion of the screen in the channel search screen of the channel schedule or in the multi-view screen configuration.

[0204] Meanwhile, the processor (170) can detect that a request to play the third content of the third channel on the full screen of the display device (100) is received. The processor (170) can play the third content through the second media program of the second application program (20) using the second codec or the third codec. When a request to play the third content on the full screen is received and connected to the second server (300b), the processor (170) can play the third content through the second media program using the second codec. The processor (170) can detect that a request to play the third content on the full screen is received and connected to the first server (300a) and the second server (300b). When connected to the first server (300a) and the second server (300b), the processor (170) can play the third content through the second media program using the third codec.

[0205] The above describes a control server and a display device linked with a content server according to the present disclosure. Meanwhile, for the manifest caching method according to the present disclosure, the system may not have a separate control server, and the control server may be implemented by being integrated within the display device.

[0206] In this regard, FIG. 16 illustrates a structure in which a display device receives metadata from a content server through a control server and a structure in which it receives metadata directly from a content server without a control server. Referring to FIG. 16, the display device (100) can receive metadata from a content server (300) via the Internet in an HTTP manner. When metadata is received from the content server (300), the display device (100) may require approximately 700ms of time to play the content of the content server (300).

[0207] Meanwhile, the control server (400) may be configured to pre-fetch metadata through the content server (300). By using the pre-fetched metadata, the time required for the display device (100) to play content from the content server (300) can be reduced to about 20ms.

[0208] The storage unit (140) of the display device (100) can be configured to pre-fetch metadata through the content server (300). By using the metadata pre-fetched in the storage unit (140), the display device (100) does not need to separately receive metadata from the control server (400). Accordingly, the time required for the display device (100) to play content from the content server (300) can be reduced to within 10ms.

[0209] A display device configured to pre-fetch metadata by interacting with a content server without passing through a control server (caching server) will be described with reference to FIGS. 1 through 16. The display device (100) may be configured to include a communication interface (135), a processor (170), a display (180), and a storage unit (140). The communication interface (135) may be configured to establish a session with a content server (300) based on an input from a remote control device (200) that executes content of an IP-based broadcasting service.

[0210] The processor (170) can receive an input (S510) from a remote control device (200) to execute content of an IP-based broadcasting service. Based on the input executing content of the broadcasting service, the processor (170) can control the communication interface (135) (S520) to establish a session connection with the content server (300).

[0211] The processor (170) can control the communication interface (135) to transmit (S530) a request for metadata required to play content of channels associated with the broadcasting service to the content server (300) via the content server (300). The display (180) can be configured to play the content on the screen. The processor (170) can be configured to store (S540) the metadata received from the content server (300) in the storage unit (140) in response to the request for metadata. The processor (170) can control the reception of metadata stored in the caching storage (420) of the content server (300) through a connected session.

[0212] The processor (170) may receive a switching request from the remote control device (200) to switch from a first channel providing first content to a second channel providing second content. In response to the switching request, the processor (170) may extract / pre-patch (S550) second metadata associated with the second content among the metadata stored in the storage unit (140). The processor (170) may control (S560) the display (180) so that the second content provided from the second channel is played on the screen of the display (180) using the extracted / pre-patchched second metadata.

[0213] Meanwhile, the technical effects of the control server and display device linked with the content server according to the present disclosure may be summarized as follows, but are not limited thereto.

[0214] According to the present specification, the channel switching time following channel switching in the display device can be improved through a control server linked with the display device and the content server.

[0215] According to the present specification, since caching of metadata is performed without a request from the display device, the issue of still experiencing delays in playing the content of a channel upon first entering each channel of the display device can be resolved.

[0216] According to the present specification, metadata can be pre-fetched without a request from the display device. Accordingly, a technical solution can be presented to minimize time delays occurring during the channel switching process and to provide the user with a fast and seamless channel switching experience.

[0217] According to the present specification, by shortening channel switching times and minimizing the delay time perceived by the user between switches, it is possible to improve the perceived quality of the customer and contribute to extending the total service usage time.

[0218] According to the present specification, content switching between IP-based channels considering image quality is possible through a metadata extraction method considering content switching between IP-based channels.

[0219] According to the present specification, content switching between channels of other services considering picture quality is possible through a metadata extraction method that considers content switching between IP-based channels and digital TV-based channels.

[0220] The foregoing disclosure may be implemented as computer-readable code on a medium on which a program is recorded. A computer-readable medium includes all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include a Hard Disk Drive (HDD), a Solid State Disk (SSD), a Silicon Disk Drive (SSD), ROM, RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc., and also include implementations in the form of a carrier wave (e.g., transmission over the Internet). Additionally, the computer may include a control unit (180) of a terminal. Accordingly, the above detailed description should not be interpreted restrictively in all respects and should be considered exemplary. The scope of the invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the invention are included within the scope of the invention.

Claims

1. In a control server that interacts with a display device and a content server, A communication interface configured to connect a session with the display device based on an input executing content of an IP-based broadcasting service from the display device; A processor that controls the communication interface to transmit a request for metadata required to play the content of channels associated with the broadcasting service to the content server; and It includes a caching storage configured to store the metadata received from the content server in response to the above request, and The above processor is, Control the display device so that metadata stored in the caching storage is transmitted to and stored in the display device through the connected session, and A switching request is received from the display device to switch from a first channel providing first content to a second channel providing second content, and In response to the above switching request, the display device is controlled to extract second metadata associated with the second content among the metadata stored in the display device, and A control server that controls the display device so that the second content provided by the second channel is played on the screen of the display device using the second metadata extracted above.

2. In Paragraph 1, The above processor is, Information associated with the location where the second metadata of the second channel playing the second content is stored is transmitted to the display device from the first channel playing the first content, and A control server that enables the display device to play the second content of the second channel based on the second metadata extracted based on information associated with the location where the second metadata is stored.

3. In Paragraph 1, The above processor is, All metadata for all channels associated with the above broadcasting service is extracted from the above caching storage, and A control server that controls the communication interface and the display device to transmit and store all metadata to the display device.

4. In Paragraph 1, The above processor is, The above display device sorts channels based on customer information transmitted to the control server, a list of preferred channels, a list of channels displayed on the initial screen, a list of frequently watched channels, a list of channels selected in order of channels with high viewing time, and viewing patterns by time period, and A control server that controls the communication interface and the display device to transmit and store a list of selected metadata according to the order of the sorted channels in conjunction with the above caching storage.

5. In Paragraph 4, The number and order of the sorted channels are selected according to the priority of the preferred channel list, the viewing patterns by time of day, information on channels with high viewing times, the list of frequently watched channels, and the customer information. The channels with the most viewing time mentioned above are selected as the top number of channels in order of viewing time of a specific channel, and A control server in which the above list of frequently watched channels is selected from the top number of channels in order of the number of views, wherein if the content of a specific channel is played for more than a threshold time or a certain percentage during a certain period, it is considered to have been watched once.

6. In Paragraph 4, The above processor is, Detecting a selection input for a first icon of a first application program that plays multiple contents through multiple channels on the screen of the display device, and When the first media player of the first application program is executed for the first time while the display device is powered on, hardware resources capable of playing all content are allocated to the display device, and When the first application program is executed again in the above power-on state, hardware resources based on content information by codec of the first media player are allocated to the display device, and The above hardware resources include first codec information of a first codec that decodes at a first resolution and second codec information of a second codec that decodes at a second resolution higher than the first resolution, for a control server.

7. In Paragraph 6, The above processor is, A list of selected metadata is transmitted to and stored in the display device according to the order of channels sorted based on the above-mentioned selected channel list and time-based viewing patterns, and Detecting a switch from the first channel to the second channel of the first application program, When switched to the second channel, the second content is controlled to be played through the first media program of the first application program using metadata extracted from the list of the stored metadata, and The first content of the first channel is decoded through either the first codec or the second codec, and A control server in which the second content of the second channel is decoded through the other of the first codec and the second codec.

8. In Paragraph 6, The above processor is, A list of selected metadata is transmitted to and stored in the display device according to the order of channels sorted based on the above-mentioned selected channel list and time-based viewing patterns, and The first content of the first channel is decoded through the first codec, and the second content of the second channel can be decoded through the first codec or the second codec, and The above processor is, When a request to play the second content on the full screen of the display device is received, the second content is played through the first media program of the first application program using the metadata extracted from the list of the stored metadata and the second codec. A control server that, upon receiving a request to play the second content on a portion of the screen of the display device, plays the second content through the first media program using the metadata and the first codec.

9. In Paragraph 6, The above processor is, Detecting a second selection input for a second icon of a second application program that causes a live broadcast to be played on the screen of the display device, and Detecting a switch between the first channel of the first application program and the third channel of the second application program, Receiving codec bell content information from the second media player of the second application program, and Hardware resources including third metadata are reallocated according to the codec bell content information received from the second media player, and A control server comprising the above reallocated hardware resources including first codec information of a first codec decoding at a first resolution, second codec information of a second codec decoding at a second resolution higher than the first resolution, and third codec information of a third codec decoding at a third resolution higher than the second resolution.

10. In Paragraph 9, The above processor is, A list of selected metadata is transmitted to and stored in the display device according to the order of channels sorted based on the above-mentioned selected channel list and time-based viewing patterns, and Detecting a transition from the first channel of the first application program to the third channel of the second application program, When switched to the third channel, control is made to play the third content through the second media program of the second application program using metadata extracted from the list of the stored metadata, and The first content of the first channel provided from the first server is decoded through either the first codec and the second codec, and A control server in which the third content of the third channel provided from the second server is decoded through any one of the first codec, the second codec, and the third codec.

11. In Paragraph 10, The above processor is, When a request to play the third content on a part of the display device is received, the second content is controlled to be played through the second media program of the second application program using the metadata extracted from the list of the stored metadata and the first codec. A control server that, upon receiving a request to play the third content on the full screen of the display device, plays the third content through the second media program using the second codec or the third codec.

12. In Paragraph 11, When a request to play the third content on the full screen is received and connected to the second server, the third content is controlled to be played through the second media program using the second codec, and A control server that receives a request to play the third content on the full screen and plays the third content through the second media program using the third codec while connected to the first server and the second server.

13. In Paragraph 9, The above processor is, Based on the switching to the third channel of the second application program, hardware resources associated with the metadata are recovered from the first media player of the first application, and A control server that reallocates separate hardware resources associated with the third metadata to the second media player.

14. In Paragraph 9, The above processor is, Detecting a switch between channels of the first application program or a switch to the second channel of the second application program while an advertisement video is playing on the screen through the first channel, and While the above advertisement video is being played, hardware resources are allocated based on the codec-specific content information of the first media player of the first application, or separate hardware resources associated with the third metadata are reallocated to the second media player, and A control server that displays an icon on the screen regarding whether to stop the advertisement currently playing when the allocation of the above hardware resources is completed or the reallocation of the above separate hardware resources is completed.

15. In a display device that interacts with a content server through a control server, A communication interface configured to connect a session with a control server based on an input executing content of an IP-based broadcasting service from a remote control device; A processor that controls the control server to transmit a request for metadata required to play the content of channels associated with the broadcasting service to the content server; A display configured to play the above contents on a screen; and It includes a storage unit configured to store the metadata received from the control server in response to the above request, and The above processor is, Controls that metadata stored in the caching storage of the control server is received through the connected session, and Receives a switching request from the above remote control device to switch from a first channel providing first content to a second channel providing second content, and In response to the above conversion request, extract second metadata associated with the second content among the metadata stored in the above storage unit, and A display device that controls the display to play the second content provided by the second channel on the screen of the display using the second metadata extracted above.

16. In Paragraph 15, The above processor is, Information associated with the location where the second metadata of the second channel playing the second content is stored in the first channel playing the first content is received from the control server, and A display device that controls the display to play the second content of the second channel based on the second metadata extracted based on information associated with the location where the second metadata is stored.

17. In Paragraph 15, The above processor is, If the number of all metadata for all channels associated with the above broadcasting service is less than a threshold, all metadata is received from the control server, and If the number of all metadata is greater than or equal to a threshold, customer information, preferred channel list, channel list displayed on the initial screen, frequently watched channel list, channel list selected in order of channels with high viewing time, and viewing patterns by time period are transmitted to the control server, and A display device that receives a list of selected metadata from the control server according to the order of channels sorted based on the above channel list and time-based viewing patterns.

18. In Paragraph 15, The above processor is, Detecting a selection input for a first icon of a first application program that plays multiple contents through multiple channels on the screen of the above display, and When the first application program is executed for the first time while the power is on, hardware resources capable of playing all content are allocated from the control server, and The above hardware resources include first codec information of a first codec that decodes at a first resolution and second codec information of a second codec that decodes at a second resolution higher than the first resolution, and A list of selected metadata is received from the control server and stored according to the order of channels sorted based on the above-mentioned selected channel list and time-based viewing patterns, and Detecting a switch from the first channel to the second channel of the first application program, When switched to the second channel, the second content is controlled to be played through the first media program of the first application program using metadata extracted from the list of the stored metadata, and The first content of the first channel is decoded through either the first codec or the second codec, and A display device in which the second content of the second channel is decoded through the other of the first codec and the second codec.

19. In Paragraph 16, The above processor is, Detecting a second selection input for a second icon of a second application program that enables live broadcasting to be played on the screen of the above display, and Detecting a switch between the first channel of the first application program and the third channel of the second application program, and Receiving codec bell content information from the second media player of the second application program, and Hardware resources including third metadata are reallocated from the control server according to the codec bell content information received from the second media player, and A display device comprising the above reallocated hardware resources including first codec information of a first codec decoding at a first resolution, second codec information of a second codec decoding at a second resolution higher than the first resolution, and third codec information of a third codec decoding at a third resolution higher than the second resolution.

20. In Paragraph 19, The above processor is, A list of selected metadata is received from the control server and stored according to the order of channels sorted based on the above-mentioned selected channel list and time-based viewing patterns, and Detecting a transition from the first channel of the first application program to the third channel of the second application program, When switched to the third channel, the third content is played through the second media program of the second application program using metadata extracted from the list of the stored metadata, and The first content of the first channel provided from the first server is decoded through either the first codec and the second codec, and The third content of the third channel provided from the second server is decoded through any one of the first codec, the second codec, and the third codec, and The above processor is, When a request to play the third content on a part of the display is received, the second content is played through the second media program of the second application program using the metadata extracted from the list of the stored metadata and the first codec. A display device that, when a request to play the third content on the full screen of the display is received, plays the third content through the second media program using the second codec or the third codec.

Images