Display device for switching reproduction mode of content
The display device addresses the limitations of IP-based live channel UIs by enabling seamless switching between live and VOD playback, ensuring content continuity and quality, and allowing fast-forwarding, thus improving user experience.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- LG ELECTRONICS INC
- Filing Date
- 2024-12-09
- Publication Date
- 2026-06-18
Smart Images

Figure KR2024020104_18062026_PF_FP_ABST
Abstract
Description
A display device that performs content playback mode switching
[0001] The present disclosure relates to an electronic device for playing recommended content. More specifically, the present disclosure relates to an electronic device for playing recommended content and a content playback system including the same.
[0002] Standardization is underway for internet streaming methods such as IPTV (Internet Protocol Television), including VOD (Video On Demand) streaming via HTTP (Hypertext Transfer Protocol) and live streaming. In particular, MPEG-DASH (Dynamic Adaptive Streaming over HTTP), which is being standardized by ISO / IEC / MPEG, is receiving attention.
[0003] Examples of solutions for playing streaming content include HLS (HTTP Live Streaming), MPEG-DASH (Moving Picture Experts Group - Dynamic Adaptive Streaming over HTTP), and MP4.
[0004] Meanwhile, many users watching streaming content want to consume content quickly through the seek function. However, since the IP-based live channel UI does not provide seek and fast playback functions, users are forced to watch content at 1x speed, and there is an issue that fast content consumption is not possible.
[0005] In this regard, the first video of the content currently being played live can be played as the second video of the VOD. When playing as the second video of the VOD, playback of the same content (program) at a faster speed and playback from a specific point in time are possible.
[0006] Meanwhile, when playing the first video of live content as the second video of VOD, there is a problem in that it is difficult to guarantee content continuity depending on the transmission standards, video format, and quality. Specifically, when switching the playback mode of content, buffering or screen stuttering may occur depending on the transmission standards, timing between contents, and video format / quality.
[0007] The present disclosure aims to solve the aforementioned problems and other problems by providing a display device that performs a playback mode switching between real-time broadcasting of content and video on demand.
[0008] The purpose of the present disclosure is to resolve the issue that users are forced to watch content at 1x speed because search and fast-speed functions are not provided on the IP-based live channel UI.
[0009] The purpose of the present disclosure is to ensure the continuity of content according to transmission standards, video format / quality, etc., when playing a first video of content currently being played live as a second video of VOD.
[0010] The purpose of the present disclosure is to resolve issues such as buffering or screen stuttering that occur depending on transmission standards, timing between contents, video format / quality, etc., when switching the playback mode of content.
[0011] A display device for performing a playback mode switching of content according to one aspect of the present specification includes: a display that plays a first video of specific content in a live playback mode via an IP-based live channel; a user input interface unit configured to receive user input from a remote control device to play a second video based on VOD of the specific content; and a processor operably coupled to the display and controlling to switch the first video to the second video and display it on the display. The processor acquires address information capable of playing the second video, and upon receiving the user input while playing the first video, can change to a VOD playback mode so that the second video can be played in an application program playing the first video. The processor can play a plurality of remaining segments associated with the first video stored in a storage unit in the live playback mode through the application program, and can control the application program to play the second video received through the address information in the VOD playback mode.
[0012] According to an embodiment, when the processor receives a control input associated with the playback of the second video from the remote control device, it can control the second video to be played through the application program based on the control input. The control input may be associated with at least one of the user input that causes the playback of the second video to start at the same time as the last playback time of the first video, playback speed of the second video, pause, seek, or resume.
[0013] According to an embodiment, the processor can download a list of URLs of content from a first server that is available after the point in time when viewing began through the live channel, and obtain the URL of the first video from the downloaded list of URLs. The processor can receive the second video from a second server via the obtained URL, and control the application program so that the second video received from the second server is played and its attributes are controlled through the application program.
[0014] According to an embodiment, the processor may download representative thumbnails corresponding to the contents and obtain representative thumbnails of multiple episodes of the second video among the downloaded representative thumbnails. The representative thumbnails may be obtained from an HLS (HTTP Live Streaming) manifest file or from the first server. When a selection input is received in a screen area where the obtained representative thumbnails are displayed, the processor may play the VOD content of the corresponding episode corresponding to the screen area where the selection input was received.
[0015] According to an embodiment, the processor transmits an index of the time at which the plurality of remaining segments end to a second server providing the second video, and can receive segments of the second video after the end time from the second server.
[0016] According to an embodiment, the plurality of remaining segments of the first video may include a first segment, a second segment, and a third segment. While playing the plurality of remaining segments of the first video, the processor may receive a fourth segment of the second video that follows the third segment. When the playback of the plurality of remaining segments is completed, the processor may play the fourth segment of the received second video and the segments that follow the fourth segment.
[0017] According to an embodiment, the processor can control the display so that a video or advertisement associated with the second video is displayed when the playback of the second video is completed in the VOD playback mode. When the playback of the second video is completed in the VOD playback mode, the processor can control the display so that a return button is displayed in a first area of the display to return to the live channel. When a return input for the return button is received, the processor can control the display so that the first video is played through the live channel.
[0018] According to an embodiment, the processor can control a plurality of screen areas or buttons capable of playing content of different episodes of the second video to be displayed in a third area of the display. When a selection input is received at any one of the plurality of screen areas or buttons, the processor can control the display to play the content of the corresponding episode of the second video corresponding to the said area.
[0019] According to an embodiment, when the processor receives the user input while the first video is being played, it can play the second video through the first media player of the application program. When the selection input is received after the playback of the corresponding episode of the first video has ended, the processor can play the second video through the second media player of the second application program.
[0020] According to an embodiment, the plurality of residual segments of the first video may include a first segment, a second segment, and a third segment. The processor may receive each of the plurality of residual segments of the first video from a first server according to a first transmission standard at a first interval of a first time interval and store them in the storage unit. The processor may determine whether the first segment of the second video overlaps with at least one of the first to third segments. If the first segment overlaps with the at least one segment, the processor may receive the segment of the second video of the overlapping portion from a second server at a first interval of the first time interval. If the first segment does not overlap with the at least one segment, the processor may receive the second video from the second server according to a second transmission standard at a second interval of a second time interval different from the first time interval.
[0021] According to an embodiment, the processor can determine a first transmission quality from a first server providing the first video of the live channel. Based on the first transmission quality, the processor can receive a plurality of remaining segments of the first video on a time frame at any one of low quality, medium quality, and high quality and store them in a buffer of the storage unit.
[0022] According to an embodiment, the processor can display the plurality of remaining segments stored in the buffer in the live playback mode through the application program. The processor can receive the second video from a second server providing the second video, the second video having an index that follows the index of the last segment of the plurality of remaining segments. The processor can control the second video to play starting from the segment of the index.
[0023] According to an embodiment, the processor can determine a second transmission quality from a second server providing the second video. Based on the first transmission quality and the second transmission quality, the processor can determine the reception time of the second video. If the second transmission quality is higher than the first transmission quality, the processor can receive the second video starting from the time of the first index of the first segment of the plurality of remaining segments. The processor can control the second video to be played starting from the segment of the first index.
[0024] According to an embodiment, the plurality of residual segments may include a first segment, a second segment, and a third segment. If it is determined that the second transmission quality from the second segment is higher than the first transmission quality, the processor may receive the second video from a second point in time of the second index of the second segment. If it is determined that the second transmission quality from the third segment is higher than the first transmission quality, the processor may receive the second video from a third point in time of the third index of the third segment. The processor may control the second video to be played from the second segment or the third segment.
[0025] According to an embodiment, the processor may receive a first switching input that switches to the first video at a first time point while the second video is being played. The processor may receive a second switching input that switches to the second video at a second time point while the first video is being played. The processor may determine whether the last playback time point of the second video is a later time point than the last playback time point of the first video. Based on the determination that it is a later time point, the processor may play the second video starting from the segment corresponding to the last playback time point of the second video.
[0026] According to an embodiment, the processor can determine whether the last playback time of the second video is a previous time point prior to the last playback time of the first video. Based on the determination that it is a previous time point, the processor can play a plurality of remaining segments associated with the first video through the application program, starting from the segment corresponding to the last playback time of the first video. The processor can control the application program to play subsequent segments of the second video received through the second server.
[0027] A control method for a display device that performs a switching of content playback modes according to another aspect of the present disclosure is performed by a processor, and the method comprises: a first video playback process of playing a first video of specific content in a live playback mode via an IP-based live channel; a user input receiving process of receiving a user input from a remote control device to play a second video based on VOD of the specific content; a playback information acquisition process of acquiring address information capable of playing the second video; a VOD playback preparation process of changing to a VOD playback mode so that the second video can be played in an application program that plays the first video when the user input is received while playing the first video; a residual segment display process of displaying a plurality of residual segments associated with the first video stored in a storage unit in the live playback mode through the application program; and a second video playback process in which the application program plays the second video received through the address information in the VOD playback mode.
[0028] According to the present specification, the continuity and quality of the content can be maintained when switching playback modes between real-time broadcasting and video-on-demand of the content.
[0029] According to the present specification, search and fast-forwarding functions are not provided on the IP-based live channel UI, but are intended to provide search and fast-forwarding functions by switching to VOD playback mode.
[0030] According to the present specification, when playing a first video of content currently being played live as a second video of VOD, previously received segments can be reused depending on the transmission quality and image quality. Accordingly, the continuity of the content can be guaranteed even if the transmission standard, video format / image quality, etc., are changed.
[0031] According to the present specification, previously received segments can be reused or the position of the first segment received based on VOD can be adjusted depending on transmission quality and image quality. Accordingly, issues such as buffering or screen stuttering can be resolved when switching the playback mode of content due to transmission standards, timing between content, video format / image quality, etc.
[0032] According to the present specification, when watching an IP-based live channel, the same content can be played seamlessly as VOD.
[0033] According to the present specification, by seamlessly switching from a live channel to VOD, content consumption can be activated, thereby increasing the user's total viewing time.
[0034] According to the present specification, content consumption can be activated by seamlessly switching to VOD, and advertising revenue can be maximized by providing advertisements during or after the completion of content playback.
[0035] Further scopes of the applicability of the present invention will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present invention are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present invention, should be understood as being given merely as examples.
[0036] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure.
[0037] FIG. 2 is a drawing for explaining a content server according to an embodiment of the present disclosure.
[0038] FIG. 3 is a drawing for explaining a content provision system according to an embodiment of the present disclosure.
[0039] Figure 4 shows an example of changing to VOD playback mode of the same content during live content playback.
[0040] Figure 5 shows a configuration in which the display device of Figure 4 interacts with first and second servers that provide first and second videos.
[0041] Figure 6 shows the structure of residual segments with different image quality in live playback mode and segments in VOD playback mode.
[0042] Figure 7 shows a screen configuration that displays thumbnails of multiple contents and allows playing content of a specific episode based on a selection input in the area where the thumbnails are displayed.
[0043] FIG. 8 shows the configurations of segments of the first and second videos transmitted by the first and second transmission standards.
[0044] Figure 9 shows a configuration that distinguishes multiple residual segments and the first segment to be received in VOD playback mode by index.
[0045] Figure 10 shows a flowchart of a control method for a display device that performs a playback mode switching of content.
[0046] Figure 11 shows a flowchart of a channel and content switching method in relation to the control method of Figure 10.
[0047] Figure 12 shows a flowchart of a content switching method based on transmission quality in relation to the control method of Figure 10.
[0048] FIG. 13 shows a flowchart of a content switching method that determines when the first segment of the second video is received by comparing the first and second transmission quality.
[0049] It should be noted that technical terms used in this specification are used merely to describe specific embodiments and are not intended to limit the invention. Additionally, singular expressions used in this specification include plural expressions unless the context clearly indicates otherwise. The suffixes "module" and "part" for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not inherently possess distinct meanings or roles.
[0050] In this specification, terms such as "composed of" or "comprising" should not be interpreted as necessarily including all of the various components or steps described in the specification, and should be interpreted as potentially excluding some of the components or steps, or including additional components or steps.
[0051] In addition, when describing the technology disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the technology disclosed in this specification, such detailed description is omitted.
[0052] In addition, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification, and the technical concept disclosed in this specification is not limited by the attached drawings; it should be understood that they include all modifications, equivalents, and substitutions that fall within the concept and technical scope of the present invention. Furthermore, not only each of the embodiments described below, but also combinations of embodiments may fall within the concept and technical scope of the present invention as modifications, equivalents, and substitutions that fall within the concept and technical scope of the present invention.
[0053] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings.
[0054] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure.
[0055] Referring to FIG. 1, the display device (100) may include a broadcast receiver (130), an external device interface (135), a storage unit (140), a user input interface (150), a processor (170), a wireless communication unit (173), a voice acquisition unit (175), a display unit (180), an audio output unit (185), and a power supply unit (190).
[0056] The broadcast receiving unit (130) may include a tuner (131), a demodulating unit (132), and a network interface unit (133).
[0057] The tuner (131) can tune to a specific broadcast channel according to a channel tuning command. The tuner (131) can receive a broadcast signal for the tuned specific broadcast channel.
[0058] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.
[0059] The network interface unit (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet network. The network interface unit (133) may transmit or receive data to or from other users or other electronic devices through the connected network or another network linked to the connected network.
[0060] The network interface unit (133) can access a specific web page through a connected network or another network linked to the connected network. That is, it can access a specific web page through a network and transmit or receive data with the corresponding server.
[0061] In addition, the network interface unit (133) can receive content or data provided by a content provider or network operator. That is, the network interface unit (133) can receive content such as movies, advertisements, games, VOD, broadcast signals, and related information provided by a content provider or network provider through a network.
[0062] Additionally, the network interface unit (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the internet, content provider, or network operator.
[0063] The network interface unit (133) can select and receive a desired application among the applications that are open to the public through the network.
[0064] The external device interface unit (135) can receive an application or a list of applications within an adjacent external device and transmit it to a processor (170) or a storage unit (140).
[0065] The external device interface section (135) can provide a connection path between the display device (100) and an external device. The external device interface section (135) can receive one or more of video and audio output from an external device connected to the display device (100) wirelessly or via a wired connection, and transmit them to the processor (170). The external device interface section (135) may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.
[0066] The video signal of an external device input through the external device interface unit (135) can be output through the display unit (180). The voice signal of an external device input through the external device interface unit (135) can be output through the audio output unit (185).
[0067] The external device that can be connected to the external device interface section (135) may be any one of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB memory, or home theater, but this is merely an example.
[0068] In addition, some of the content data stored in the display device (100) can be transmitted to another user or other electronic device selected among other users or other electronic devices that are previously registered in the display device (100).
[0069] The storage unit (140) can store programs for each signal processing and control within the processor (170), and can store signal-processed video, audio, or data signals.
[0070] Additionally, the storage unit (140) may perform the function of temporarily storing video, audio, or data signals input from the external device interface unit (135) or the network interface unit (133), and may also store information regarding a predetermined image through a channel memory function.
[0071] The storage unit (140) can store an application or a list of applications input from an external device interface unit (135) or a network interface unit (133).
[0072] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit (140) and provide them to the user.
[0073] The user input interface (150) can transmit a signal input by the user to the processor (170) or transmit a signal from the processor (170) to the user. For example, the user input interface (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication, or process to transmit control signals from the processor (170) to the remote control device (200).
[0074] Additionally, the user input interface (150) can transmit control signals input from local keys (not shown), such as a power key, channel key, volume key, and setting value, to the processor (170).
[0075] The image signal processed by the processor (170) can be input to the display unit (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the processor (170) can be input to an external output device through the external device interface unit (135).
[0076] The voice signal processed by the processor (170) can be output as audio to the audio output unit (185). Additionally, the voice signal processed by the processor (170) can be input to an external output device through the external device interface unit (135).
[0077] In addition, the processor (170) can control the overall operation within the display device (100).
[0078] Additionally, the processor (170) can control the display device (100) by means of user commands or internal programs entered through the user input interface (150). The processor (170) can connect to a network to enable the user to download desired applications or application lists into the display device (100). The processor (170) may be configured to execute at least one application program to control the display device (100). An application program (10) may execute to determine whether a specific content has been purchased, played, refunded, or resold based on the viewing history and playback time of the specific content. A second application program (20) may execute to store and manage information regarding the playback history and playback time of the specific content.
[0079] The processor (170) enables the processed video or audio signal, such as channel information selected by the user, to be output through the display unit (180) or audio output unit (185).
[0080] Additionally, the processor (170) enables a video signal or audio signal from an external device, such as a camera or camcorder, which is input through the external device interface unit (135), to be output through the display unit (180) or audio output unit (185) in accordance with an external device video playback command received through the user input interface (150).
[0081] Meanwhile, the processor (170) can control the display unit (180) to display an image, for example, a broadcast image input through the tuner (131), an external input image input through the external device interface unit (135), an image input through the network interface unit, or an image stored in the storage unit (140) can be controlled to be displayed on the display unit (180). In this case, the image displayed on the display unit (180) may be a still image or a video, and may be a 2D image or a 3D image.
[0082] Additionally, the processor (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from the outside, and the content may be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.
[0083] The wireless communication unit (173) can communicate with an external device via wired or wireless communication. The wireless communication unit (173) can perform short-range communication with an external device. To this end, the wireless communication unit (173) can support short-range communication by using at least one of Bluetooth™, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. Such wireless communication unit (173) can support wireless communication between a display device (100) and a wireless communication system, between a display device (100) and another display device (100), or between a display device (100) and a network where a display device (100, or an external server) is located, through a wireless area network. The wireless area network may be a wireless personal area network.
[0084] Here, another display device (100) may be a wearable device (e.g., a smartwatch, smart glass, head-mounted display, or mobile terminal such as a smartphone) capable of exchanging (or interacting with) data with the display device (100) according to the present invention. A wireless communication unit (173) may detect (or recognize) a wearable device capable of communicating around the display device (100). Furthermore, if the detected wearable device is an authenticated device to communicate with the display device (100) according to the present invention, the processor (170) may transmit at least a portion of the data processed in the display device (100) to the wearable device through the wireless communication unit (173). Accordingly, the user of the wearable device may use the data processed in the display device (100) through the wearable device.
[0085] The voice acquisition unit (175) can acquire audio. The voice acquisition unit (175) may include at least one microphone (not shown) and can acquire audio around the display device (100) through the microphone (not shown).
[0086] The display unit (180) can generate a driving signal by converting the video signal, data signal, OSD signal processed by the processor (170) or the video signal, data signal, etc. received from the external device interface unit (135) into R, G, and B signals, respectively.
[0087] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present invention, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the actual implemented display device (100).
[0088] That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. In addition, the functions performed in each block are intended to explain embodiments of the present invention, and the specific operations or devices do not limit the scope of the present invention.
[0089] FIG. 2 is a drawing for explaining a content server according to an embodiment of the present disclosure.
[0090] The content server (300) can provide a recommendation service that recommends content that a viewer using the display device (100) may prefer.
[0091] The content server (300) may include a communication interface (310), memory (320), and a processor (330).
[0092] The content server (300) can transmit and receive data to and from at least one display device (100) via wired or wireless communication through the communication interface (310).
[0093] The memory (320) may include a content information database (321). The content information database (321) may store information related to content played on each device. For example, the content information database (321) may store content playback information, content setting information, or application installation information in association with the identification information of each device.
[0094] When the processor (330) receives a content recommendation request from a display device (100) or an external device, it can recommend content optimized for each device based on data stored in the content information database (321).
[0095] FIG. 3 is a drawing for explaining a content provision system according to an embodiment of the present disclosure.
[0096] The content provision system (1000) may include at least one display device (100), at least one remote control device (200), and a content server (300).
[0097] The processor (170) of the display device (100) can play content.
[0098] Additionally, the processor (170) can generate content playback information regarding the played content. Additionally, the processor (170) can generate content setting information, which is information regarding the quality, volume, and preferred channel status set when playing the content.
[0099] Content playback information may include at least one of content identification information, content genre information, content playback start time information, content playback end time information, and content total playback time information for the played content.
[0100] Content setting information may include at least one of quality information set for the content when playing the content, volume information, and preferred channel information regarding whether the user has registered the channel providing the content as a preferred channel.
[0101] The processor (170) can transmit device identification information of the display device (100), generated content playback information, and generated content setting information to the content server (300) through the communication interface (173). The device identification information may be unique identification information for distinguishing it from other devices.
[0102] The content server (300) can store content playback information and content setting information received from the display device (100) in the content information database (321) in association with device identification information.
[0103] Meanwhile, the processor (170) can receive a content recommendation command through the user input interface unit (150) or the voice acquisition unit (175).
[0104] When the processor (170) receives a content recommendation command, it can transmit device identification information of the display device (100) and a content recommendation request to the content server (300) through the communication interface (173).
[0105] The communication interface (310) of the content server (300) can receive device identification information and a content recommendation request from the display device (100).
[0106] The processor (330) of the content server (300) can obtain content playback information and content setting information associated with the display device (100) from the content information database (321) based on device identification information.
[0107] The processor (330) can generate content recommendation information and recommendation setting information for the display device (100) based on content playback information and content setting information. The content recommendation information may include recommended content identification information and recommended content genre information for at least one recommended content. Additionally, the recommendation setting information may include recommended image quality setting information and preferred channel information.
[0108] The processor (330) can transmit content recommendation information and recommendation setting information to the display device (100) through the communication interface (310).
[0109] The processor (170) can receive content recommendation information and recommendation setting information from the content server (300) through the communication interface (173).
[0110] The processor (170) can display at least one recommended content based on the received content recommendation information. Additionally, when a playback command for the recommended content is input through the user input interface unit (150) or the voice acquisition unit (175), the processor (170) can set the quality of the recommended content to be played based on the received recommendation setting information and play it.
[0111] The quality of recommended content is set for playback, and if a user requests a change to a preferred channel, a channel change to the preferred channel can be performed based on the preferred channel information.
[0112] Meanwhile, the display device (100) can mirror the content currently being played to an external device. The external device may include another display device or a mobile device. In this case, the mirrored content can be viewed through the external device. Therefore, viewing information regarding the mirrored content needs to serve as basic data for recommending content to the external device.
[0113] Meanwhile, when the display device (100) performs a mirroring operation to an external device, it may receive a control command from the external device to control the display device (100). The control command may include a content change command to change the content being played from the first content to the second content. When the display device (100) receives the content change command, it may play the changed content. In this case, the display device (100) needs to transmit content playback information regarding the changed content to the content server (300) as information for content recommendation to the external device.
[0114] Hereinafter, the operation process of a display device that performs a playback mode switching of content according to the present disclosure will be described. In this regard, FIG. 4 shows an example diagram in which the same content is changed to a VOD playback mode during live content playback. Meanwhile, FIG. 5 shows a configuration in which the display device of FIG. 4 interacts with first and second servers that provide first and second videos.
[0115] Referring to FIG. 4(a), a first video of a specific content (program) corresponding to live contents can be played on the display (180) of the display device (100). The first video of the specific content can be displayed on the display (180) in live playback mode via an IP-based live channel. The first video of the specific content can be displayed on the display (180) via an application program (10). The application program (10) may be a first media player capable of playing the first video of the specific content.
[0116] Referring to FIG. 4(b), the display device (100) may receive user input from a remote control device to play a second video based on VOD of specific content. Accordingly, the second video of the same specific content (program) may be displayed on the display (180) of the display device (100) in VOD (Video On Demand) playback mode. The second video of the specific content may be played through the second application program (20) of FIG. 1 and output to the display (180).
[0117] However, when a specific content is being watched as a first video in live playback mode and then switched to a second video in VOD playback mode, the second application program (20) is executed, which may cause interruptions in the playback of the specific content. Therefore, the second video of the specific content can be played through the application program (10) and output to the display (180).
[0118] Meanwhile, a progressive bar (180b) indicating the streaming time point of a second video of specific content may be displayed in the lower area of the display (180). The ratio of the position of the progress bar to the total length of the progressive bar (180b) may correspond to the ratio of the streaming time point (Ts) to the total playback time of the second video.
[0119] Referring to FIGS. 1 to 5, a display device (100) for performing a playback mode switching of content according to the present disclosure will be described. The display device (100) may be configured to include a storage unit (140), a user input interface unit (150), a display (170), and a processor (180).
[0120] The display (170) may be configured to display a first video in live playback mode via the IP-based live channel of FIG. 4(a). The user input interface unit (150) may be configured to receive user input from the remote control device (200) to play a second video based on VOD. In this regard, the remote control device (200) may include a first button (201) configured to switch to VOD content during live broadcast playback and a second button (202) configured to return to live broadcast during VOD content playback.
[0121] When the first button (201) is pressed while the first video of the live broadcast is playing, the second video of the VOD may be played starting from the point of playback of the VOD content immediately preceding the last playback point of the first video of the live broadcast. Meanwhile, when the second button (202) is pressed while the second video of the VOD is playing, the first video of the live broadcast may be played again.
[0122] The processor (170) may be operably coupled with the user input interface unit (150) and the display (180). The storage unit (140) may be configured to store segments of content or control information. The storage unit (140) may be implemented as memory or a database. The processor (170) may switch a first video in live playback mode to a second video based on VOD. The processor (170) may control the display (180) to display the second video based on VOD of FIG. 4(b).
[0123] The processor (170) can obtain address information that can play a second video based on VOD. The processor (170) can receive user input while playing a first video in live playback mode. In response to the reception of user input, the processor (170) can change to VOD playback mode so that the second video can be played in the application program that plays the first video.
[0124] The processor (170) can download a list of URLs of content from the first server (300) after the point in time when viewing began through the live channel. The processor (170) can obtain the URL of the first video from the downloaded list of URLs. The processor (170) can receive the second video from the second server (400) through the obtained URL. The processor (170) can control the application program (10) so that the second video received from the second server (400) is played through the application program (10) and its attributes are controlled.
[0125] Meanwhile, FIG. 6 illustrates the structure of residual segments having different image qualities in live playback mode and segments in VOD playback mode. The multiple segments in FIG. 6 represent segments of video content. Therefore, when a display device receives segments of video content, the received segments of video content can be played on the screen of the display device.
[0126] FIG. 6(a) illustrates the remaining segments and quality of the first to third segments transmittable in live playback mode. Referring to FIG. 1, FIG. 4(a) and FIG. 6(a), each of the remaining segments of the first video in live playback mode may be configured to have different quality. For example, the first, second, and third segments (S1, S2, S3) of the first video in live playback mode may be configured to have high quality, medium quality, and low quality, respectively. The first segment (S1) is a high-quality first segment (S1 H It can be composed of ). The second segment (S2) is a second segment (S2) of medium quality. M It can be composed of ). The third segment (S3) is a third segment (S3) of medium quality. M It can be composed of ).
[0127] FIG. 6(b) shows the remaining segments of the first to third segments of the live playback mode, the fourth segment of the second video based on VOD, and the remaining segments following therefrom. FIG. 6(c) shows the remaining segments of the first to third segments of the live playback mode, the second segment of the second video based on VOD, and the remaining segments following therefrom.
[0128] Referring to FIG. 1, FIG. 4(b) and FIG. 6(b), the third segment (S3) of medium quality M Subsequently, multiple segments of the second video based on VOD may be received. Accordingly, the fourth segment (S4) to the eighth segment (S8) of the second video based on VOD may be received. In this regard, the quality of the first to third segments of the second video based on VOD may be predicted to be of medium quality or lower. Accordingly, the third segment (S3) of the first video in live playback mode, which is of medium quality, M Following ), the fourth segment (S4) of the second video based on VOD can be delivered for the first time.
[0129] Referring to FIG. 1, FIG. 4(b) and FIG. 6(c), the third segment (S3) of medium quality M Subsequently, multiple segments of a second video based on VOD may be received. Accordingly, the second segment (S2) of the second video based on VOD H ), 3rd segment (S3 H ), the fourth segment (S4) to the eighth segment (S8) may be received. In this regard, the quality of the second and third segments of the second video based on VOD can be predicted to have high quality, which is higher than medium quality. Accordingly, the high-quality first segment (S1) of the first video in live playback mode H Following ), the second segment of the high-definition second video based on VOD (S2 H) can be delivered for the first time.
[0130] With reference to FIGS. 1 to 6, operations of the processor (170) playing residual segments are described. The processor (170) can play a plurality of residual segments associated with a first video stored in a storage unit (140) in live playback mode through an application program (10). The processor (170) can control the application program (10) to play a second video received through address information in VOD playback mode.
[0131] Meanwhile, the processor (170) may receive a control input associated with the playback of the second video from the remote control device (200). Upon receiving the control input associated with the playback of the second video, the processor (170) may control the playback of the second video through the application program (10) based on the control input. In this regard, the control input may be a user input that causes the playback of the second video to start at the same time as the last playback time of the first video. Meanwhile, the control input may control the playback attributes of the second video by being associated with at least one of playback speed, pause, seek, or resume of the second video.
[0132] Meanwhile, a display device that performs a playback mode switching of content according to the present disclosure displays thumbnails of a plurality of contents and can play content of a specific episode according to a selection input in the area where the thumbnails are displayed. In this regard, FIG. 7 shows a screen configuration that displays thumbnails of a plurality of contents and can play content of a specific episode according to a selection input in the area where the thumbnails are displayed.
[0133] Referring to FIGS. 1 through 7, the processor (170) can download representative thumbnails corresponding to the content. The processor (170) can obtain representative thumbnails of multiple episodes of the content of the second video from among the downloaded representative thumbnails. The representative thumbnails can be obtained from the manifest file of HLS (HTTP Live Streaming) or from the first server (300). The processor (170) can detect whether a selection input is received in the screen area where the obtained representative thumbnails are displayed. When a selection input is received in the screen area where the representative thumbnails are displayed, the processor (170) can control the playback of the VOD content of the corresponding episode corresponding to the screen area where the selection input was received.
[0134] The transmission speed and quality of the second video may be degraded until a certain point in time when the second video is transmitted by connecting to the second server (400). Accordingly, the processor (170) may receive segments of the second video after the index of the previously received segments of the first video.
[0135] In this regard, the processor (170) may transmit an index of the point in time when multiple remaining segments end to the second server (400) providing the second video. For example, if up to the third segment (S3) among the multiple remaining segments is received and stored in the storage unit (140), the index of the point in time when multiple remaining segments end may be set to 3. The processor (170) may receive segments of the second video after the point in time when multiple remaining segments end from the second server (400). When the second server (400) receives information that the index of the point in time when multiple remaining segments end is 3, the second server (400) may transmit the fourth segment (S4) and subsequent segments. Accordingly, the processor (170) may receive the fourth segment (S4) and subsequent segments from the second server (400).
[0136] Meanwhile, a display device that performs a playback mode switching of content according to the present disclosure may receive a second video in advance during the playback of a first video to ensure continuity when switching content. For example, a plurality of remaining segments of the first video may include a first segment (S1), a second segment (S2), and a third segment (S3).
[0137] While playing multiple remaining segments of the first video, the processor (170) may receive a fourth segment (S4) of the second video that follows the third segment (S3). When the playback of the multiple remaining segments is completed, the processor (170) may play the received fourth segment (S4) of the second video and the segments that follow the fourth segment (S4).
[0138] Meanwhile, a display device that performs the switching of the content playback mode according to the present disclosure may be configured to play another episode of VOD or return to the live channel of the corresponding program. In this regard, the processor (170) may detect whether the playback of the second video is completed in the VOD playback mode. When the playback of the second video is completed in the VOD playback mode, the processor (170) may control the display (170) to display an image or advertisement associated with the second video.
[0139] When the playback of the second video is completed in VOD playback mode, the processor (170) can control the display (180) so that a return button (181) for returning to the live channel is displayed in the first area (180R1) of the display (180). Specific content may be played in the second area (180R2) of the display (180). The last segment of the second video may be displayed in the second area (180R2) of the display (180), or any video such as an advertisement or a video related to a program (content) may be displayed. Meanwhile, when a return input for the return button (181) is received, the processor (170) can control the display (170) so that the first video is played through the live channel.
[0140] The processor (170) can control multiple screen areas (182a, 182b, 182c) or buttons to be displayed in the third area (180R3) of the display, which can play content of other episodes of the second video. If the content currently playing or finished playing is Program Episode 2, thumbnails of Program Episode 3, Program Episode 4, and Program Episode 5 following Program Episode 2 are displayed in the screen areas (182a, 182b, 182c).
[0141] The processor (170) can detect whether a selection input is received in any one of the multiple screen areas (182a, 182b, 182c) or buttons. When a selection input is detected, the processor (170) can control the display (180) so that the content of the corresponding episode of the second video corresponding to any one of the areas is played.
[0142] Meanwhile, a display device that performs the switching of the content playback mode according to the present disclosure may change the application program (e.g., media player) on which the content is played, or continue to run the previous program. In this regard, when a user input to play a second video is received while the first video is being played, the processor (170) may play the second video through the first media player of the application program (10).
[0143] If the application program is changed to play a second VOD-based video while the first video is playing in live playback mode, additional time may be required for setting changes and codec downloads. Therefore, when a user requests to play a second VOD-based video while the first video is playing in live playback mode, it is advisable to use the same application program (media player) that was previously running.
[0144] Meanwhile, the processor (170) can detect whether a selection input is received after the playback of the corresponding episode of the first video has ended. If a selection input is detected after the playback of the corresponding episode has ended, the processor (170) can play the second video through the second media player of the second application program (20). In this regard, additional setting changes and codec downloads can be performed in advance through the application program (10) before the second video of the corresponding episode, which is based on VOD, ends. Therefore, if a selection input is detected after the playback of the corresponding episode has ended, the second video can be played through the second media player optimized for VOD playback.
[0145] Meanwhile, a display device that performs a playback mode switching of content according to the present disclosure may determine the playback point of VOD content based on a switching input between the first and second videos. For example, a user may switch from a first video of a live broadcast to a second video based on VOD and watch the second video for a certain period of time or longer. Additionally, the second video may be played at high speed (e.g., 1.25x speed, 1.5x speed, 2x speed, etc.) or played by moving to a specific playback point. Meanwhile, while playing the second video, the user may switch the channel back to the live channel of the first video. In this regard, the user may intend to watch content other than the content in question on the live channel.
[0146] Therefore, if the first video is still playing on the live channel, the user may intend to watch the remainder of the first video again through the VOD playback mode. In this regard, the processor (170) may receive a first switching input that switches to the first video at a first point while the second video is playing. The first switching input may be made by selecting the return button (181) of the display. The processor (170) may receive a second switching input that switches to the second video at a second point while the first video is playing.
[0147] The processor (170) can determine whether the last playback point of the second video is a later time point than the last playback point of the first video. If the last playback point of the second video is a later time point, it is determined that a skip operation through fast playback and / or seeking for the second video has been performed. The skip operation through seeking can be performed via the input of the progressive (180b) of FIG. 4(b) or the remote control device (200) of FIG. 3. Based on the determination that it is a later time point, the processor (170) can play the second video starting from the segment corresponding to the last playback point of the second video.
[0148] Meanwhile, the processor (170) can determine whether the last playback time of the second video is a previous time point before the last playback time of the first video. If the last playback time of the second video is a previous time point, it is determined that the user did not perform a skip action through fast playback and / or navigation for the second video. Therefore, it can be determined that the user who switched back to VOD after switching to the live channel intended to watch the content on VOD again from the time of switching to the live channel.
[0149] Accordingly, based on the determination result that it is an earlier point in time, the processor (170) can play multiple remaining segments associated with the first video through the application program, starting from the segment corresponding to the last playback point of the first video. Additionally, the processor (170) can control the application program (10) to play subsequent segments of the second video received through the second server (400).
[0150] In this regard, the phrase "Playing as VOD from the current playback point of the live channel" can be displayed on the screen, and after a certain period of time, playback can automatically begin from the segment corresponding to the last playback point of the first video. Meanwhile, upon receiving user input to play from the viewing point of the previous VOD within a certain period of time, the second video can be played from the last viewing point of the previous VOD.
[0151] Meanwhile, a display device that performs the switching of content playback modes according to the present disclosure can receive and play segments having adaptive quality based on transmission quality. In this regard, the first video received in an IP-based live playback mode may consist of video segments based on MPEG-DASH (Dynamic Adaptive Streaming over HTTP) or HLS (HTTP live streaming).
[0152] MPEG-DASH is similar to HLS, another streaming protocol, in that it divides video into segments and encodes those segments at various quality levels. Accordingly, it is possible to stream video at different quality levels and change the quality level in the middle of the video stream. Meanwhile, the second video received in VOD playback mode can consist of video segments based on various transport protocols. For switching between live channels and VOD channels, the second video can also be implemented using MPEG-DASH or HLS.
[0153] The default segment length of HLS can be set to a default value of 10 seconds or 6 seconds, but can be adjusted from the default value. The segment length of MPEG-DASH can be adjusted to 2-10 seconds. The optimal segment length of MPEG-DASH can be 2-4 seconds, but is not limited to this and can be changed depending on the application. Therefore, considering the transition between MPEG-DASH and HLS-based transport protocols in live playback mode and VOD playback mode, the segment length can be set to be the same.
[0154] In this regard, FIG. 8 illustrates the configurations of segments of the first and second videos transmitted via the first and second transmission standards. Referring to FIG. 8(a), the first to third segments (S1, S2, S3) can be transmitted via the first transmission standard in live playback mode. The length of the first to third segments (S1, S2, S3) can be configured as a first time interval (T1). For example, the first time interval (T1) of the first transmission standard, such as HLS, can be set to a default value of 6 seconds.
[0155] Referring to FIG. 8(b), in VDO playback mode, the fourth segment (S4) to the eighth segment (S8) can be transmitted via the second transmission standard. In live playback mode, the third segment (S3) of medium quality M Playback is performed up to ), and the fourth segment (S4) and subsequent segments can be played back in VDO playback mode. The length of the fourth segment (S4) through the eighth segment (S8) can be set to a second time interval (T2) that is different from the first time interval (T1). For example, the second time interval (T2) of a second transmission standard such as MPEG-DASH can be set to be shorter than the first time interval (T1) of the first transmission standard. The second time interval (T2) of a second transmission standard such as MPEG-DASH can be set to 3 seconds.
[0156] Referring to FIG. 8(c), in live playback mode, the first segment (S1) of high quality H ) is played, and in VDO playback mode, the high-quality second segment (S2 H It can be played from ). In VDO playback mode, the second segment (S2 H ) to the 8th segment (S8) can be transmitted using the 2nd transmission standard. The 2nd segment (S2 H ) and the third segment (S3 H The length of ) can be composed of a first time interval (T1). Meanwhile, the length of the fourth segment (S4) to the eighth segment (S8) can be set to a second time interval (T2) different from the first time interval (T1).
[0157] Referring to FIG. 8, the length of the first to third segments (S1, S2, S3) received in live playback mode can be set as the first time interval (T1). In VOD playback mode, the length of the segment that overlaps with at least one of the first to third segments (S1, S2, S3) is set as the first time interval (T1). Meanwhile, if there are no overlapping segments in VOD playback mode, the length of the fourth segment (S4) following the third segment (S3) in VOD playback mode and the lengths of the subsequent segments can be set as the second time interval (T2), which is different from the first time interval (T1).
[0158] Regarding the dynamic adjustment of the length of video segments, the following is explained with reference to FIGS. 1 through 8. A plurality of residual segments of the first video may include a first segment (S1) to a third segment (S3). A processor (180) may receive each of the plurality of residual segments of the first video from a first server (300) according to a first transmission standard at a first interval of a first time interval (T1) and store them in a storage unit (140). The processor (180) may determine whether the first segment of the second video overlaps with at least one segment of the first segment (S1) to the third segment (S3). In this regard, the processor (180) may determine the first and second transmission quality (network speed) from the first and second servers (300, 400) providing the first and second videos.
[0159] If the first segment overlaps with at least one segment, the processor (180) can receive the segment of the second video in the overlapping portion from the second server (400) at the first interval of the first time interval (T1). If the first segment does not overlap with at least one segment, the processor (170) can receive the second video from the second server (400) at the second interval of the second time interval (T2). The second interval of the second time interval (T2) can be configured differently from the first interval of the first time interval (T1).
[0160] Whether to receive at least a portion of the content already received in live playback mode in VOD playback mode can be determined by considering the transmission quality associated with image quality. In this regard, the processor (170) can determine the first transmission quality (network speed) from the first server (300) providing the first video of the live channel. The measurement of the first transmission quality may be performed at the server (300) and the measurement value of the first transmission quality may be transmitted to the display device (100). Alternatively, the measurement of the first transmission quality may be performed at the display device (100) based on the information transmitted from the server (300).
[0161] The processor (170) can receive multiple residual segments of the first video in a time frame at any one of low quality, medium quality, or high quality based on the first transmission quality. The processor (170) can store the multiple residual segments of the first video received at any one of the quality in a buffer of the storage unit (140).
[0162] Meanwhile, in order to distinguish between multiple remaining segments and the first segment to be received in VOD playback mode and to convey information associated therewith, each video segment needs to be distinguished by an index. In this regard, FIG. 9 illustrates a configuration for distinguishing between multiple remaining segments and the first segment to be received in VOD playback mode by an index.
[0163] Referring to FIGS. 4 and 9, the first and second servers (300, 400) can manage multiple video segments of specific content through an index. The specific content (100) stored in the first and second servers (300, 400) may be configured to include an index list (1100) and MPD segments (1200).
[0164] The index list (1100) may be configured to include multiple video segments of the first video or multiple video segments of the second video. The MPD segment (1200) may include a key area (1210) and a data area (1220) composed of indices that are mapped to the indices of the index list (1100).
[0165] With reference to FIGS. 1 through 9, the operation of a display device that performs index-based playback mode switching is described. A processor (170) can display a plurality of remaining segments stored in a buffer in live playback mode through an application program (10). In this regard, the first and second videos may be transmitted in units of a plurality of segments. For example, the first and second videos may be transmitted in units of three segments. Accordingly, the first to third segments (S1, S2, S3) may be indicated by indices (1,1), (1,2), and (1,3), respectively. Meanwhile, the fourth to sixth segments (S4, S5, S6) may be indicated by indices (2,1), (2,2), and (2,3), respectively. The index method of FIG. 9 corresponds to one example, and the index method for switching between playback modes according to the present disclosure may be varied depending on the application.
[0166] The processor (170) can receive a second video having an index (2,1) that follows the index of the last segment (S3) of a plurality of remaining segments from a second server (400) that provides the second video. The processor (170) can control the second video to play starting from the segment (S4) of the index (2,1) that follows the index of the last segment (1,3).
[0167] Meanwhile, a display device that performs the switching of the content's playback mode can determine whether to reuse already received segments based on the first and second transmission quality of the first and second videos. In this regard, the processor (170) can determine the second transmission quality from the second server (400) providing the second video. Based on the first transmission quality and the second transmission quality, the processor (170) can determine the time of reception of the second video.
[0168] If the second transmission quality is higher than the first transmission quality, the processor (170) can receive the second video from the time of the first index of the first segment of the plurality of remaining segments. Accordingly, the processor (170) can control the second video to be played from the segment of the first index. If it is determined that the second transmission quality is higher than the first transmission quality, the processor can play the second video from the first segment (S1) through the first media player that is playing the first video. By playing the second video through the first media player, it is possible to provide a seamless screen without requiring time for additional setting changes and codec downloads.
[0169] Meanwhile, a display device that performs the switching of the content playback mode may reuse a portion of the received first video and play the second video starting from the segment of the index selected based on quality. A plurality of remaining segments may include the first segment (S1), the second segment (S2), and the third segment (S3).
[0170] The processor (170) can determine whether the second transmission quality from the second segment (S2) is higher than the first transmission quality. If the second transmission quality from the second segment (S2) is higher than the first transmission quality, the processor (170) can receive the second video from the second point in time of the second index (1,2) of the second segment (S2).
[0171] The processor (170) can determine whether the second transmission quality from the third segment (S3) is higher than the first transmission quality. If the second transmission quality from the third segment (S3) is higher than the first transmission quality, the processor (170) can receive the second video from the point in time of the third index (1,3) of the third segment (S3). Accordingly, the processor (170) can control the second video to be played from the second segment (S2) or the third segment (S3).
[0172] For the above, a display device for performing a content playback mode switching according to one aspect of the present disclosure has been described. Below, a control method for a display device for performing a content playback mode switching according to another aspect of the present disclosure will be described. All configurations and operations of the display device for performing the content playback mode switching described above apply to the control method below.
[0173] In this regard, FIG. 10 shows a flowchart of a control method for a display device that performs a playback mode switching of content. FIG. 11 shows a flowchart of a channel and content switching method in relation to the control method of FIG. 10. FIG. 12 shows a flowchart of a content switching method based on transmission quality in relation to the control method of FIG. 10. FIG. 13 shows a flowchart of a content switching method that determines the time when the first segment of the second video is received by comparing the first and second transmission qualities.
[0174] A flowchart of a control method for a display device that performs a playback mode switching of content is shown. Referring to FIGS. 1 to 13, the control method for switching the playback mode can be performed by a processor (170). The control method may include a first video playback process (S100), a user input reception process (S150), a playback information acquisition process (S200), a VOD playback preparation process (S300), a remaining segment display process (S400), and a second video playback process (S500).
[0175] In the first video playback process (S100), the first video of specific content can be played in live playback mode via an IP-based live channel. In the user input reception process (S150), user input can be received from a remote control device to play a second video based on VOD of specific content. When user input is received while the first video is playing, the playback information acquisition process (S200) and the VOD playback preparation process (S300) can be performed.
[0176] In the playback information acquisition process (S200), address information for playing the second video can be acquired. When user input is received while playing the first video, the VOD playback preparation process (S300) can change to VOD playback mode so that the application program playing the first video can play the second video. In the remaining segment display process (S400), multiple remaining segments associated with the first video stored in the storage unit in live playback mode can be displayed through the application program. In the second video playback process (S500), the application program can play the second video received through the address information in VOD playback mode.
[0177] Meanwhile, when a control input associated with the playback of the second video is received from a remote control device, the second video playback process (S500) can control the second video to be played through an application program based on the control input. In this regard, the control input may be a user input that causes the playback of the second video to start at the same time as the last playback time of the first video. Meanwhile, the control input may be associated with at least one of playback speed, pause, seek, or resume of the second video, thereby controlling the playback attributes of the second video.
[0178] Meanwhile, the VOD playback preparation process (S300) may include a thumbnail acquisition process (S310), a screen display process (S320), and a selection input reception process (S330). In the thumbnail acquisition process (S310), representative thumbnails corresponding to the content may be downloaded, and among the downloaded representative thumbnails, representative thumbnails of the content of multiple episodes of the second video may be acquired. The representative thumbnails may be acquired from an HLS (HTTP Live Streaming) manifest file or from a first server.
[0179] In the screen display process (S320), the acquired representative thumbnails can be displayed in different screen areas of the display. Meanwhile, the screen display process (S320) can be executed while the second video is playing. Therefore, if an input is received to play content of another episode while the content of a specific episode of the second video is playing, the screen display process (S320) and the selection input reception process (S330) can be executed.
[0180] In the selection input reception process (S330), a selection input can be received in a screen area where representative thumbnails obtained in the selection input reception process (S330) are displayed. In the second video playback process (S500), VOD content of the corresponding episode corresponding to the screen area where the selection input was received can be played. In this regard, since VOD content of another episode is played after the content viewing is completed, rather than changing from live playback mode to VOD playback mode while viewing the content, the remaining segment display process (S400) is not executed.
[0181] Meanwhile, in the VOD playback preparation process (S300), the index of the point at which a plurality of remaining segments end can be transmitted to the second server providing the second video. Additionally, in the remaining segment display process (S300), segments of the second video after the point of end can be received from the second server. The plurality of remaining segments of the first video may include a first segment, a second segment, and a third segment.
[0182] In the residual segment display process (S400), while playing multiple residual segments of the first video, the fourth segment of the second video following the third segment can be received. Therefore, the segment of the second video can be received in advance and stored in a buffer before the second video playback process (S500) is performed. When the playback of multiple residual segments is completed, the fourth segment of the second video received and the segments following the fourth segment can be played in the second video playback process (S500).
[0183] Meanwhile, the control method may further include a content / channel switching process (S600). When the playback of the second video is completed (S510) in VOD playback mode, the content / channel switching process (S600) can control the display so that a video or advertisement associated with the second video is displayed on the display.
[0184] The content / channel switching process (S600) may include a channel switching UI display process (S610), a content switching UI display process (S610b), a channel switching process (S630), and a content switching process (S630b).
[0185] When the playback of the second video is completed (S510) in VOD playback mode, the channel switching UI display process (S610) can control the display of a return button (181) (channel switching UI) that allows returning to a live channel in the first area of the display. When the playback of the second video is completed (S510) in VOD playback mode, the content switching UI display process (S610b) can control the display of multiple buttons that allow playing content of other episodes of the second video in the third area of the display.
[0186] When a return input for the return button (181) (channel switching UI) is received (S620), a channel switching process (S630) can be performed to control the display so that the first video is played through the live channel. Meanwhile, when a selection input is received (S620b) for any one of the multiple buttons (screen areas), a content switching process (S630b) can be performed to control the display so that the content of the corresponding episode of the second video corresponding to the button is played.
[0187] Meanwhile, the control method may determine the reuse of a portion of the first video segment and the reception time of the second video based on the transmission quality when switching from the first video to the second video. In this regard, the control method may further include a first transmission quality determination process (S110) and a first video storage process (S120) following the first video playback process (S100). Additionally, the control method may further include a second transmission quality determination process (S210) and a second video reception time determination process (S220) following the user input reception process (S150).
[0188] In the first transmission quality determination process (S110), the first transmission quality from the first server providing the first video of the live channel can be determined. In the first video storage process (S120), based on the first transmission quality, a plurality of residual segments of the first video on a time frame can be received at any one of low quality, medium quality, and high quality and stored in the buffer of the storage unit.
[0189] Meanwhile, the remaining segment display process (S400) can display multiple remaining segments stored in a buffer in live playback mode through an application program. Additionally, in the remaining segment display process (S400), a second video having an index that follows the index of the last segment of the multiple remaining segments can be received. Accordingly, in the second video playback process (S500), the second video can be controlled to be played starting from the segment with the index that follows the index of the last segment.
[0190] In the second transmission quality determination process (S210), the second transmission quality from the second server can be determined. The second video reception time determination process (S220) can determine the reception time of the second video based on the first transmission quality and the second transmission quality.
[0191] If it is determined (S211) that the second transmission quality is higher than the first transmission quality for all segments, the second video can be received (S221) from the time of the first index of the first segment of the plurality of remaining segments in the second video reception time determination process (S220). The plurality of remaining segments may include the first segment, the second segment, and the third segment. Accordingly, the second video playback process (S500) can control (S510) to play the second video from the segment of the first index (the first segment).
[0192] If it is determined (S212) that the second transmission quality from the second segment is higher than the first transmission quality, the second video can be received (S221) from the second time point of the second index of the second segment in the second video reception time determination process (S220). Accordingly, the second video playback process (S500) can be controlled (S520) to play the second video from the second segment.
[0193] If it is determined that the second transmission quality from the third segment is higher than the first transmission quality (S213), the second video can be received from the third point in time of the third index of the third segment in the second video reception time determination process (S220). Accordingly, the second video playback process (S500) can control (S530) to play the second video from the third segment.
[0194] Meanwhile, if it is determined that the second transmission quality is not higher than the first transmission quality, the second video can be received from the fourth time point of the fourth index of the fourth segment in the second video reception time determination process (S220). Accordingly, the second video playback process (S500) can control (S540) to play the second video from the fourth segment.
[0195] For the above, a display device and a control method thereof for performing a playback mode switching of content according to the present disclosure have been described. In this regard, while watching content of a live channel in a channel service operated by a manufacturer of the display device, a user can watch VOD content. In this regard, switching between live content and VOD content is possible by pressing the left or right button of a remote control device.
[0196] Meanwhile, a seamless transition to VOD is possible by obtaining the VOD URL based on the ID of the currently playing live content. In this regard, a continuous viewing experience is provided by reusing the media player used for watching the live broadcast for VOD content playback. Therefore, it is possible to break free from app dependency when switching between content playback modes. By switching between content playback modes in a manner independent of app dependency, VOD content that is not implemented within the live channel app can also be played through the app.
[0197] In addition, it is possible to restore the playback position using current playback status information and transition to VOD content without interruption while maintaining the currently downloaded buffer. In this regard, after starting to watch a live broadcast, URLs of the related VOD list are downloaded, and the representative thumbnail of each VOD can be downloaded via network communication. The representative thumbnail of each VOD can be obtained from the HLS manifest file or via the URL of the thumbnail image file from the server.
[0198] Meanwhile, the manufacturer operating the channel already stores the content on its server in the form of VOD for the majority of programs, even though the content is live. Users can freely browse specific content on the live channel, just as they would when watching VOD, and quickly play and consume the content.
[0199] Meanwhile, if the user switches from the channel to another channel and then switches back to the current channel, a message indicating that the user has already finished watching can be displayed on the screen. If the user wishes to return to the live channel, they can do so by selecting the 'LIVE' button provided in the GUI.
[0200] The technical effects of a display device and a control method for performing a playback mode switching of content according to the present disclosure may be summarized as follows, but are not limited thereto.
[0201] According to the present specification, the continuity and quality of the content can be maintained when switching playback modes between real-time broadcasting and video-on-demand of the content.
[0202] According to the present specification, search and fast-forwarding functions are not provided on the IP-based live channel UI, but are intended to provide search and fast-forwarding functions by switching to VOD playback mode.
[0203] According to the present specification, when playing a first video of content currently being played live as a second video of VOD, previously received segments can be reused depending on the transmission quality and image quality. Accordingly, the continuity of the content can be guaranteed even if the transmission standard, video format / image quality, etc., are changed.
[0204] According to the present specification, previously received segments can be reused or the position of the first segment received based on VOD can be adjusted depending on transmission quality and image quality. Accordingly, issues such as buffering or screen stuttering can be resolved when switching the playback mode of content due to transmission standards, timing between content, video format / image quality, etc.
[0205] According to the present specification, when watching an IP-based live channel, the same content can be played seamlessly as VOD.
[0206] According to the present specification, by seamlessly switching from a live channel to VOD, content consumption can be activated, thereby increasing the user's total viewing time.
[0207] According to the present specification, content consumption can be activated by seamlessly switching to VOD, and advertising revenue can be maximized by providing advertisements during or after the completion of content playback.
[0208] Further scopes of the applicability of the present invention will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present invention are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present invention, should be understood as being given merely as examples.
[0209] The foregoing disclosure may be implemented as computer-readable code on a medium on which a program is recorded. A computer-readable medium includes all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include a Hard Disk Drive (HDD), a Solid State Disk (SSD), a Silicon Disk Drive (SSD), ROM, RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc., and also include implementations in the form of a carrier wave (e.g., transmission over the Internet). Additionally, the computer may include a control unit (180) of a terminal. Accordingly, the above detailed description should not be interpreted restrictively in all respects and should be considered exemplary. The scope of the invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the invention are included within the scope of the invention.
Claims
1. A display device that performs switching of content playback modes, A display that plays a first video of specific content in live playback mode via an IP-based live channel; A user input interface unit configured to receive user input from a remote control device to play a second video based on VOD of the specific content; and It includes a processor operably coupled to the display and controlling the conversion of the first video into the second video and displaying it on the display. The above processor is, Obtain address information capable of playing the above second video, and When the user input is received while the first video is being played, the application program playing the first video changes to a VOD playback mode so that the second video can be played, and In the above live playback mode, a plurality of remaining segments associated with the first video stored in the storage unit are played through the application program, and A display device that controls the application program to play the second video received through the address information in the VOD playback mode.
2. In Paragraph 1, The above processor is, When a control input related to the playback of the second video is received from the remote control device, the second video is controlled to be played through the application program based on the control input, and A display device, wherein the control input is associated with at least one of the user input that causes the playback of the second video to start at the same time as the last playback time of the first video, playback speed of the second video, pause, seek, or resume.
3. In Paragraph 1, The above processor is, Download a list of URLs of content from the first server that is available after the point in time when viewing began through the above live channel, and Obtain the URL of the first video from the above list of downloaded URLs, and Receive the second video from the second server via the above-mentioned obtained URL, and A display device that controls the application program to play the second video received from the second server and control its attributes through the application program.
4. In Paragraph 3, The above processor is, Download the representative thumbnails corresponding to the above contents, and Among the above-mentioned downloaded representative thumbnails, representative thumbnails of the contents of multiple episodes of the above-mentioned second video are obtained, and The above representative thumbnail is obtained from the HLS (HTTP Live Streaming) manifest file or the above first server, and A display device that, when a selection input is received in a screen area where the above-mentioned representative thumbnails are displayed, the processor plays the VOD content of the corresponding episode corresponding to the screen area where the selection input was received.
5. In Paragraph 1, The above processor is, The index at the time when the above plurality of remaining segments end is transmitted to the second server providing the second video, and A display device that receives segments of the second video after the termination point from the second server.
6. In Paragraph 5, The above processor is, The plurality of remaining segments of the first video include a first segment, a second segment and a third segment, and While playing the plurality of remaining segments of the first video, receiving the fourth segment of the second video that follows the third segment, A display device that plays the fourth segment of the received second video and the segments following the fourth segment when the playback of the plurality of remaining segments is completed.
7. In Paragraph 1, The above processor is, When the playback of the second video is completed in the above VOD playback mode, control is made so that a video or advertisement associated with the second video is displayed on the display, and When the playback of the second video is completed in the above VOD playback mode, control is made so that a return button to return to the live channel is displayed in the first area of the display, and A display device that controls the display to play the first video through the live channel when a return input for the above return button is received.
8. In Paragraph 7, The above processor is, Controls that a plurality of screen areas or buttons capable of playing content of other episodes of the second video are displayed in the third area of the display, and A display device that controls the display so that when a selection input is received at any one of the plurality of screen areas or buttons, the content of the corresponding episode of the second video corresponding to any one of the areas is played.
9. In Paragraph 8, The above processor is, When the user input is received while the first video is being played, the second video is played through the first media player of the application program, and A display device that plays the second video through the second media player of the second application program when the selection input is received after the playback of the corresponding episode of the first video is finished.
10. In Paragraph 3, The plurality of remaining segments of the first video include a first segment, a second segment and a third segment, and The above processor is, Each of the plurality of remaining segments of the first video is received from the first server according to the first transmission standard at a first interval of the first time interval and stored in the storage unit, Determining whether the first segment of the second video overlaps with at least one segment among the first to third segments, and If the first segment overlaps with at least one segment, the segment of the second video of the overlapping portion is received from the second server at a first interval of the first time interval, and A display device that receives the second video from the second server in a second transmission standard at a second interval of a second time interval different from the first time interval, if the first segment does not overlap with the at least one segment.
11. In Paragraph 1, The above processor is, Determining the first transmission quality from the first server providing the first video of the above live channel, and A display device that, based on the first transmission quality, receives a plurality of residual segments of the first video on a time frame at any one of low quality, medium quality, and high quality and stores them in a buffer of the storage unit.
12. In Paragraph 11, The above processor is, In the above live playback mode, the plurality of remaining segments stored in the buffer are displayed through the application program, and Receiving the second video from a second server providing the second video, the second video having an index following the index of the last segment of the plurality of remaining segments, and A display device that controls the playback of the second video from the segment of the index.
13. In Paragraph 11, The above processor is, Determining the second transmission quality from the second server providing the second video, and Based on the first transmission quality and the second transmission quality, the reception time of the second video is determined, and If the second transmission quality is higher than the first transmission quality, the second video is received from the time of the first index of the first segment of the plurality of remaining segments, and A display device that controls the playback of the second video from the segment of the first index.
14. In Paragraph 13, The above plurality of remaining segments include a first segment, a second segment and a third segment, and The above processor is, If it is determined that the second transmission quality from the second segment is higher than the first transmission quality, the second video is received from the second time point of the second index of the second segment, and If it is determined that the second transmission quality from the third segment is higher than the first transmission quality, the second video is received from the third time point of the third index of the third segment, and A display device that controls the playback of the second video from the second segment or the third segment.
15. In Paragraph 3, The above processor is, Receiving a first switching input that switches to the first video at a first point in time while playing the second video, and Receiving a second switching input that switches to the second video at a second point in time while playing the first video, and Determining whether the last playback time of the second video is a later time point than the last playback time of the first video, and A display device that plays the second video starting from the segment corresponding to the last playback time of the second video, based on the result of the judgment that the second video is a later time point.
16. In Paragraph 14, The above processor is, Determining whether the last playback time of the second video is a previous time point prior to the last playback time of the first video, and Based on the determination result that the above-mentioned previous point in time is, a plurality of remaining segments associated with the first video are played through the application program starting from the segment corresponding to the last playback point of the first video, and A display device that controls the application program to play subsequent segments of the second video received through the second server.
17. A control method for a display device that performs a playback mode switching of content, wherein the method is performed by a processor, and the method comprises: A first video playback process that plays a first video of specific content in live playback mode via an IP-based live channel; A user input receiving process for receiving user input to play a second video based on VOD of the specific content from a remote control device; A playback information acquisition process for acquiring address information capable of playing the second video; A VOD playback preparation process that, upon receiving user input while playing the first video, changes the application program playing the first video to a VOD playback mode so that the second video can be played; A residual segment display process for displaying a plurality of residual segments associated with the first video stored in the storage unit in the above live playback mode through the application program; and A control method comprising a second video playback process in which the above application program plays the second video received through the address information in the above VOD playback mode.
18. In Paragraph 17, When a control input associated with the playback of the second video is received from the remote control device, the second video playback process controls the second video to be played through the application program based on the control input, and The control input is associated with at least one of the user input that causes the second video to be played at the same playback time as the first video, playback speed of the second video, pause, seek, or resume, and In the process of acquiring the above playback information, a list of URLs of content after the point in time when viewing began through the above live channel is downloaded from the first server, and the URL of the first video is obtained from the downloaded list of URLs. A display device in which the second video is received from the second server via the above-mentioned obtained URL, and the received second video is played through the application program during the second video playback process and its attributes are controlled.
19. In Paragraph 18, The above VOD playback preparation process is, A thumbnail acquisition process for downloading representative thumbnails corresponding to the above contents and acquiring representative thumbnails of multiple episodes of the content of the second video among the downloaded representative thumbnails - the representative thumbnails are acquired from an HLS (HTTP Live Streaming) manifest file or from the first server; and It includes a selection input receiving process for receiving a selection input in a screen area where the above-mentioned representative thumbnails are displayed, and A display device in which, when the above selection input is received, the VOD content of the corresponding episode corresponding to the screen area where the above selection input was received is played during the second video playback process.
20. In Paragraph 18, The method further includes a content / channel switching process that controls the display of a video or advertisement associated with the second video when the playback of the second video is completed in the above VOD playback mode, and The above content / channel switching process is, A channel switching UI display process that controls a return button to be displayed in the first area of the display to return to the live channel when the playback of the second video is completed in the above VOD playback mode; A content switching UI display process that controls a plurality of buttons capable of playing content of other episodes of the second video to be displayed in the third area of the display; A channel switching process for controlling the display to play the first video through the live channel when a return input for the above return button is received; and A control method comprising a content switching process that controls the display to play the content of the corresponding episode of the second video corresponding to the button when a selection input is received on any one of the plurality of buttons.