Display system for output image synchronization, and display method using same
The display system and method address playback time errors by determining device roles within sync groups and using multicast protocols to synchronize image playback, ensuring consistent output across devices in diverse network environments.
Patent Information
- Application Number
- PCT/KR2024/003363
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-18
- Filing Date
- 2024-03-18
- Publication Date
- 2024-11-21
AI Technical Summary
When multiple electronic devices share content, playback time errors can occur due to varying network latency, necessitating a technology to continuously synchronize the playback time of output images across devices.
A display system and method that determines whether a display device operates as a master or client within a sync group, synchronizing playback time using multicast communication protocols, master playback information, and user settings to maintain seamless image synchronization across devices in changing environments.
Ensures seamless synchronization of output images between devices even in varying network conditions and sync group configurations, maintaining consistent playback without additional configuration for synchronization.
Smart Images

Figure KR2024003363_21112024_PF_FP_ABST
Abstract
Description
Display system for output image synchronization and display method using the same
[0001] Various embodiments of the present disclosure relate to a display system for output image synchronization and a display method using the same.
[0002] A variety of electronic devices, such as smartphones, TVs, tablet PCs, portable multimedia players (PMPs), personal digital assistants (PDAs), laptop personal computers (PCs), and wearable devices, are becoming increasingly widespread. In particular, the increasing use of electronic devices is driving the need for content sharing between them. For example, one electronic device can share content with another.
[0003] Meanwhile, when multiple electronic devices share content, playback time discrepancies may occur between the output images from each device. For example, if network latency—the time it takes for time information transmitted by a server to synchronize electronic devices to reach each playback device—varies depending on the wireless network environment of each electronic device, playback time discrepancies may occur between electronic device content.
[0004] Therefore, when multiple electronic devices share content, a technology is required that can continuously synchronize the playback time of output images between the electronic devices.
[0005] Various embodiments of the present disclosure can provide a display system and a display method using the same, which determine whether a display device will operate as a master device or a client device within a sync group according to a change in the configuration of the sync group and synchronize the playback time of an output image between the master device and the client device.
[0006] A display system according to embodiments of the present disclosure may include a host and at least one display device that receives a video playback signal from the host. The at least one display device may recognize a sync group based on the video playback signal. The at least one display device may determine whether to operate as a master device or a client device within the sync group. The at least one display device may synchronize a playback time of an output video with at least one other display device based on master playback information from the master device.
[0007] In one embodiment, the at least one display device may search for the master device within the sync group based on a multicast communication protocol, and, if the master device exists within the sync group, determine to operate as the client device within the sync group.
[0008] In one embodiment, the at least one display device can search for the master device within the sync group based on a multicast communication protocol, and if the master device does not exist within the sync group, compare priorities with at least one other display device within the sync group to determine whether to act as the master device or the client device.
[0009] In one embodiment, the master device may transmit the master playback information including at least one of a playback start PTS, a current output PTS, and a buffering time to the client device at predetermined intervals.
[0010] In one embodiment, the client device can synchronize the playback time of the output video with the master device by controlling at least one of playback start time, playback speed, and buffering based on the master playback information.
[0011] In one embodiment, when the master device is removed from the sync group, the at least one display device can re-determine whether to operate as the master device or the client device within the sync group.
[0012] In one embodiment, when the master device within the first sync group changes to the second sync group, the master device may determine to operate as the client device within the second sync group.
[0013] In one embodiment, when the master device and the client device within the first sync group are simultaneously changed to the second sync group, the at least one display device can maintain a decision in the second sync group as to whether to operate as the master device or the client device within the first sync group.
[0014] In one embodiment, when the master device and the client device within the sync group are pre-designated according to user settings, the at least one display device can determine an operation as a pre-designated device among the master device and the client device without searching for the master device within the sync group based on a multicast communication protocol.
[0015] In one embodiment, the sync group may include at least one of a channel sharing group, a split screen playback group, a content sharing group, and an application sharing group.
[0016] A display method according to embodiments of the present disclosure may include an operation in which at least one display device receives a video playback signal from a host, an operation in which the at least one display device recognizes a sync group based on the video playback signal, an operation in which the at least one display device determines whether to operate as a master device or a client device within the sync group, and an operation in which the at least one display device synchronizes a playback time of an output video with at least one other display device based on master playback information from the master device.
[0017] In one embodiment, the operation of determining whether the at least one display device will operate as a master device or a client device within the sync group may include the operation of searching for the master device within the sync group based on a multicast communication protocol, and, if the master device is present within the sync group, determining that the display device will operate as the client device within the sync group.
[0018] In one embodiment, the operation of determining whether the at least one display device will operate as a master device or a client device within the sync group may include the operation of searching for the master device within the sync group based on a multicast communication protocol, and, if the master device does not exist within the sync group, the operation of comparing priorities with at least one other display device within the sync group to determine whether the display device will operate as the master device or the client device.
[0019] In one embodiment, the master device may transmit the master playback information including at least one of a playback start PTS, a current output PTS, and a buffering time to the client device at predetermined intervals.
[0020] In one embodiment, the client device can synchronize the playback time of the output video with the master device by controlling at least one of playback start time, playback speed, and buffering based on the master playback information.
[0021] In one embodiment, if the master device is removed from the sync group, the operation may further include re-determining whether the at least one display device will operate as the master device or the client device within the sync group.
[0022] In one embodiment, the method may further include an operation of determining that the master device operates as the client device within the second sync group when the master device within the first sync group changes to the second sync group.
[0023] In one embodiment, when the master device and the client device within the first sync group are simultaneously changed to the second sync group, the operation may further include maintaining in the second sync group a decision as to whether the at least one display device will operate as the master device or the client device within the first sync group.
[0024] In one embodiment, the operation of determining whether the at least one display device will operate as a master device or a client device within the sync group may include, if the master device and the client device within the sync group are pre-designated according to user settings, the operation of determining that the at least one display device operates as a pre-designated device among the master device and the client device without searching for the master device within the sync group based on a multicast communication protocol.
[0025] In one embodiment, the sync group may include at least one of a channel sharing group, a split screen playback group, a content sharing group, and an application sharing group.
[0026] According to various embodiments of the present disclosure, the display system of the present disclosure and the display method using the same can determine whether a display device will operate as a master device or a client device within a sync group according to a change in the configuration of the sync group.
[0027] Therefore, the display system of the present disclosure and the display method using the same can seamlessly synchronize output images between display devices even in various environments where the configuration of the sync group changes.
[0028] The effects that can be obtained from the exemplary embodiments of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly derived and understood by those skilled in the art to which the exemplary embodiments of the present disclosure pertain from the following description. In other words, unintended effects resulting from implementing the exemplary embodiments of the present disclosure can also be derived by those skilled in the art from the exemplary embodiments of the present disclosure.
[0029] FIG. 1 illustrates a display system according to one embodiment.
[0030] FIG. 2 illustrates a block configuration of a display device according to one embodiment.
[0031] FIG. 3 illustrates a master device search operation of a display device according to one embodiment.
[0032] FIG. 4 illustrates a master device and a client device within a sync group according to one embodiment.
[0033] FIG. 5 illustrates a playback time synchronization operation of an output image according to one embodiment.
[0034] FIG. 6 illustrates the operation of a display device when a master device is removed from a sync group according to one embodiment.
[0035] FIG. 7 illustrates an operation in which a master device and a client device are re-determined within a sync group according to one embodiment.
[0036] FIG. 8 illustrates the operation of a display device after a sync group has been changed according to one embodiment.
[0037] FIG. 9 illustrates the operation of a display device when the sync groups of a master device and a client device are changed simultaneously according to one embodiment.
[0038] FIG. 10 illustrates the operation of a display device when a master device and a client device are pre-designated according to user settings according to one embodiment.
[0039] Figure 11 illustrates types of sink groups according to one embodiment.
[0040] Figure 12 illustrates an operational flow of a display method according to one embodiment.
[0041] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.
[0042] FIG. 1 illustrates a display system (100) according to one embodiment.
[0043] Referring to FIG. 1, a display system (100) may include a host (110) and at least one display device (120a, 120b, …120n).
[0044] The host (110) can receive an input signal from an external device. The host (110) can generate an image reproduction signal based on the input signal. The host (110) can transmit the image reproduction signal to at least one display device (120a, 120b, ...120n). In addition, the host (110) can control at least one of the screen size, resolution, brightness, and contrast of an image output from at least one display device (120a, 120b, ...120n). The host (110) can be compatible with various types of display devices by supporting various interfaces such as HDMI, DisplayPort, and DVI.
[0045] The display devices (120a, 120b, …120n) can receive an image reproduction signal from the host (110). The display devices (120a, 120b, …120n) can display an output image based on the image reproduction signal. For example, each of the display devices (120a, 120b, …120n) can display the same output image. For example, each of the display devices (120a, 120b, …120n) can display a different output image.
[0046] Display devices (120a, 120b, ...120n) may be included in a predetermined sync group (e.g., Sync group 1, Sync group 2) based on a video reproduction signal. A sync group may be a group of display devices (120a, 120b, ...120n) that need to synchronize the reproduction time of output images. For example, display devices (120a, 120b, ...120n) included in the same sync group may display the same output image. For example, display devices (120a, 120b, ...120n) included in the same sync group may display a single output image by dividing it.
[0047] The display system (100) of the present disclosure can determine whether a display device (120a, 120b, ...120n) will operate as a master device or a client device within a sync group according to a change in the configuration of the sync group. In addition, the display system (100) can synchronize the playback time of output images between the master device and the client devices.
[0048] For example, the display devices (120a, 120b, ...120n) can recognize a sync group based on the image playback signal. For example, the display devices (120a, 120b, ...120n) can determine whether to operate as a master device or a client device within the sync group. For example, the display devices (120a, 120b, ...120n) can synchronize the playback time of an output image with at least one other display device based on the master playback information.
[0049] FIG. 2 illustrates a block configuration of a display device (200) according to one embodiment.
[0050] The display device (200) of FIG. 2 may be the display device of FIG. 1 (e.g., 120a, 120b, …120n).
[0051] The display device (200) may be, but is not limited to, a smartphone, tablet PC, PC, smart TV, mobile phone, PDA (personal digital assistant), laptop, media player, micro server, digital broadcasting terminal, navigation, kiosk, home appliance, and other mobile or non-mobile computing devices. In addition, the display device (200) may be a wearable terminal such as a watch or glasses that can perform various computing functions such as video viewing and communication. The display device (200) may be a terminal in various forms without being limited to the above-described contents.
[0052] According to one example, the memory (220) is a storage medium used by the display device (200) and can store data such as at least one command (221) or setting information corresponding to at least one program. The program may include an operating system (OS) program and various application programs.
[0053] In one example, the memory (220) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable ROM (EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk, and an optical disk.
[0054] According to one example, the video input unit (230) can receive video and video information through a tuner (not shown), an input / output unit (not shown), or a communication unit (250). The video input unit (230) can include at least one of the tuner and the input / output unit. The tuner can select only the frequency of a broadcast channel to be received by the display device (200) from among many radio wave components through amplification, mixing, resonance, etc. of a broadcast signal received wirelessly or wiredly. The broadcast signal can include video, audio, and additional data (e.g., an Electronic Program Guide (EPG)). The tuner can receive broadcast channels (or, viewing images) from various broadcast sources such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, and Internet broadcasting. The tuner can be implemented as an integrated unit with the display device (200) or as a separate tuner electrically connected to the display device (200). The above input / output unit may include at least one of an HDMI (High Definition Multimedia Interface) input port, a component input jack, a PC input port, and a USB input jack, which can receive images and image information from an external device of the display device (200) under the control of the processor (210). It is obvious to those skilled in the art that the above input / output unit may be added, deleted, and / or changed depending on the performance and structure of the display device (200).
[0055] According to one example, the display (240) can perform functions for outputting information in the form of numbers, characters, images, and / or graphics. The display (240) can include at least one hardware module for outputting. The at least one hardware module can include, for example, at least one of a Liquid Crystal Display (LCD), a Light Emitting Diode (LED), a Light Emitting Polymer Display (LPD), an Organic Light Emitting Diode (OLED), an Active Matrix Organic Light Emitting Diode (AMOLED), or a Flexible LED (FLED). The display (240) can display a screen corresponding to data received from the processor (210). The display (240) may be referred to as an 'output unit', a 'display unit', or other terms having an equivalent technical meaning thereto.
[0056] According to an example, the communication unit (250) may provide a wired / wireless communication interface that enables communication with an external device. The communication unit (250) may include at least one of a wired Ethernet, a wireless LAN communication unit, and a short-range communication unit. The wireless LAN communication unit may include, for example, Wi-Fi, and may support the wireless LAN standard (IEEE802.11x) of the Institute of Electrical and Electronics Engineers (IEEE). The wireless LAN communication unit may be wirelessly connected to an AP (Access Point) under the control of the processor (210). The short-range communication unit may wirelessly perform short-range communication with an external device under the control of the processor (210). Short-range communication may include Bluetooth, Bluetooth Low Energy, infrared communication (IrDA: Infrared Data Association), UWB (Ultra WideBand), WiFi Direct, and NFC (Near Field Communication). The above external devices may include server devices that provide video services, etc., and mobile terminals (e.g., smartphones, tablets, etc.).
[0057] According to one example, the processor (210) may execute at least one instruction (221) stored in the memory (220) to perform calculations or data processing related to control and / or communication of at least one other component of the display device (200). The processor (210) may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a micro controller unit (MCU), a sensor hub, a supplementary processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA), and may have multiple cores.
[0058] The processor (210) can recognize a sync group based on a video playback signal received from a host (e.g., the host (110) of FIG. 1). The processor (210) can determine whether the display device (200) will operate as a master device or a client device within the sync group. The processor (210) can synchronize the playback time of an output video with at least one other display device based on the master playback information.
[0059] FIG. 3 illustrates a master device search operation of a display device according to one embodiment, FIG. 4 illustrates a master device and a client device within a sync group according to one embodiment, and FIG. 5 illustrates a playback time synchronization operation of an output image according to one embodiment.
[0060] Referring to FIG. 3, at least one display device (300a, 300b, 300c, …300n) can recognize a sync group based on a video playback signal received from a host. At least one display device (300a, 300b, 300c, …300n) can determine whether to operate as a master device or a client device within the sync group.
[0061] At least one display device (300a, 300b, 300c, …300n) can discover the master device within the sync group based on a multicast communication protocol.
[0062] In one embodiment, when the master device exists within the sync group, at least one display device (300a, 300b, 300c, …300n) may be determined to operate as the client device within the sync group.
[0063] In one embodiment, if there is no master device within the sync group, at least one display device (300a, 300b, 300c, ...300n) may compare priorities with at least one other display device within the sync group. For example, if it has a higher priority than at least one other display device, at least one display device (300a, 300b, 300c, ...300n) may be determined to operate as the master device. For example, if it has a lower priority than at least one other display device, at least one display device (300a, 300b, 300c, ...300n) may be determined to operate as a client device. For example, at least one display device (300a, 300b, 300c, …300n) can determine the priority among at least one display device (300a, 300b, 300c, …300n) based on a multicast address, but it will be understood by those skilled in the art that the priority determination criteria are not limited thereto.
[0064] Referring to FIGS. 4 and 5, at least one display device (410, 420a, 420b, ...420n) within a sync group can synchronize the playback time of an output image with at least one other display device based on master playback information. For example, at least one display device (410) can be a master device. For example, at least one display device (420a, 420b, ...420n) can be a client device.
[0065] The master device (410) can transmit master playback information (MPD) to client devices (420a, 420b, …420n) based on a multicast communication protocol. For example, the master device (410) can perform data communication with the client devices (420a, 420b, …420n) using at least one of the User Datagram Protocol (UDP) protocol and the Internet Group Management Protocol (IGMP) protocol.
[0066] For example, the master device (410) can transmit master playback information (MPD) including at least one of a playback start PTS (Playback Presentation Time Stamp), a current output PTS (Current Output Presentation Time Stamp), and a buffering time to the client devices (420a, 420b, ...420n) at regular intervals. The master device (410) can synchronize output image playback between at least one display device (410, 420a, 420b, ...420n) within the sync group based on the master playback information (MPD).
[0067] The playback start PTS is a value indicating the point in time at which playback of the output video begins, and can be used to synchronize the times at which playback of the output video begins. For example, the master device (410) can transmit the playback start PTS to the client devices (420a, 420b, … 420n), thereby allowing each client device (420a, 420b, … 420n) to start playback of the output video at the same point in time.
[0068] The current output PTS indicates the PTS value of the output image currently displayed on the client devices (420a, 420b, …420n), through which the master device (410) can determine the status of the output image of the client devices (420a, 420b, …420n). For example, the master device (410) can collect the current output PTS of the client devices (420a, 420b, …420n) and synchronize the status of the output image of each client device (420a, 420b, …420n).
[0069] The buffering time may be a value indicating the time required for the master device (410) to buffer the output image before the output image is transmitted to the client devices (420a, 420b, ...420n). For example, the buffering time may be set differently depending on the network conditions. For example, the master device (410) may calculate the buffering time based on the network bandwidth and the processing speed of the master device (410). For example, the client devices (420a, 420b, ...420n) may perform buffering based on the buffering time.
[0070] The client device (420a, 420b, …420n) can synchronize the playback time of the output video with the master device (410) by controlling at least one of the playback start time, playback speed, and buffering based on the master playback information (MPD).
[0071] Specifically, the client devices (420a, 420b, ... 420n) can start playing the output video based on the playback start PTS. The client devices (420a, 420b, ... 420n) can check the PTS value of the output video currently being output and compare it with the current output PTS value transmitted from the master device. The client devices (420a, 420b, ... 420n) can adjust the playback speed if the PTS value of the output video currently being output is different from the current output PTS value transmitted from the master device. For example, as shown in FIG. 5, since the clock difference of the first client device (Client Device 1) is 0.01 second based on the current output PTS value included in the master playback information (MPD) (e.g., the PTS of FIG. 5), the first client device (Client Device 1) can synchronize the playback time of the output video with the master device by lowering the playback speed. Similarly, as shown in FIG. 5, since the clock difference of the second client device (Client Device 2) is -0.01 seconds based on the current output PTS value included in the master playback information (MPD) (e.g., PTS of FIG. 5), the second client device (Client Device 2) can synchronize the playback time of the output video with the master device by increasing the playback speed. The client devices (420a, 420b, … 420n) can receive video playback information from the host (e.g., the host (110) of FIG. 1) quickly or slowly by performing buffering based on the buffering time transmitted from the master device.
[0072] In this way, the display system (100) of the present disclosure can determine whether a display device will operate as a master device or a client device within a sync group based on recognition of the sync group. Accordingly, the display system (100) of the present disclosure can synchronize output images between display devices without adding a separate configuration for synchronization.
[0073] FIG. 6 illustrates the operation of a display device when a master device is removed from a sync group according to one embodiment, and FIG. 7 illustrates the operation of a master device and a client device being re-determined within a sync group according to one embodiment.
[0074] Referring to FIGS. 6 and 7, the display system (100) of the present disclosure can re-determine the master device and client devices within a sync group according to a change in the configuration of the sync group.
[0075] When the master device (610) is removed from the sync group, at least one display device (620a, 620b, …620n) can re-determine whether to operate as the master device or the client device within the sync group.
[0076] As shown in FIG. 6, when a master device (610) is removed from the sync group, at least one display device (620a, 620b, ...620n) that was operating as a client device in the sync group can search for a new master device within the sync group based on a multicast communication protocol. For example, when there is no new master device within the sync group, at least one display device (620a, 620b, ...620n) can compare priorities with at least one other display device within the sync group.
[0077] As shown in Fig. 7, among at least one display device (e.g., 620a, 620b, ...620n of Fig. 6), the display device with the highest priority (e.g., 620a of Fig. 6) may be determined to operate as the master device (710). Among at least one display device (e.g., 620a, 620b, ...620n of Fig. 6), at least one display device (e.g., 620b, ...620n of Fig. 6) that does not have the highest priority may be determined to operate as a client device (720b, ...720n).
[0078] A new master device (710) can transmit master playback information (MPD) to client devices (720b, ...720n) based on a multicast communication protocol. For example, the master device (710) can transmit master playback information (MPD) including at least one of a playback start PTS, a current output PTS, and a buffering time to the client devices (720b, ...720n) at predetermined intervals. The master device (710) can synchronize output image playback between at least one display device (710, 720b, ...720n) within a sync group based on the master playback information (MPD).
[0079] FIG. 8 illustrates the operation of a display device after a sync group has been changed according to one embodiment.
[0080] Referring to FIGS. 6 to 8, when the sync group of a master device (e.g., 610 of FIG. 6) is changed, the master device can operate as a client device in the changed sync group.
[0081] For example, as shown in FIG. 8, when a master device (e.g., 610 in FIG. 6) within a first sync group (sync group 1) changes to a second sync group (sync group 2), the master device (e.g., 610 in FIG. 6) may determine to operate as a client device (610) within the second sync group (sync group 2).
[0082] In this case, the client device (610) changed to the second sync group (sync group 2) can synchronize the playback time of the output video with the master device (810) by controlling at least one of the playback start time, playback speed, and buffering based on the master playback information (MPD), similar to other client devices (820a, 820b, ...820n) within the second sync group (sync group 2).
[0083] FIG. 9 illustrates the operation of a display device when the sync groups of a master device and a client device are changed simultaneously according to one embodiment.
[0084] Referring to FIGS. 4 and 9, when all display devices within a sync group are changed to another sync group at the same time, the master device and client devices within the sync group can be maintained in the changed other sync group as well.
[0085] Specifically, when a master device (410) and a client device (420a, 420b, ...420n) within a first sync group (e.g., sync group 1 of FIG. 4) are simultaneously changed to a second sync group (e.g., sync group 2 of FIG. 9), the at least one display device (910, 920a, 920b, ...920n) can maintain in the second sync group a decision as to whether to operate as the master device or the client device within the first sync group (e.g., sync group 1 of FIG. 4).
[0086] In this case, in the second sync group (e.g., sync group 2 of FIG. 9), at least one display device (910, 920a, 920b, ...920n) may not perform an operation of searching for a master device separately. In addition, in the second sync group (e.g., sync group 2 of FIG. 9), at least one display device (910, 920a, 920b, ...920n) may operate as the master device or the client device, respectively, in the same manner as in the sync group before the change (e.g., the first sync group).
[0087] FIG. 10 illustrates the operation of a display device when a master device and a client device are pre-designated according to user settings according to one embodiment.
[0088] Referring to FIG. 10, at least one display device (1000a, 1000b, 1000c, …1000n) within a sync group can be designated as at least one of a master device and a client device according to user settings.
[0089] For example, if the master device and the client device within the sync group are pre-designated according to user settings, at least one display device can determine an operation as a pre-designated device (e.g., 1000a is a master device, 1000b, 1000c, ...1000n is a client device) among the master device and the client device (1000b, 1000c, ...1000n) without an operation of searching for the master device within the sync group based on a multicast communication protocol.
[0090] Figure 11 illustrates types of sink groups according to one embodiment.
[0091] Referring to FIG. 11, a sync group may be a unit group that synchronizes the playback time of the output image of at least one display device. For example, display devices included in the same sync group may display the same output image. For example, display devices included in the same sync group may display a single output image in segments.
[0092] In one example, a sync group may include at least one of a channel sharing group (sync group 1), a split-screen playback group (sync group 2), a content sharing group (sync group 3), and an application sharing group (sync group 4).
[0093] As shown in (a) of Fig. 11, a channel sharing group (sync group 1) may be a sync group in which at least one display device shares the same channel. For example, at least one display device within a channel sharing group (sync group 1) may play the same channel at the same time. For example, a channel sharing group (sync group 1) may be used in at least one of a TV and an IPTV.
[0094] As shown in (b) of Fig. 11, the split-screen playback group (sync group 2) may be a sync group in which at least one display device plays a single output image through a split screen. For example, four display devices within the split-screen playback group (sync group 2) may play a single output image split into four parts.
[0095] As shown in (c) of Fig. 11, a content sharing group (sync group 3) may be a sync group in which at least one display device shares and plays the same content. For example, at least one display device within a content sharing group (sync group 3) may stream the same content (e.g., a video) being played on an external device (e.g., a smartphone).
[0096] As shown in (d) of Fig. 11, the application sharing group (sync group 4) may be a sync group in which at least one display device shares and uses the same application. For example, at least one display device within the application sharing group (sync group 4) may execute the same application being used on at least one other display device.
[0097] Figure 12 illustrates an operational flow of a display method according to one embodiment.
[0098] Referring to FIG. 12, the display method may include an operation (1210) in which at least one display device receives a video playback signal from a host, an operation (1220) in which the at least one display device recognizes a sync group based on the video playback signal, an operation (1230) in which the at least one display device determines whether to operate as a master device or a client device within the sync group, and an operation (1240) in which the at least one display device synchronizes a playback time of an output video with at least one other display device based on master playback information.
[0099] In one example, in operation 1210, the host may transmit a video playback signal to at least one display device. For example, the at least one display device may display an output video based on the video playback signal received from the host.
[0100] For example, in operation 1220, the display device can recognize a sync group based on a video playback signal. For example, the display device can recognize a sync group that plays the same output video based on the video playback signal. For example, the display device can recognize a sync group that plays a single output video by dividing it based on the video playback signal.
[0101] In one example, at operation 1230, the display device may determine whether to act as a master device or a client device within the sync group. For example, at least one display device may search for the master device within the sync group based on a multicast communication protocol.
[0102] In one embodiment, if the master device exists within the sync group, at least one display device may be determined to act as the client device within the sync group.
[0103] In one embodiment, if the master device does not exist within the sync group, at least one display device may compare its priority with at least one other display device within the sync group. For example, if the display device has a higher priority than at least one other display device, the at least one display device may be determined to operate as the master device. For example, if the display device has a lower priority than at least one other display device, the at least one display device may be determined to operate as a client device.
[0104] In one example, at operation 1240, the display device can synchronize the playback time of the output video with at least one other display device based on the master playback information. For example, the master device can transmit master playback information (MPD) including at least one of a playback start PTS, a current output PTS, and a buffering time to the client device at predetermined intervals. For example, the client device can synchronize the playback time of the output video with the master device by controlling at least one of a playback start point in time, a playback speed, and buffering based on the master playback information (MPD).
[0105] In one embodiment, the display method of the present disclosure allows a device to re-determine the master device and client devices within a sync group according to a change in the configuration of the sync group. For example, if the master device is removed from a sync group, at least one display device can re-determine whether to operate as the master device or the client device within the sync group. For example, if the sync group of the master device is changed, the master device can operate as a client device in the changed sync group. For example, if all display devices within a sync group are changed to a different sync group at the same time, the master device and client devices within the sync group can be maintained even in the changed different sync group. For example, if the master device and the client devices within the sync group are pre-designated according to a user setting, at least one display device can determine to operate as the pre-designated device among the master device and the client devices without searching for the master device within the sync group based on a multicast communication protocol.
[0106] In this way, the display method of the present disclosure can determine whether the display device will operate as a master device or a client device within a sync group depending on a change in the configuration of the sync group.
[0107] Therefore, the display method of the present disclosure can synchronize output images between display devices without interruption even in various environments where the configuration of the sync group is changed.
[0108] However, since this has been described above, a duplicate explanation will be omitted.
[0109] The display devices according to the various embodiments disclosed in this document may take various forms. The display devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. The display devices according to the embodiments of this document are not limited to the aforementioned devices.
[0110] The various embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. For example, a component expressed in the singular should be understood to include a concept including plural components unless the context clearly indicates only the singular. It should be understood that the term "and / or" used in this document encompasses any and all possible combinations of one or more of the listed items. The terms "comprise," "have," "consist of," and the like used in this disclosure are intended to specify only the presence of a feature, component, part, or combination thereof described in this disclosure, and the use of such terms does not exclude the presence or addition of one or more other features, components, parts, or combinations thereof. In this document, phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can each include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used merely to distinguish the corresponding component from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order).
[0111] The terms "part" or "module" used in various embodiments of this document may include units implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. The "part" or "module" may be an integrally formed component or a minimum unit or part of the component that performs one or more functions. For example, according to one embodiment, the "part" or "module" may be implemented in the form of an application-specific integrated circuit (ASIC).
[0112] The term “if” as used in various embodiments of this document may be interpreted to mean “when”, “when”, “in response to determining”, or “in response to detecting”, depending on the context. Similarly, “if it is determined that” or “if ~ is detected” may be interpreted to mean “upon determining”, “in response to determining”, or “upon detecting”, or “in response to detecting”, depending on the context.
[0113] The program executed by the electronic device (200) described in this document may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.
[0114] Software may include a computer program, code, instructions, or a combination of one or more of these, which can configure a processing device to perform a desired operation or command the processing device, either independently or collectively. Software may be implemented as a computer program including instructions stored on a computer-readable storage medium. Examples of the computer-readable storage medium include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical reading media (e.g., CD-ROMs, digital versatile discs (DVDs)). The computer-readable storage medium may be distributed across network-connected computer systems so that the computer-readable code can be stored and executed in a distributed manner. Computer programs can be distributed online (e.g., by download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0115] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In the display system (100), host (110); and At least one display device (200) that receives a video playback signal from the host, At least one display device, Recognize the sync group based on the above video playback signal, Determines whether to act as a master device or a client device within the above sink group, Synchronizing the playback time of the output image with at least one other display device based on the master playback information from the master device; System.
2. In paragraph 1, At least one display device, Searching for the master device within the sink group based on a multicast communication protocol, If the master device exists within the sync group, it is determined that it operates as the client device within the sync group. System.
3. In paragraph 1, At least one display device, Searching for the master device within the sink group based on a multicast communication protocol, If the master device does not exist within the sync group, determining whether to act as the master device or the client device by comparing the priority with at least one other display device within the sync group. System.
4. In any one of paragraphs 1 to 3, The above master device, transmitting said master playback information including at least one of a playback start PTS, a current output PTS, and a buffering time to said client device at predetermined intervals; System.
5. In any one of paragraphs 1 to 3, The above client device, By controlling at least one of the playback start time, playback speed, and buffering based on the master playback information, the playback time of the output video is synchronized with the master device. System.
6. In any one of paragraphs 1 to 5, If the master device is removed from the sync group, the at least one display device, Re-determines whether to act as the master device or the client device within the said sync group; System.
7. In any one of paragraphs 1 to 5, When the master device within the first sync group changes to the second sync group, the master device, determining that the client device operates within the second sink group; System.
8. In any one of paragraphs 1 to 5, When the master device and the client device within the first sync group are simultaneously changed to the second sync group, at least one display device, Maintaining in said second sync group the decision as to whether to act as said master device or said client device within said first sync group; System.
9. In any one of paragraphs 1 to 5, If the master device and the client device within the sync group are designated according to user settings, the at least one display device is, Determining an operation with a designated device among the master device and the client device without searching for the master device within the sync group based on a multicast communication protocol, System.
10. In any one of paragraphs 1 to 5, The above sink group is, Containing at least one of a channel sharing group, a split screen playback group, a content sharing group, and an application sharing group; System.
11. In the display method, An operation (1210) in which at least one display device receives a video playback signal from a host; An operation (1220) in which at least one display device recognizes a sync group based on the image reproduction signal; An operation (1230) for determining whether at least one of the display devices will act as a master device or a client device within the sync group; and The at least one display device comprises an operation (1240) of synchronizing the playback time of the output image with at least one other display device based on master playback information from the master device. method.
12. In paragraph 11, The operation of determining whether at least one of the display devices will act as a master device or a client device within the sync group is: An operation of searching for the master device within the sync group based on a multicast communication protocol; and Including an action for determining that the master device is operating as the client device within the sync group, if the master device exists within the sync group; method.
13. In paragraph 11, The operation of determining whether at least one of the display devices will act as a master device or a client device within the sync group is: An operation of searching for the master device within the sync group based on a multicast communication protocol; and Including an operation of determining whether to act as the master device or the client device by comparing priorities with at least one other display device within the sync group, if the master device does not exist within the sync group. method.
14. In any one of paragraphs 11 to 13, The above master device, transmitting said master playback information including at least one of a playback start PTS, a current output PTS, and a buffering time to said client device at predetermined intervals; method.
15. In any one of paragraphs 11 to 13, The above client device, By controlling at least one of the playback start time, playback speed, and buffering based on the master playback information, the playback time of the output video is synchronized with the master device. method.
Citation Information
Patent Citations
Method and system for reproducing visual and / or audio content synchronously by one group of devices
JP2020010318A
Multi-display system and method
KR101960541B1
Multimedia control system for synchronizing of set top box group
KR1020170089543A
Synchronization of Content Between Networked Devices
US20220264498A1
Synchronized playback and control of media
US20220295436A1
