Playback control device

The playback control device dynamically adjusts latency based on event triggers, improving interactive experiences and buffer stability in live streaming by autonomously adapting playback speed to the event's structure, thus balancing latency and reliability.

WO2026234108A1PCT designated stage Publication Date: 2026-11-12HIVE STREAMING
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2026/063124
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-05-09
Filing Date
2026-05-06
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Existing video streaming systems face a challenge in balancing latency and reliability, particularly in live events, as reducing latency compromises buffer stability and vice versa, hindering interactive experiences.

Method used

A playback control device dynamically adjusts playback latency based on event-specific triggers, increasing speed for reduced latency during interactive segments and decreasing speed for buffer recovery during less interactive segments, without requiring user intervention or protocol changes.

Benefits of technology

This approach enhances user experience by optimizing latency and buffer stability, ensuring seamless interaction and uninterrupted playback across varying network conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2026063124_12112026_PF_FP_ABST
    Figure EP2026063124_12112026_PF_FP_ABST
Patent Text Reader

Abstract

The present disclosure relates to a method of a playback control device (203) in a video streaming system (200) of adjusting playback latency of a live video stream of an event (202) to be presented to an audience (205), and a playback control device (203) performing the method. The method comprises receiving (S101), from a source device (201), the live video stream to be presented to the audience (205), monitoring (S102) at least one playback latency trigger (206) associated with the event (202), and adjusting (S103) the playback latency of the received live video stream by controlling a playback speed of the video stream output by the playback control device (203) for presentation to the audience (205) based on the monitored playback latency trigger (206).
Need to check novelty before this filing date? Find Prior Art

Description

PLAYBACK CONTROL DEVICETECHNICAL FIELD

[0001] The present disclosure relates to a method of a playback control device in a video streaming system of adjusting playback latency of a live video stream of an event to be presented to an audience, and a playback control device performing the method.BACKGROUND

[0002] Video streaming for large audiences requires a careful balance between latency and reliability, where latency refers to a delay between a first instance in time when video content is captured and a second instance in time when said video content is displayed to a viewer. Lower latency is essential for real-time interactions, such as live Q&A sessions, auctions, and sports betting, where viewers must respond quickly to events as the events occur.

[0003] However, reducing latency also reduces ability to buffer the video content, making the stream more vulnerable to network fluctuations and playback interruptions. To mitigate this, traditional video streaming solutions introduce a playback buffer, allowing for more reliable delivery by compensating for variations in network conditions, including e.g. retransmission of dropped video packets. This approach enhances stream stability but at the cost of increased delay, which can hinder interactive experiences.SUMMARY

[0004] One objective is to solve, or at least mitigate, this problem in the art, and thus to provide an improved method in a video streaming system of adjusting playback latency of a live video stream of an event to be presented to an audience.

[0005] This objective is attained in a first aspect by a method of a playback control device in a video streaming system of adjusting playback latency of a live video stream of an event to be presented to an audience, the method comprising receiving, from a source device, the live video stream to be presented to the audience; monitoring at least one playback latency trigger associated with the event; and adjusting the playback latency of the received live video stream by controlling aplayback speed of the video stream output by the playback control device for presentation to the audience based on the monitored playback latency trigger.

[0006] In a second aspect, this objective is attained by a playback control device configured to adjust playback latency of a live video stream of an event to be presented to an audience by a video streaming system, the playback control device being operative to receive, from a source device, the live video stream to be presented to the audience; monitor at least one playback latency trigger associated with the event; and adjust the playback latency of the received live video stream by controlling playback speed of the video stream output by the playback control device for presentation to the audience based on the monitored playback latency trigger.

[0007] The disclosed method and device enable dynamic adjustment of playback latency in a live video streaming context, based on real-time cues from the structure or flow of the event itself. By controlling the playback speed of the video stream in response to monitored playback latency triggers, the system provides a technical advantage in that it can reduce latency during time-critical or interactive segments— such as Q&A sessions, voting, or bidding rounds— while increasing latency during less interactive segments to allow for buffer recovery and enhanced stream stability.

[0008] This results in an improved quality of service and user experience without requiring manual input from the viewer or modification of the underlying streaming protocol. The technical benefits include optimized use of buffer resources, increased responsiveness during interactive content, and reduced risk of playback interruptions due to adaptive latency control performed locally at the playback control device. Furthermore, the system operates autonomously and can be integrated in both standalone and client-based architectures, making it versatile across different streaming environments and network conditions.

[0009] In an embodiment, the monitored playback latency trigger causes the playback control device to increase the playback speed to reduce playback latency in response to a first type of playback latency trigger being detected, and to decrease the playback speed to improve playback reliability in response to a second type of playback latency trigger being detected. This enables the device to dynamically adapt to different phases of the event, providing a seamless balance between interactivity and buffering robustness.[ooio] In an embodiment, the playback control device is implemented as a standalone device separate from a display device and is configured to output the video stream with adjusted playback latency to the display device for presentation to the audience. This allows centralized latency control and simplifies deployment in managed environments such as corporate or broadcast systems.[oon] In an embodiment, the playback control device is integrated in a display device configured to both adjust the playback latency and present the video stream directly to the audience. This supports decentralized operation and user-specific adaptation, which is beneficial in consumer or heterogeneous network environments.

[0012] In an embodiment, the playback latency trigger is associated with a timesensitive segment of the event during which reduced playback latency is beneficial for enhancing viewer responsiveness or interaction. This ensures that the audience receives near real-time content when it matters most, such as during Q&A sessions or auctions.

[0013] In an embodiment, the playback latency trigger is associated with a transition in the event between a presentation-oriented segment and an interactive segment, or with a return from an interactive segment to a passive or presentation-oriented segment of the event. This enables the system to anticipate changes in the content’s interactivity profile and proactively adjust latency to match.

[0014] In an embodiment, the playback latency trigger is associated with the initiation of a live question-and-answer session, or with the start of a live audience interaction, voting session, or poll. This improves the immediacy of viewer feedback and engagement by reducing latency just before interaction begins.

[0015] In an embodiment, the playback latency trigger is activated in response to an increase in audience activity, including one or more of live chat messages, reactions, or other user engagement indicators. This allows the system to infer interaction needs from user behaviour and optimize playback latency accordingly.

[0016] In an embodiment, the playback latency trigger is activated by a manual command issued by an event moderator or host via a control interface. This provides direct control over latency adjustments, enabling event organizers to synchronize playback behaviour with live transitions.

[0017] In an embodiment, the playback latency trigger is inferred by the playback control device using audio or visual analysis of the live video stream. This facilitates fully autonomous operation by enabling the device to respond intelligently to contextual changes in the event.

[0018] In an embodiment, the audio or visual analysis comprises detecting changes in speech patterns, host behaviour, or crowd noise. This provides a more nuanced detection capability that can identify shifts in engagement level and trigger appropriate playback responses.

[0019] In an embodiment, the playback latency trigger is detected by the playback control device based on any one or more of: metadata embedded in the video stream, a manual host command, a predefined schedule, or contextual analysis of the video stream. This ensures robustness and flexibility by supporting multiple parallel or fallback detection methods for increased reliability.

[0020] In an embodiment, adjusting the playback latency comprises gradually increasing or decreasing the playback speed to transition between latency modes in a perceptually seamless manner. This minimizes visual or audio disruption, maintaining a high-quality user experience while latency is being adjusted.

[0021] In an embodiment, adjusting the playback latency comprises controlling the playback speed to be above a nominal playback speed when reducing playback latency is prioritized, and to be below the nominal playback speed when improving playback reliability is prioritized, thereby enabling the playback control device to selectively favour responsiveness during time-sensitive segments and robustness during less time-sensitive segments while maintaining a consistent overall viewing experience.

[0022] In an embodiment, decreasing the playback speed to improve playback reliability comprises increasing an amount of media buffered at the playback control device, thereby reducing sensitivity to temporary bandwidth drops and lowering the likelihood that the playback buffer will be depleted during the live stream.

[0023] In an embodiment, the playback control device monitors at least one buffer metric indicative of buffer occupancy and decreases the playback speed based on the buffer metric, thereby enabling closed-loop control that adapts to actual bufferconditions rather than relying on fixed assumptions, which improves stability under varying network performance.

[0024] In an embodiment, the playback control device decreases the playback speed until the buffer metric indicates that a playback buffer has been rebuilt toward a target buffer level, thereby providing a measurable criterion for buffer recovery and helping ensure that sufficient buffer is restored before returning to latency-reduction behaviour.

[0025] In an embodiment, improving playback reliability comprises reducing a risk of playback interruption due to buffer underrun and rebuffering events, thereby improving quality of service by reducing stalls and maintaining continuous presentation of the live video stream to the audience.

[0026] In an embodiment, reducing the risk of playback interruption comprises controlling the playback speed based on the buffer metric indicative of buffer occupancy, thereby proactively preventing buffer underrun by adapting playback consumption to buffer availability and maintaining smoother playback during adverse network conditions.

[0027] In a third aspect, a computer program is provided comprising computerexecutable instructions for causing a playback control device to perform steps recited in the method of the first aspect when the computer-executable instructions are executed on a processing unit included in the playback control device.

[0028] In a fourth aspect, a computer program product is provided comprising a computer readable medium, the computer readable medium having the computer program according to the third aspect embodied thereon.

[0029] Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise herein. All references to "a / an / the element, apparatus, component, means, step, etc." are to be interpreted openly as referring to at least one instance of the element, apparatus, component, means, step, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated.BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Aspects and embodiments are now described, by way of example, with reference to the accompanying drawings, in which:

[0031] Figure 1 schematically illustrates a conventional video streaming system in which embodiments may be implemented;

[0032] Figure 2 schematically illustrates a video streaming system configured to adjust playback latency of a live video stream based on one or more playback latency triggers according to an embodiment;

[0033] Figure 3 shows a flowchart illustrating a method adjusting playback latency of a live video stream in an embodiment.

[0034] Figure 4 schematically illustrates a video streaming system configured to adjust playback latency of a live video stream based on one or more playback latency triggers according to an another embodiment; and

[0035] Figure 5 illustrates a playback control device in an embodiment.DETAILED DESCRIPTION

[0036] The aspects of the present disclosure will now be described more fully hereinafter with reference to the accompanying drawings, in which certain embodiments of the invention are shown.

[0037] These aspects may, however, be embodied in many different forms and should not be construed as limiting; rather, these embodiments are provided by way of example so that this disclosure will be thorough and complete, and to fully convey the scope of all aspects of invention to those skilled in the art. Like numbers refer to like elements throughout the description.

[0038] As previously mentioned, video streaming for large audiences requires a careful balance between latency and reliability, where lower latency is essential for real-time interactions, such as live Q&A sessions, auctions, and sports betting, i.e. scenarios where viewers must respond quickly to events as the events occur.

[0039] Figure 1 schematically illustrates a conventional video streaming system 100 in which embodiments maybe implemented, where a video source 101 in the form of a camera records an event 102, e.g. a live auction, and transports the videocontent via a buffering device 103, such as a cloud server, to a display device 104 of a viewer 105 watching the recorded event.

[0040] The buffering device 103 acts a playback buffer, allowing for more reliable video stream delivery by compensating for variations in network conditions, including e.g. retransmission of dropped video packets, given that the latency is allowed to be sufficiently high for retransmission to be possible. However, reducing latency of the video stream being recorded by the camera 102 and transported via the buffering device 103 to the display device 104 also reduces ability of the buffering device 103 to buffer the video content, thus hampering any packet retransmission. In other words, this approach enhances stream stability but at the cost of increased delay, which can hinder interactive experiences.

[0041] To overcome these issues, prior art video conferencing tools may e.g. dynamically drop video frames to maintain real-time communication, which inevitably results in video packet loss. Further, some video streaming technologies allow for adjusting playback speed (e.g., YouTube’s speed settings), but these are user-controlled and not dynamically adjusted based on network conditions or event needs.

[0042] Other approaches, for instance low-latency streaming protocols such as Web Real-Time Communication (WebRTC) and Low- Latency Hypertext Transfer Protocol Live Streaming (LL-HLS), focus on reducing latency but do not dynamically shift the playback offset in real-time.

[0043] Thus, live event organizers and streaming platforms face a trade-off between ensuring real-time engagement and maintaining a smooth, uninterrupted viewing experience. A fundamental challenge in existing streaming approaches is the inability to dynamically adjust streaming latency, i.e. offset between a live source and the viewer’s playback position, once the video content stream has started.

[0044] Figure 2 illustrates a video streaming system 200 configured to adjust playback latency of a live video stream based on one or more playback latency triggers according to an embodiment. The system includes a video source 201, such as a camera, which captures and transmits a live video stream of an event 202.

[0045] Reference will further be made to Figure 3 showing a flowchart illustrating a method adjusting playback latency of a live video stream in an embodiment.

[0046] In step S101, the live video stream is received by a playback control device 203, which is configured to present the video stream to an audience 205 via a display device 204, such as a screen or monitor.

[0047] In step S102, the playback control device 203 monitors at least one playback latency trigger 206 associated with the event 202. The playback latency trigger 206 maybe generated based on specific conditions or phases of the event, such as the start of a Q&A session, a real-time voting segment, or other moments requiring reduced latency for interaction.

[0048] In step S103, based on the detection of the playback latency trigger 206, the playback control device 203 adjusts the playback latency of the received video stream by controlling the playback speed of the video stream output from the device 203. The playback speed is dynamically increased to reduce playback latency or decreased to build buffer at the device 203 and thus improve playback reliability, possibly even allowing packet retransmission. In other words, the adjusting of S103 may comprise increasing the playback speed to reduce playback latency in response to a first type of playback latency trigger 206 being detected during the monitoring in S102, and decreasing the playback speed to improve playback reliability in response to a second type of playback latency trigger 206 being detected.

[0049] Advantageously, this approach enables the playback control device 203 to adaptively optimize the trade-off between latency and reliability during different phases of the event 202, thereby improving the viewing experience for the audience 205 in real time.

[0050] In traditional video streaming platforms like YouTube or even in low-latency live streaming solutions, latency adjustments are primarily initiated by the viewer. These systems typically provide a fixed set of playback speeds (e.g. 1.25 x, 0.75 x) that can be selected manually. These adjustments are user-centric, static, and do not respond to the dynamic nature of the live content itself. In other words, prior art systems remain agnostic to the actual structure or context of the live event being streamed.

[0051] In contrast, instead of relying on viewer action, the playback control device 203 of the embodiment described above monitors one or more event-driven triggers 206 that are directly associated with the content of the event 202. These triggersreflect transitions in the nature of the event— such as switching from a passive presentation to an interactive Q&A session— and cause the playback control device 203 to automatically adjust the playback speed of the video stream. In this context, as mentioned above, the playback latency triggers 206 maybe regarded as comprising at least a first type of playback latency trigger associated with entry into, or occurrence of, an interactive or time-sensitive segment of the event, and a second type of playback latency trigger associated with return to, or occurrence of, a less timesensitive segment of the event. When an interactive segment is about to begin, as indicated with the trigger 206, the device 203 can increase the playback speed slightly to reduce latency, improving responsiveness for the audience 205. Once the interactive segment ends and the event returns to a less time-sensitive mode, again as indicated with the trigger 206, the device 203 can decrease the playback speed to rebuild buffer and improve stream stability. Hence, the playback control device 203 may be viewed as selectively operating in at least two playback-latency modes based on which type of playback latency trigger is triggered: a (first) latency-reduction mode in which playback speed is increased, and a (second) reliability-improvement mode in which playback speed is decreased. In this context, improving playback reliability may comprise increasing an amount of media buffered at the playback control device 203, for example increasing a buffer depth toward a target buffer level, and / or reducing a risk of playback interruption such as buffer underrun and rebuffering events. In some embodiments, the playback control device 203 monitors a buffer metric indicative of buffer occupancy and controls the decreased playback speed until the buffer metric indicates that the buffer has been rebuilt to the target buffer level.

[0052] This event-aware dynamic adjustment mechanism has two key advantages over prior art:- context sensitivity: the device 203 reacts not just to network or client-side conditions, but to the actual structure of the live event in that the monitored trigger 206 indicates when latency is critical (e.g. live Q&A) versus when reliability is more important (e.g. watching a keynote), and- autonomous operation: the adjustment is automated and controlled by the device 203 receiving the trigger 206, thereby eliminating the need for end-userintervention. This leads to a more seamless, intelligent streaming experience that adapts in real-time to the flow of the event.

[0053] Further advantageous is that this mechanism does not require changes to the underlying streaming protocol, nor does it depend on manual configuration by the user.

[0054] In the embodiment illustrated in Figure 2, the playback control device 203 is shown as a standalone unit that receives the live video stream, monitors playback latency triggers, and adjusts the playback latency before outputting the video stream to the display device 204, being e.g. a desktop or laptop computer. This configuration reflects a modular architecture, where the playback control logic is physically or functionally separated from the display component. Such a setup could be beneficial in environments where central management of playback behaviour is required, such as in broadcast infrastructure or enterprise streaming solutions.

[0055] In an alternative embodiment illustrated with reference to Figure 4, the functionality of the playback control device 203 could alternatively be implemented directly within the user’s display device 204. This could include integration into smart TVs, set-top boxes, or personal computing devices such as tablets or laptops.

[0056] Integrating the playback control functionality 203 into the display device 204 simplifies the system architecture by reducing the number of physical components involved. It also allows for localized decision-making, where each user device can independently monitor playback latency triggers and adjust playback behaviour accordingly. This approach may be particularly advantageous in scenarios with heterogeneous network conditions across a distributed audience, enabling personalized latency adjustments without requiring centralized coordination, in peer-to-peer signaling and / or for complementary enhancements that function in parallel with the rendering of content on the user’s display device 204, providing added functionality or interactivity.

[0057] The choice between a standalone playback control device and an integrated implementation depends on factors such as deployment environment, scalability requirements, and the degree of control desired over latency behaviour across multiple viewers.

[0058] Regarding the playback latency trigger 206 of the event 202 represented by the live video stream, numerous scenarios may be envisaged, as will be discussed in the following.

[0059] During a live event, various occurrences or structural transitions within the event 202 itself may act as playback latency triggers 206 that initiate adjustments to the playback speed of a video stream by the playback control device 203.

[0060] For example, when a speaker at the event 202 transitions into a live Q&A session, lower playback latency may be desirable to support real-time interaction between the audience 205 and the speaker. In this case, the playback control device 203 may respond by slightly increasing the playback speed to reduce latency in advance of the Q&A portion.

[0061] Similarly, if the event includes critical announcements or live voting— such as audience polls during a show or a shareholder meeting— minimizing latency becomes important to ensure timely responses and fairness. Here again, the playback speed maybe increased temporarily by the playback control device 203 to bring the viewer’s playback position closer to real-time.

[0062] In contrast, certain event segments, such as keynote presentations or prerecorded speeches, may not require low latency and are more tolerant of buffering. When transitioning from these less interactive phases to more dynamic segments, the playback control device 203 can adapt playback latency accordingly to suit the interaction demands of each phase. For example, a live demonstration or an open panel discussion may justify reducing latency, while the following general presentation may allow for greater buffer depth.

[0063] In another example, after the conclusion of an interactive segment such as a Q&A or live chat, the event may return to a passive, presentation-oriented mode. At this point, the playback control device 203 may respond by slightly decreasing the playback speed, e.g. to 0.95X to allow the buffer to rebuild. This adjustment helps improve stream reliability and reduce the likelihood of playback interruptions due to fluctuating network conditions. At the next occurring Q&A, the playback control device 203 may increase the playback speed back to real time, or even to a higher speed.

[0064] In a further example, if the system 200 detects a surge in user engagement (e.g., rapid influx of chat messages, reactions, or comments), it may indicate that real-time interaction is crucial and activate a trigger 206 accordingly to which the playback control device 203 responds by temporarily increasing playback speed to minimize latency.

[0065] In yet an example, an event host or moderator may manually trigger latency adjustments, for example, based on audience response or transitions in the event program, causing the playback control device 203 to either increase or decrease the latency.

[0066] These exemplifying embodiments illustrate how real-time awareness of the event’s structure beneficially can guide dynamic latency control, ensuring an optimal balance between interactivity and playback stability throughout the event.

[0067] Now, as described, the playback control device 203 is configured to adjust the playback latency of a live video stream based on one or more playback latency triggers 206 associated with the structure or progression of the event 202. In order to detect and respond to such triggers, a number of detection mechanisms may be employed, either individually or in combination, as will be discussed in the following.

[0068] In one embodiment, playback latency triggers are conveyed via metadata or timeline markers embedded in the video stream by the source device 201 or a content management system (not shown). These markers may denote transitions between different segments of the event 202, such as the start or end of a Q&A session, the initiation of a live voting phase, or other interaction-intensive periods. The playback control device 203 monitors the incoming stream for the presence of such markers and activates the corresponding trigger upon detection.

[0069] Alternatively, triggers may be initiated manually by an event moderator or host using a separate control interface. This interface allows a human operator to issue real-time commands indicating changes in the event state, such as “Start Q&A” or “Return to Presentation.” These commands are transmitted to the playback control device 203, which interprets them as triggers and adjusts the playback speed accordingly. In some embodiments, the control interface is operatively connected to, or comprised in, a control entity separate from the source device 201, such as an event control system or content management system, which transmits a controlsignal indicative of the playback latency trigger 206 to one or more playback control devices 203. In this manner, the playback latency trigger 206 maybe conveyed independently of metadata embedded in the live video stream.

[0070] In another embodiment, playback latency triggers may be defined programmatically in advance of the event 202, based on a known schedule. For example, if an agenda indicates that an interactive session is planned to begin 30 minutes into the event 202, the system maybe configured to increase playback speed shortly before that time to reduce latency. The playback control device 203 compares the current playback time to the predefined schedule and automatically activates the latency adjustment when the scheduled point is reached.

[0071] In more advanced configurations, playback latency triggers 206 may be inferred using audio or visual analysis of the live stream. For instance, the system may analyse the audio signal for changes in speech patterns or crowd noise or may apply machine learning to detect visual cues such as a change in presenter behaviour. These contextual indicators may signal the beginning of a more interactive segment, prompting the playback control device 203 to adjust latency in real time.

[0072] These various trigger detection mechanisms advantageously provide flexibility and allow the system to adapt to a wide range of live event formats, ensuring that latency adjustments occur in synchronization with the actual flow of the event.

[0073] While the exemplifying embodiment set out in the above primarily has been described in the context of presentation-based events such as Q&A sessions and keynote talks, similar benefits of dynamic playback latency adjustment apply to a wide range of other live-streamed scenarios.

[0074] For instance, in live sports events or e-sports broadcasts, latency may be reduced during time-sensitive moments such as final plays or in-game battles and increased during halftime or commentary to improve buffering. In online learning environments, playback latency can be minimized during student interaction phases such as polls or discussions and restored afterward for stability.

[0075] In financial news streams or earnings calls, latency reduction is valuable during real-time announcements or Q& segments, while less critical commentary allows for increased buffer. Auction events may require lower latency during activebidding windows and allow latency to rise between rounds. Similarly, concerts or live performances with audience participation— such as live voting or interactive messaging— may benefit from temporarily reduced latency to enhance engagement.

[0076] In Table 1 below, various events are listed along with a potential trigger causing adjustment of the playback latency by the playback control device 203, as well as a detection mechanism and how a trigger accordingly can be conveyed to the device 203. It should be noted that these are example only and further combinations of detection triggers may be envisaged, and how the triggers are conveyed to the device 203.Playback latency Detection mechanism Conveyance to the trigger deviceStart of Q&A session Metadata marker or Stream metadata or manual host input control signalLive voting or audience Metadata marker or Stream metadata or poll manual host input control signal Transition to passive Programmatic schedule Timed trigger presentation segmentSpike in audience Real-time analytics on Control signal engagement (e.g., chat engagement metricsactivity]Manual override by Manual host input Control signal host / moderatorPre-scheduled agendaProgrammatic schedule Timed triggerbased transitionIn-game event in e-sports Computer vision / audio Stream metadata or or sports or event metadata visual / audio interpretationLive auction bidding Auction system triggers Control signalround or host controlTable 1. Playback latency triggers and detection mechanisms.

[0077] These examples illustrate that the event-driven latency adjustment approach described herein can be beneficial across a broad range of live content types involving both active and passive viewing phases.

[0078] As described, to adjust playback latency, the playback control device 203 modifies the playback speed of the live video stream received from the camera 201, which effectively causes a temporary shift in the playback offset of the video stream output by the playback control device 203 relative to the real-time point of the stream. This can be achieved by slightly increasing or decreasing the playback speedwithin a range that is imperceptible to most viewers (typically around 0.95X to 1.05X of normal speed). In other words, the playback control device 203 may, in response to the playback latency triggers, control the playback speed to be slightly above a nominal playback speed when reducing latency is prioritized, and to be slightly below the nominal playback speed when improving playback reliability is prioritized, while maintaining the playback speed within a perceptually acceptable range. In some embodiments, the playback control device 203 adjust playback latency by playbackspeed control without skipping video content, thereby maintaining continuous playback while still allowing latency reduction and buffer recovery

[0079] When the playback latency trigger 206 indicates that reduced latency is desirable - for example, at the beginning of a Q&A session or during a critical live moment - the playback control device 203 may temporarily increase the playback speed above real-time speed.

[0080] Assuming for instance that the video stream is nominally played at 30 frames / sec (fps), and as the Q& session starts, the playback control device 203 increases the playback speed of the video stream being output gradually from ix playback speed to i.ix playback speed, e.g. from 30 fps to 31 fps, then 32 fps, and up to 33 fps. After the Q&A session, the playback speed can be decreased stepwise from 33 fps to 32 fps, then 31 fps, and back to 30 fps to increase reliability while reducing the ability of the viewer to perceive the change in playback speed. Thus, the playback control device 203 will subtly manipulate the playback speed to enable different portions of a stream to benefit from lower latency or more reliability. Further, unlike conventional systems in which playback speed adjustments are manually performed by the viewer, the present system advantageously enables automatic latency optimization driven by the structure and context of the live event itself.

[0081] In case the playback speed adjustment fails or is unsupported, the the playback control device 203 may revert to a default latency mode

[0082] Figure 5 illustrates a playback control device 203 configured to adjust playback latency of a live video stream of an event to be presented to an audience according to an embodiment. The steps of the method performed by the device 203 are in practice performed by a processing unit 212 embodied in the form of one or more microprocessors arranged to execute a computer program 213 downloaded to a storage medium 214 associated with the microprocessor, such as a Random AccessMemory (RAM), a Flash memory or a hard disk drive. The processing unit 212 is arranged to cause the device 203 to carry out the method according to embodiments when the appropriate computer program 213 comprising computer-executable instructions is downloaded to the storage medium 214 and executed by the processing unit 212. The storage medium 214 may also be a computer program product comprising the computer program 213. Alternatively, the computer program 213 maybe transferred to the storage medium 214 by means of a suitable computer program product, such as a Digital Versatile Disc (DVD) or a memory stick. As a further alternative, the computer program 213 maybe downloaded to the storage medium 214 over a network. The processing unit 212 may alternatively be embodied in the form of a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), etc. The device 203 further comprises a communication interface 215 (wired or wireless) over which it is configured to transmit and receive data.

[0083] The aspects of the present disclosure have mainly been described above with reference to a few embodiments and examples thereof. However, as is readily appreciated by a person skilled in the art, other embodiments than the ones disclosed above are equally possible within the scope of the invention, as defined by the appended patent claims.

[0084] Thus, while various aspects and embodiments have been disclosed herein, other aspects and embodiments will be apparent to those skilled in the art. The various aspects and embodiments disclosed herein are for purposes of illustration and are not intended to be limiting, with the true scope and spirit being indicated by the following claims.

Claims

CLAIMS1. A method of a playback control device (203) in a video streaming system (200) of adjusting playback latency of a live video stream of an event (202) to be presented to an audience (205), the method comprising:receiving (S101), from a source device (201), the live video stream to be presented to the audience (205);monitoring (S102) at least one playback latency trigger (206) associated with the event (202); andadjusting (S103) the playback latency of the received live video stream by controlling a playback speed of the video stream output by the playback control device (203) for presentation to the audience (205) based on the monitored playback latency trigger (206).

2. The method of claim 1, wherein the monitored playback latency trigger (206) causes the playback control device (203) to increase (S103) the playback speed to reduce playback latency in response to a first type of playback latency trigger (206) being detected (S102), and to decrease (S103) the playback speed to improve playback reliability in response to a second type of playback latency trigger (206) being detected (S102).

3. The method of claims 1 or 2, wherein the playback control device (203) is implemented as a standalone device separate from a display device (204) and is configured to output the video stream with adjusted playback latency to the display device (204) for presentation to the audience (205).

4. The method of claims 1 or 2, wherein the playback control device (203) is integrated in a display device (204) configured to both adjust the playback latency and present the video stream directly to the audience (205).

5. The method of any one of the preceding claims, wherein the playback latency trigger (206) is associated with a time-sensitive segment of the event (202) during which reduced playback latency is beneficial for enhancing viewer responsiveness or interaction.

6. The method of any one of the preceding claims, wherein the playback latency trigger (206) is associated with a transition in the event (202) between apresentation-oriented segment and an interactive segment, or with a return from an interactive segment to a passive or presentation-oriented segment of the event (202).

7. The method of any one of the preceding claims, wherein the playback latency trigger (206) is associated with the initiation of a live question-and-answer session during the event (202), or with the start of a live audience interaction, voting session, or poll.

8. The method of any one of the preceding claims, wherein the playback latency trigger (206) is activated in response to an increase in audience activity, including one or more of live chat messages, reactions, or other user engagement indicators.

9. The method of any one of the preceding claims, wherein the playback latency trigger (206) is activated by a manual command issued by an event moderator or host via a control interface.

10. The method of any one of the preceding claims, wherein the playback latency trigger (206) is inferred by the playback control device (203) using audio or visual analysis of the live video stream.

11. The method of claim 10, wherein the audio or visual analysis comprises detecting changes in speech patterns, host behaviour, or crowd noise.

12. The method of any one of the preceding claims, wherein the playback latency trigger (206) is detected by the playback control device (203) based on any one or more of: metadata embedded in the video stream, a manual host command, a predefined schedule, or contextual analysis of the video stream.

13. The method of any one of the preceding claims, wherein adjusting (S103) the playback latency comprises gradually increasing or decreasing the playback speed to transition between latency modes in a perceptually seamless manner.

14. The method of any one of the preceding claims, wherein adjusting (S103) the playback latency comprises controlling the playback speed to be above a nominal playback speed when reducing playback latency is prioritized, and to be below the nominal playback speed when improving playback reliability is prioritized.15- The method of any one of the preceding claims, wherein decreasing the playback speed to improve playback reliability comprises increasing an amount of media buffered at the playback control device (203).

16. The method of claim 15, wherein the playback control device (203) monitors at least one buffer metric indicative of buffer occupancy and decreases the playback speed based on the buffer metric.

17. The method of claim 16, wherein the playback control device (203) decreases the playback speed until the buffer metric indicates that a playback buffer has been rebuilt toward a target buffer level.

18. The method of any one of claims 15-17, wherein improving playback reliability comprises reducing a risk of playback interruption due to buffer underrun and rebuffering events.

19. The method of claim 16 and 18, wherein reducing the risk of playback interruption comprises controlling the playback speed based on the buffer metric indicative of buffer occupancy.

20. A computer program (213) comprising computer-executable instructions for causing the playback control device (203) to perform steps recited in any one of claims 1-19 when the computer-executable instructions are executed on a processing unit (212) included in the playback control device (203).

21. A computer program product comprising a computer readable medium (214), the computer readable medium having the computer program (213) according to claim 20 embodied thereon.

22. A playback control device (203) configured to adjust playback latency of a live video stream of an event (202) to be presented to an audience (205) by a video streaming system (200), the playback control device (203) being operative to:receive (S101), from a source device (201), the live video stream to be presented to the audience (205);monitor (S102) at least one playback latency trigger (206) associated with the event (202); and toadjust (S103) the playback latency of the received live video stream by20controlling playback speed of the video stream output by the playback control device (203) for presentation to the audience (205) based on the monitored playback latency trigger (206).