Optimized failover from a unicast content server to a multicast content server

By dynamically switching between unicast and multicast servers based on buffer conditions and network stability, the method ensures seamless multimedia content delivery, addressing bandwidth and interruption issues in existing technologies.

FR3149156A1Pending Publication Date: 2024-11-29ORANGE SA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
FR2023005026
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-22
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

The existing balance between bandwidth gain in multicast mode and establishment time in content transmission leads to potential terminal starvation and multimedia content interruptions, particularly when switching between channels or quality changes.

Method used

A method and system that dynamically switches between unicast and multicast content servers based on conditions such as buffer memory content and network stability, ensuring seamless transitions by pre-loading segments in the buffer before switching to multicast.

Benefits of technology

Ensures uninterrupted multimedia playback by absorbing connection delays and network fluctuations, maintaining smooth content delivery without interruptions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A method for managing access by a reading device (T) to segments of content accessible from content servers (SU, SM), comprising initiating the retrieval of segments from a first server (SU), and continuing the retrieval of segments from a second server (SM) when a condition on an environment of said reading device (T) is met. Figure for the abstract: Fig. 1
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Optimized failover from a unicast content server to a multicast content server FIELD OF THE INVENTION

[0001] The present invention relates to the field of transmission over a telecommunications network of data streams, in particular comprising digital multimedia content, namely digital audio and / or video content, also called audiovisual content.

[0002] It relates more particularly to the management of access by a reading device to segments of content accessible from content servers. This content may be multimedia content (video or audio-video for example) which may be in real time (called “live” content by those skilled in the art, or direct), or on demand (VoD for “Video on Demand”, still in English).

[0003] Conventionally, a data stream, particularly multimedia content, is divided into segments.

[0004] These segments can be obtained in different ways. In particular, the segments can be obtained in a unicast mode, for example in U-ABR mode (for “unicast adaptive bitrate” in English), or in a multicast mode, for example in M-ABR mode (for “multicast adaptive bitrate” in English).

[0005] The U-ABR and M-ABR modes allow content segments to be downloaded using a progressive adaptive downloading technique (or "adaptive streaming" in English) by those skilled in the art.

[0006] In a unicast obtaining (or transmission) mode, the segments are transmitted between a transmitter (content server, etc.) and a recipient (a reading device, etc.). When several reading devices wish to obtain the same content, the segments are transmitted to each one independently, in as many streams of segments.

[0007] The multicast mode of obtaining (or transmitting) aims to share the transmission to several recipients. Recipients who wish to obtain the content request to subscribe to this multicast transmission service. A mechanism is then put in place to connect these new recipients to an existing distribution tree. This connection aims to optimize the sharing of the transmission by taking into account the network topology.

[0008] Thus, the closer one is to the content source, the more there is sharing, that is to say that the same segment is transmitted only once for a set of distinct recipients. This achieves a substantial gain in bandwidth.

[0009] However, the choice between one or other of the methods of obtaining the segments of content poses the problem of balancing the bandwidth gain provided by the "multicast" mode and the time taken to establish it, which can be detrimental to the terminal, particularly when the user switches from one content to another (zapping from one channel to another, for example). This can also be the case when a change in quality is necessary.

[0010] The time lapse required to establish a stream of segments in multicast mode could cause the terminal to starve, which will then no longer be able to produce multimedia content to the user. In the case of video content, this will be interrupted on the last image decoded from the last segment received (video freeze).

[0011] Such a situation is not acceptable to users, and therefore there is a need to improve current state-of-the-art proposals. Summary of the invention

[0012] The invention aims to improve the general experience of users of reading devices.

[0013] For these purposes, according to a first aspect, the present invention can be implemented by a method for managing access by a reading device to segments of content accessible from content servers, comprising starting the obtaining of segments from a first server, and continuing the obtaining of segments from a second server when a condition on an environment of said reading device is reached.

[0014] According to preferred embodiments, the invention comprises one or more of the following features which can be used separately or in partial combination with each other or in total combination with each other: - said first server is associated with a unicast obtaining mode, and / or said second server is associated with a multicast obtaining mode. Thus, it is possible to trigger a switch from a unicast to multicast mode of obtaining content segments depending on the environment of the reading device, in particular in order to be able to take into account its local situation - said condition on the environment of said reading device comprises a condition on information associated with the segments obtained by said reading device. This information makes it possible to take into account the content of a buffer memory of the reading device to decide whether or not to trigger a switch to the second content server. - said reading device transmits information about its environment to said management entity, and said management entity determines whether said condition is met based on said information. This management entity can thus manage the choice of the switchover time based on the information transmitted by the management entity on its environment. This embodiment makes it possible to centralize the specific functionalities in the management entity and thus be compatible with any reading device. - said information is transmitted with segment requests transmitted by said reading device. This saves message exchanges on the local network, and the management entity thus has the necessary information when choosing from which content server to request the requested segment. - said information includes a duration associated with the segments present in the buffer memory of said reading device. The management entity can thus choose from which content server to request the requested segment based on the duration of content present in the buffer memory of the reading device and can estimate whether this duration allows the time necessary for switching to the second content server to be absorbed. - Said information may also or alternatively comprise a number of segments present in the buffer memory of said reading device. This embodiment also allows the management entity to estimate whether the content of the buffer memory allows the absorption of the time necessary for switching to the second content server.

[0015] Another aspect of the invention relates to an entity for managing access by a reading device to segments of content accessible from content servers, comprising a processor configured to perform a start of obtaining segments from a first server, and a continuation of obtaining segments from a second server when a condition on an environment of said device of said reading device is reached.

[0016] Another aspect of the invention relates to a gateway, for example a home gateway, comprising a management entity as previously described.

[0017] Another aspect of the invention relates to a computer program capable of being implemented on a supervision device, the program comprising code instructions which, when executed by a processor, carry out the steps of the method as previously described.

[0018] Another aspect of the invention relates to a data medium on which at least one series of program code instructions has been stored for the execution of a method as previously described.

[0019] Other characteristics and advantages of the invention will appear on reading the following description of a preferred embodiment of the invention, given by way of example and with reference to the appended drawings. BRIEF DESCRIPTION OF THE FIGURES

[0020] The attached drawings illustrate the invention: - [Fig. 1] illustrates a telecommunications network allowing the implementation of a method according to embodiments of the invention; - [Fig.2] shows a diagram of a timeline, according to an implementation of the invention.

[0021] DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

[0022] [Fig.l] illustrates a telecommunications network, NET, allowing the routing of data streams, formed of content segments, to one or more terminals or reading devices T.

[0023] These terminals or reading devices can be of different types, such as in particular a mobile terminal, a connected television, a computer, etc.

[0024] The mobile terminal may typically be a smartphone type smart phone or a digital tablet, adapted to receive multimedia streams and to produce them on an interface of the terminal or connected to said terminal.

[0025] The TV can be natively connected or connected via an associated device such as, for example, an HDMI key connected to the TV.

[0026] An example of an external device communicating with a TV is Chromecast. Chromecast is a real-time media streaming device (media gateway) developed and marketed by Google. The device plugs into the HDMI port of a TV and communicates, via Wi-Fi, with another device connected to the Internet (computer, smartphone, tablet, etc.), in order to display on the TV the multimedia content received from an application compatible with Google Cast technology, from the Google Chrome browser on a computer, or from certain Android devices.

[0027] In the latter case, the multimedia content playback device may be this associated device.

[0028] The data streams may be multimedia streams. These typically include video or audio-video streams (or content). They may also be audio streams (music, radio broadcasts, etc.), or interactive content (including games). They may be on-demand content or “live” or “live” content. This transmission mode may be an “IPTV” (acronym for “Internet Protocol Television”) type transmission mode, but other transmission modes are obviously possible.

[0029] Generally speaking, the contents are divided into segments.

[0030] When an adaptive download mode of the ABR (“Adaptive Bit Rate”) type is implemented, the segments may be available in several resolutions. A The so-called “manifest” file allows reading devices, T, to choose a resolution based in particular on their local environment.

[0031] These resolutions correspond to qualities of the video (and / or audio) content and consequently to different speeds on the telecommunications network.

[0032] The qualities available in ABR can vary depending on the video streaming platform used, but in general and currently, common qualities include: - Very low quality: Often suitable for users with very slow or unstable internet connections, this quality can have a resolution of 240p and a bitrate of 200 kbps. - Low quality: This quality is suitable for more stable but still relatively slow internet connections, with a resolution of 360p and a bitrate of 400-700 kbps. - Standard quality: This quality is suitable for most Internet connections, with a resolution of 480p or 720p and a bit rate of 800 kbps to 2 Mbps. - High quality: This quality is suitable for fast and reliable internet connections, with a resolution of 1080p and a speed of 2-5 Mbps. - Very high quality: this quality is suitable for very fast Internet connections, with a resolution of 4K and a speed of more than 10 Mbps.

[0033] It is important to note that the available qualities may vary depending on the user and network bandwidth capabilities, as well as the quality and complexity of the video content being streamed. The manifest file may then be modified based on variations made at the network or content server level.

[0034] This content may initially be available on a DIF source.

[0035] This source is connected to a content delivery network, CDN (for “Content Delivery Network”), which forms, in a way, an overlay to the telecommunications network, NET, such as the Internet.

[0036] The CDN content delivery network comprises one or more distinct content servers, Su, SM. A first server Su may for example be a unicast server and a second server SM may be a multicast server.

[0037] Typically, the segments of the DIF source are transmitted to a first unicast server, and to a second multicast server. The multicast server, or "multicaster", can receive the segments from the unicast server Su when a decision is made to enable multicast transmission. This decision can for example be made by the first content server, Su, or by a supervisory device, not shown, having knowledge of the number of playback devices wishing to receive a given content.

[0038] The CDN content delivery network also includes terminal equipment. These terminal equipments can form a gateway G between the public network on which the CDN content delivery network is deployed and a private network to which different content playback devices, T, are connected.

[0039] This local network may be a network installed at a user's home (home network) allowing him to connect different equipment, or content playback devices, both to each other and to the gateway to the public network. Such a local network may comply with different technologies, for example Wi-Fi, Ethernet™, Bluetooth, etc., or a combination of several such networks.

[0040] As mentioned above, the unicast server Su provides manifest files to the playback devices T through the respective gateways G. From these manifest files, the playback devices T can send requests to download a segment of the resolution chosen from those available in the manifest.

[0041] More specifically, the reading devices can access the manifests and the content segments through management entities which can, for example, be embedded on these G gateways.

[0042] The G gateways can therefore group together different functions. However, according to other embodiments, these functions can be distributed within different devices (which can then constitute a distributed gateway).

[0043] The multicast server SM transmits the segments in a broadcast tree, independently of the reading devices T registered for obtaining them. The nodes of the broadcast tree take care of the transmission up to the leaves constituted by the management entities.

[0044] According to one embodiment, it is considered that these management entities are embedded in the gateways G. They can in particular be implemented by a set of software modules deployed on one (or more) processors contained in this gateway.

[0045] These management entities can provide manifests to the content playback devices T, depending on the multicast segment streams to which they have subscribed. From the point of view of these playback devices, T, these management entities therefore form the entry to the content delivery network, CDN. Such a management entity can thus correspond to the terminology “nano CDN” or “n-CDN”, known to those skilled in the art, this however only concerns in this sense access to multicast streams.

[0046] A proposed method is a method for managing access, by a reading device T, to segments of content accessible from content servers, Su, SM. This method comprises starting the obtaining of segments from a first server, Su, and a continuation of obtaining segments from a second server, SM, when a condition on an environment of the device of the reading device T is reached.

[0047] This method thus allows great flexibility in switching between a first and a second content server.

[0048] According to one embodiment, the first server is a unicast server, Su, and the second server is a multicast server, SM.

[0049] Thus, initially, the playback device T receives segments from a unicast client, then, after a certain time, it can be connected to a multicast server which transmits the following segments to it. In this way, it is not necessary to wait for the connection to the distribution tree before the playback device T can start receiving segments of the desired content.

[0050] Retrieving the first segment in unicast is faster than in MultiCast. Indeed, to retrieve the first segment in multicast, as will be seen later, you must first subscribe to a channel by subscribing to a broadcast group (IGMP Join) and the flow must be downloaded. It is therefore very interesting to retrieve the first segments in unicast so as to be able to start reading as quickly as possible and then switch to multicast to benefit from a gain in bandwidth in the operator's network.

[0051] The segments can be retrieved at a higher rate than the consumption rate for their production to the user, in particular for their display on a screen associated with the reading device T. The segments are stored in a buffer memory associated with the reading device T. The number of segments stored can vary over time depending on the consumption rate (normally constant) and the acquisition rate (which can depend both on the transmission network between the content server and the gateway G and on the environment of the reading device T, including its connection to the gateway G).

[0052] Once a sufficient number of segments are stored, obtaining the segments can continue from the multicast server. The time required to connect to the multicast tree is then absorbed by the time before this switchover and the storage of a sufficient number of segments in the buffer memory associated with the reading device T. In other words, the depth of the buffer memory makes it possible to absorb the time required to switch to the multicast server.

[0053] In this way, switching from one server to another (in particular from a unicast server to a multicast server) is smooth and transparent for the user of the playback device T. In particular, the audio-visual content is produced without interruption.

[0054] [Fig.2] illustrates a timing diagram for an example of implementation of a method between a reading device T, a gateway G, a first server of content, unicast, Su and a second content server, multicast, SM.

[0055] First, the reading device T transmits a request mi to the gateway identifying a desired content. The request mi may identify a particular segment to be obtained.

[0056] At this stage, the content segments are obtained from the first content server, Su-

[0057] A management entity, embedded in the gateway G, can be responsible for determining from which server the segments requested by a reading device T must be obtained.

[0058] This determination can be carried out by verifying a condition on the environment of the reading device T. This environment can be characterized by different factors. In particular, they can relate to the reading device T itself, and / or to the user or the reading application used and its configuration parameters, and / or to the communication network connecting the reading device T to the gateway G.

[0059] For example, a condition may relate to information associated with the segments obtained by the reading device. In particular, this information may relate to the obtained segments present in the buffer memory associated with the reading device T.

[0060] This information can be a number of segments obtained or a time calculated from these segments, knowing the duration of each segment. The condition can then consist of comparing this number, or this time, with a threshold.

[0061] This threshold can be fixed, but it can also depend on the user or the reading application that reads the content segments to the user.

[0062] Thus, this condition may carry an application or user-related need to be more or less close to real time: for example, in the case of a live broadcast of a sports competition, it may be desired that the playback of the audio-video content is delayed by only a minimum number of segments relative to the source. The threshold can then be set according to this need.

[0063] Also, a condition may relate to the stability of the communication network between the management entity and the reading device (for example a Wi-Fi network, or other radio technology). According to one embodiment, the threshold can then be made dependent on these dynamic aspects of network stability.

[0064] Other conditions may of course be provided, which will, for example, cause the threshold to change over time. But other conditions or other embodiments may not make the condition dependent on a comparison with a threshold.

[0065] Furthermore, the condition to be checked to trigger the switch to the second Content server may have one or more of these conditions.

[0066] Upon receipt of the message mB, the management entity of the gateway G triggers a processing A1 to verify the expected condition. In this example, it is assumed that the condition is not verified, for example because the reading device does not have enough segments stored in the buffer memory.

[0067] According to one embodiment, the reading device T transmits information about its environment to the management entity. In particular, it can transmit to it information associated with the segments obtained by the reading device (a number of segments stored in the buffer memory for example).

[0068] This information can be transmitted in the same message mi as the segment request.

[0069] Once it has been verified that the condition is not met, the management entity transmits a request m2 to the chosen server, here the first server Su, identifying the segment requested by the reading device T.

[0070] In an m3 message, the first server Sutransmits this segment to the gateway G, which, in an m4 message, retransmits it to the playback device T. The latter can store this segment in the buffer memory where it will be “consumed” by an audio-video content playback application.

[0071] The reading device T may transmit a new request, m5, for a new segment. The reading device, or more precisely, the reading application deployed on this device, may be responsible for triggering this new request m5. In an exemplary embodiment, this request m5 may be transmitted with information on the segments stored in its buffer memory.

[0072] In A2, the gateway management entity G can check again whether the condition is verified.

[0073] It is assumed that the reading device T already has at least one segment previously obtained and stored in its buffer memory, but that the number of segments or the duration corresponding to these segments is not sufficient. As before, the sufficiency or insufficiency can be determined by a comparison with a predefined threshold.

[0074] The expected condition is thus not met, and it is decided to continue obtaining the segments from the first content server, i.e. the unicast content server Su-

[0075] The management entity transmits a request m6 to the first content server Su by identifying the segment requested by the playback device T.

[0076] In an m7 message, the first server Sutransmits this segment to the gateway G, which, in an m8 message, retransmits it to the reading device T. The latter can store this segment in the buffer memory where it will be “consumed” by a reading application. playback of audio-video content.

[0077] The reading device T can transmit a new request, m9, for a new segment. In an exemplary embodiment, this request m9 can be transmitted with information on the segments stored in its buffer memory.

[0078] The gateway management entity G can check again whether the condition is verified.

[0079] This time it is assumed that the expected condition is verified, that is to say that the reading device T has transmitted information indicating that it has a number of segments, or a duration corresponding to these segments, sufficient in relation to a predefined threshold.

[0080] This condition being verified, the management entity can trigger a switch to a continuation of obtaining the segments from the second content server, i.e. the multicast content server, SM. The management entity of the gateway G can then transmit a mio message requesting a new segment (identifying the desired segment) to the second content server SM.

[0081] In other words, this switch can generate a change in the obtaining mode from a unicast mode to a multicast mode.

[0082] Switching to multicast mode may depend on the multicast technology used.

[0083] In multicast mode, the terminals, for example the management entity of the gateway G, interested in receiving content must join a group of terminals having requested a subscription to the same content using, for example, an IGMP (Internet Group Management Protocol) protocol if they are IPv4 terminals or the MLD (Multicast Listener Discovery) protocol if they are IPv6 terminals. Indeed, a terminal must be a member of a group to receive a given multicast stream.

[0084] The IGMP protocol may comply, in its version 3, with RFC 3376 of the IETF.

[0085] According to this protocol, the management entity sends a message to a “rendez-vous” router you » RP (for “Rendezvous Point” in English) to subscribe to the multicast group corresponding to the content desired by the reading device T. This message can be an “IGMP Membership Report” message.

[0086] This rendezvous router is chosen from a content distribution tree multicast based on topological criteria. Typically, the management entity subscribes to the nearest RP router, so that the transmission of content between the content source and this RP router takes as long as possible, in order to optimize the sharing of transmissions.

[0087] The RP router maintains a table of multicast group members. When it receives multicast data, it sends it only to entities that have subscribed to the group. Thus, after subscription, the management entity can start receiving the segments in multicast mode.

[0088] This process, illustrated schematically by step A3 in [Fig.2], can involve substantial and uncertain time.

[0089] However, according to the proposed method, subjecting the triggering of the switch to a multicast mode to compliance with a condition on the segments already obtained (and stored in the buffer memory of the reading device) makes it possible to protect against starvation of the reading device, i.e. the momentary absence of segments to be read and produced, while waiting for the reception of the segments according to the multicast obtaining mode.

[0090] The second content server SM (i.e. the multicast server) can transmit a segment in the distribution tree, and this segment can thus be obtained by the gateway management entity G (message mu).

[0091] Upon receipt of a segment, the management entity retransmits the obtained segment to the reading device, in an mi2 message. This transmission can be carried out in unicast mode since it is a transmission between two parties only.

[0092] Conventionally, multicast transmission makes it possible to reduce the load on the operator's telecommunications network. In addition, the subscription time to the channel in multicast mode does not cause the playback of the video content on the playback device T to freeze. This takes advantage of the benefits of the multicast mode of obtaining but without suffering from the disadvantages that may appear in the mechanisms of the state of the art.

[0093] This proposed mechanism can be applied to other types of servers than a pair of unicast / multicast servers. It applies in particular to the general case where switching from a first server to a second server is likely to cause a temporary interruption in the obtaining of segments by the reading device, for example due to a delay in establishing the connection with the second server.

[0094] The proposed mechanism makes it possible to protect against this switching time lapse by subjecting it to a condition on the environment of the reading device. In particular, according to one embodiment, this switching is conditioned on sufficient content in its buffer memory, so that the reading device can continue to read the content, using the buffer memory, during the establishment time. It is thus possible to guarantee that the buffer memory will not be emptied before the establishment of the connection with the second server, so that there will be no interruption of the reading. In this way, the switching between the first and the second content server appears transparent to the users of the reading device T.

[0095] It is also possible to take into account other conditions on the environment of the reading device T, so that the switch to the second content server is only carried out when this environment corresponds to required associated with the second server.

[0096] Of course, the present invention is not limited to the examples and the embodiment described and shown. It is in particular susceptible to numerous variants accessible to those skilled in the art.

Claims

Claims

1. A method of managing access by a playback device (T) to segments of content accessible from content servers (Su, SM), comprising starting to obtain segments from a first server (Su), and continuing to obtain segments from a second server (SM) when a condition on an environment of said playback device (T) is reached.

2. Method according to the preceding claim, wherein said first server is associated with a unicast obtaining mode, and / or said second server is associated with a multicast obtaining mode.

3. Method according to one of the preceding claims, wherein said condition on the environment of said reading device comprises a condition on information associated with the segments obtained by said reading device (T).

4. Method according to the preceding claim, in which said reading device transmits information on its environment to a management entity, and said management entity determines whether said condition is reached based on said information.

5. Method according to the preceding claim, in which said information comprises a duration associated with the segments present in a buffer memory of said reading device.

6. Method according to the preceding claim in which said information is transmitted with segment requests transmitted by said reading device.

7. Entity for managing access by a reading device (T) to segments of content accessible from content servers (Su, SM), comprising a processor configured to start obtaining segments from a first server, and continue obtaining segments from a second server when a condition on an environment of said reading device is reached.

8. Gateway (G) comprising a management entity according to the preceding claim.

9. A computer program capable of being implemented on a management entity, the program comprising code instructions which, when executed by a processor, performs the steps of the method defined in claims 1 to 6.

10. Data carrier on which at least one series has been stored of program code instructions for executing a method according to one of claims 1 to 6.

Citation Information

Patent Citations

  • Content delivery

    GB2602270A

  • Content delivery

    WO2023052191A1