Method for managing the processing of a video stream in a local network.

By dynamically selecting an optimal data processing device based on capabilities within a local network, the method addresses the issue of insufficient domestic gateway processing, improving video quality and user experience by reducing image freezes.

FR3148887A1Inactive Publication Date: 2024-11-22ORANGE SA
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
FR2023004804
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-15
Publication Date
2024-11-22
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing domestic gateways often have insufficient processing capabilities, leading to poor video quality and image freezes during multimedia streaming due to reduced processing capacity or unavailability, affecting user experience.

Method used

A method for managing video stream processing in a local network by selecting an optimal data processing device from a set of devices based on their capabilities, including processor power, memory size, and volatile memory, ensuring efficient processing and avoiding reliance on a default gateway.

Benefits of technology

This approach enhances video quality by reducing image freezes and ensuring consistent performance by dynamically selecting the most suitable device for processing, even when the gateway is unavailable.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

TITLE: Method for managing the processing of a video stream in a local area network. The invention relates to a method for managing the processing of a data stream in a local area network (LI1) comprising a set of data processing devices (PC, MOB, GTW), characterized in that it comprises a step (ET3) of selecting a device (PC) from the set of data processing devices and processing the stream in the selected device. Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Method for managing the processing of a video stream in a local network. Technical field

[0001] The field of the invention is that of digital multimedia content, namely digital audio and / or video content, also called audiovisual content.

[0002] The invention relates to a method for managing the processing of a video stream in a local network.

[0003] The processing entity is capable of receiving a data stream, processing the data and transmitting the processed data. In the example which will serve to illustrate the invention in the following, the processing entity is a device provided with a processor and is capable of receiving data packets from a first network, of processing the data so as to obtain content segments and of transmitting the obtained segments on request to a reading device. Such an entity is for example an entity capable of providing segments in “adaptive streaming” mode without being limited to the latter.

[0004] A reading device is particularly aimed at any device capable of receiving multimedia streams in the form of segments, for example a decoder, a mobile telephone, a tablet, etc., and of reading the contents received.

[0005] The communication link between the reading device and a device providing segments is arbitrary. In the example described below, this link will be a unicast link.

[0006] Content is, for example, content broadcast in real time, also called “live” content by those skilled in the art, or on-demand television content, or on-demand video content, etc. State of the art

[0007] There are currently several modes of transmitting content from a content transmitter to a content playback device. One known mode is, for example, Multicast ABR mode (M-ABR or Multicast Adaptive Bit Rate).

[0008] This M-ABR mode implements IP packet transport in Multicast mode. In this mode, multiple multicast transmission channels are created for a single TV channel to encode and broadcast multiple streams with different qualities on each multicast channel, respectively. In other words, the channels broadcast the same content with different image qualities, respectively.

[0009] An IP address is assigned to each channel, in this way access to the content in a desired quality is made by connecting to the corresponding IP address.

[0010] The M-ABR multicast mode is implemented by a processing entity which will be referred to as nCDN in the following. This processing entity is installed in a home gateway which interfaces a WAN (Wide Area Network) and a LAN (Local Area Network). This processing entity acts as the termination point for the Multicast stream. In practice, this processing entity receives a stream of audio and / or video data transmitted from a server in multicast mode (for example with “IPTV” (Internet Protocol Television) technology); the processing entity then stores the received packets, segments the received packets in accordance with the HAS standard and transmits, in unicast, the segments one after the other to a segment playback device.

[0011] Since the processing entity is installed in the home gateway, the processing quality therefore depends on the processing capabilities of the gateway. It is important that the processing capabilities of the gateway are optimal to best process the data flow and ensure optimal quality of service.

[0012] However, this is not always the case for multiple reasons. For example, at the time of processing, the gateway may be processing other data and may therefore see its processing capabilities reduced; also, the gateway may be natively low-performing in terms of processing capacity for financial cost reasons. One problem is that, when the home gateway sees its processing capacity reduced or its performance is not sufficient, we observe image freezes. The content rendering is therefore not optimal, and the user experience is very poor.

[0013] Also, when the home gateway is unavailable, access to the data stream is no longer possible.

[0014] The invention improves the situation

[0015] The invention

[0016] To this end, the invention relates to a method for managing the processing of a data flow in a local network comprising a set of data processing devices, characterized in that it comprises a step of selecting a device from the set of data processing devices and processing the flow in the selected device.

[0017] The invention avoids using a default device for processing a data stream, in this case a home gateway. The possibility of choosing a device at will from a set of data processing devices makes it possible, among other things, to avoid a blocking situation linked to the unavailability of the device including the processing entity, for example because the device concerned is switched off. Also, by processing the data stream by a judiciously chosen device, for example the device having optimal processing capabilities for the intended processing, the resulting processing will necessarily be of better quality. The risks of freezing images are then largely reduced or even non-existent.

[0018] According to a first embodiment, the devices have an address in the network; in this configuration, the data processing devices have an address in the network, and in that the selection of the device is followed by a transmission of the address to a reading device capable of reading the data stream resulting from the processing. This mode is useful when the home network is composed of several data processing devices. Upon receipt of this address, the reading device addresses its requests for access to content using the address of the data processing device of the device. We will see in an example that this address is an IP address (acronym for Internet Protocol). A variant could also consist of the reading device sending all access requests to the home gateway which then routes to the selected device.

[0019] According to a second embodiment, which may be implemented alternatively or cumulatively with the previous embodiment, the data processing device is selected according to its processing capabilities. As indicated above, a data processing device is chosen judiciously, here according to its capabilities, meaning the capabilities of its physical and / or software resources. This selection will allow for better processing and therefore ensure restitution of the content without image freezes.

[0020] According to a third embodiment, which may be implemented alternatively or cumulatively with the previous modes, the selection is carried out by comparing processing capacities of devices of the local network and by selecting a device at the base of the comparison. In this mode, a management entity recovers the processing capacities of all or part of the devices of the local network, namely the powers of the processors, the memory sizes, etc., respectively. Once recovered, the calculation is limited to a comparison of the capacities. This mode is simple and consumes very few resources.

[0021] According to a fourth embodiment, which may be implemented alternatively or cumulatively with the previous embodiments, the processing capabilities include a volatile memory size. This mode makes it possible to select a device equipped with a volatile memory adapted to the data flow. For example, if the data flow is a 4K type video flow entering the local network, the volatile memory will be selected from the volatile memories of the different devices in such a way as to process this flow correctly. Alternatively, since the data flow is associated with an encoding rate, the choice of the installation location of the processing entity may also depend on the encoding rate. Indeed, some flows see their encoding rates vary over time due to the variation in the bandwidth on the network; in this case, it is wise to take this encoding rate into account when choosing the memory. volatile to be used implied by the device including this volatile memory.

[0022] According to a fifth embodiment, which may be implemented alternatively or cumulatively with the previous embodiments, the local network comprises a home gateway capable of interfacing a wide area network and the local network. In this configuration, the gateway routes a data stream from the network to the processing location in the local network. This mode targets the case of reception of a data stream, for example a multimedia stream, from a content server, for example a multicast server of the M-ABR type; the gateway, having knowledge of the selected device, in particular the IP address of the selected device, routes the stream received using this IP address.

[0023] According to a sixth embodiment, which may be implemented alternatively or cumulatively with the previous embodiments, the data processing device is capable of receiving the data stream from a communication network. This mode makes it possible to select a data processing device capable not only of processing the stream with performance but also of receiving the data stream from the communication network, for example without requiring a home gateway. The advantage is that if the gateway is unavailable, the device thus selected can access the stream instead of the gateway.

[0024] According to a seventh embodiment, which may be implemented alternatively or cumulatively with the previous embodiments, the processing device chosen varies over time. This mode makes it possible to modify the location of the processing of the data flow over time. This makes it possible to use the most suitable device, in particular when the chosen device sees its capacities decrease at a given time. The change of device for processing may also be based on load forecasts on the devices of the local network.

[0025] According to a hardware aspect, the invention relates to an entity for managing the processing of a data flow in a local network comprising a set of data processing devices, characterized in that it consists of selecting a data processing device in said set, and processing the data flow in the selected device.

[0026] According to another hardware aspect, the invention relates to a decoder comprising a management entity as defined above.

[0027] According to another material aspect, the invention relates to a computer program capable of being implemented on an entity as defined above, the program comprising code instructions which, when executed by a processor, performs the steps of the selection method defined above.

[0028] Finally, according to another material aspect, the invention relates to a data medium on which at least one series of program code instructions has been stored. for the execution of a management process as defined above.

[0029] Such a recording medium may be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or a magnetic recording means, for example a USB key or a hard disk.

[0030] On the other hand, such a recording medium may be a transmissible medium such as an electrical or optical signal, which may be conveyed via an electrical or optical cable, by radio or by other means, so that the computer program it contains is remotely executable. The program according to the invention may in particular be downloaded over a network, for example the Internet.

[0031] Alternatively, the recording medium may be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the aforementioned display control method.

[0032] The invention will be better understood on reading the following description, given by way of example and with reference to the appended drawings in which:

[0033] [Fig-1] [Fig.l] represents a computer system on which is illustrated a exemplary embodiment of the invention.

[0034] [Fig.2] [Fig.2] is a simplified block diagram of the hardware structure of a reading device.

[0035] [Fig.3] [Fig.3] a simplified block diagram of the hardware structure of a home gateway.

[0036] [Fig.4] [Fig.4] schematically illustrates content divided into segments of several qualities.

[0037] [Fig.5] [Fig.5] illustrates an embodiment in the form of messages exchanged between the different devices involved in the management method.

[0038] Detailed description of an exemplary embodiment illustrating the invention:

[0039] We now present, in relation to [Fig.l], a computer system SYS including a GTW home gateway offering a local network in which there are data processing devices, namely a reading device STB reading device, for example a decoder, a PC computer, a TAB tablet.

[0040] The SYS system also includes a data flow processing entity referenced nCDN.

[0041] In our example, the nCDN processing entity is able to transmit content segments to the STB playback device on request.

[0042] [Fig.2] represents an architecture of an STB reading device. This STB device conventionally comprises memories MEM1 associated with a processor CPU1. The memories can be of the ROM type (from the English “Read Only Memory”) or RAM (from the English “Random Access Memory”) or Flash.

[0043] The STB playback device can transmit content to be played back to the TV playback device via a COM 12 communication module. This COM 12 module is, for example, an HDMI link.

[0044] The STB reading device communicates with the gateway via an Ethernet module for local wired communication or via a Wi-Fi type radio module for local wireless communication with the GTW residential gateway. The module in question is referenced CMO11 in [Fig.2].

[0045] The STB playback device comprises a HAS streaming mode download entity capable of managing the downloading of segments. This HAS download entity is capable of entering into communication with a compatible nCDN data stream processing entity.

[0046] [Fig.3] represents an architecture of a GTW home gateway. This gateway typically comprises MEM2 memories associated with a CPU2 processor. The memories can also be of the ROM (Read Only Memory) or RAM (Random Access Memory) or Flash type.

[0047] The gateway communicates with a WAN type wide area network via a COM21 communication module.

[0048] The gateway can transmit, using a COM22 communication module, content to a device on the local network via a LU link, Wi-Fi in our example.

[0049] The GTW gateway further comprises a management entity ENT capable of carrying out steps described below. The management entity ENT is located in the gateway in the example, it could however be located elsewhere in the system, for example on a data processing device of the local network.

[0050] The segments created by the nCDN processing entity are compatible with the HAS entity.

[0051] In our example, the nCDN processing entity has several SMC multicast sources to retrieve content.

[0052] To select one of the SMC multicast data sources, the STB playback device, meaning the HAS module present on the STB playback device, issues a request for access to the content and indicates a desired quality for the restitution often expressed in kbits / sec by those skilled in the art. Following reception, the nCDN entity addresses (or subscribes to) an SMC multicast server (among several multicast servers) having the content in the desired quality and receives in return the content from the multicast server in question via the telecommunications network, the Internet network in our example; the transmission mode implemented between the multicast server and the processing entity is for example the IPTV mode (acronym for "Internet Protocol Television"), known to those skilled in the art. The invention is not limited to IPTV mode but to any other similar transmission modes.

[0053] Then, after receiving the content in a given quality, the nCDN processing entity stores the received IP packets in a RAM memory so as to process these packets, the processing consisting in our example of cutting the packets into segments, and encoding each segment to obtain segments in the requested quality.

[0054] After encoding, the nCDN processing entity transmits in response a description file including the addresses (URL) of the segments thus created.

[0055] We will see below where the nCDN processing entity is located in the local network in accordance with the invention.

[0056] We will also briefly explain in the following what a segment consists of and what the possible qualities are (expressed in Kbits / s) for each segment of a content.

[0057] A RES communication network allows communication between content sources, in our example multicast servers each offering respective qualities for the same content and the nCDN entity. In our example, the RES network is the Internet network.

[0058] The STB playback device is connected via a LU communication link to the GTW gateway and via a communication link, for example an HDMI link, to a TV playback device such as a television screen.

[0059] In our example, the link between the STB playback device and the nCDN processing entity is a point-to-point (or unicast) link.

[0060] With reference to [Fig.4], different qualities can be encoded for the same content of a channel, corresponding for example to different encoding rates.

[0061] In this [Fig.4], segments are represented in table form, the HAS entity which accesses the segments and an interface which allows the HAS entity to communicate with the outside.

[0062] We will speak of quality to refer to a certain resolution of the digital content (spatial resolution, temporal resolution, quality level associated with video and / or audio compression) with a certain encoding rate. Each quality level is itself divided on the content server into time segments.

[0063] The description of these different qualities and the associated temporal segmentation, as well as the content segments, are described for the STB playback device and made available to it via their Internet addresses (URI: Universal Resource Identifier). All of these parameters (qualities, segment addresses, etc.) are generally grouped together in a parameter file called a description file or “manifest file” by those skilled in the art. It should be noted that this parameter file may be a computer file or a set of descriptive information about the content, accessible to a certain address.

[0064] The STB playback device, in a progressive adaptive download context, can adapt the access requests that it transmits to the nCDN entity to receive and decode the requested content at the quality that best corresponds to it. In our example, if the contents are available at the rates of 400 kb / s (kilobits per second) (Resolution 1, or level 1, noted NI), 800 kb / s (N2), 1200 kb / s (N3) 2100 kb / s (N4) 3000 kb / s (N4) and the client terminal has a bandwidth of 3000 kb / s, it can request the content at any rate lower than this limit, for example 2100 kb / s. Generally, we note “Ci@Nj” the content number i with the quality j (for example the j-th level Nj of quality described in the description file).

[0065] In this example, to view content, the STB playback device first queries, via the GTW service gateway, the nCDN processing entity to obtain an address of the content description file managed by the device concerned. In the following, it will be assumed that this file is a description file type file according to the MPEG-DASH standard.

[0066] A description file includes information on the segments and the available encoding rates. Such a file includes, for example, for each segment several different qualities (NI = 400 kb / s, N2 = 800 kb / s, N3 = 1200 kb / s, ...) and the access addresses of the segments in question. Once the STB playback device has the segment addresses corresponding to the desired content, the STB playback device downloads the segments one after the other. It should be noted that this download is traditionally carried out here via an HTTP URL, but could also be carried out via a universal address (URI) describing another protocol (dvb: / / mycontentsegment for example).

[0067] Then, the STB decoder receives the segments, then decodes them, and requests a reproduction on the TV screen.

[0068] It will be noted that the content is arbitrary. The content is, for example, a television program broadcast on a delayed basis, or a video on demand, or a personal video of the user, or any other multimedia content, for which the invention also applies.

[0069] The STB playback device can be controlled by the user by means of a remote control. The remote control can be physical or software.

[0070] According to the invention, a preliminary step is performed during which a data processing device is selected in the local network to host the processing entity. Unlike the prior art in which the entity is stored in the default home gateway, in the invention, the entity can be stored on a device in the local network of choice.

[0071] It will be seen that the data processing device is chosen according to the performance of the physical and / software resources for carrying out the data processing.

[0072] The steps of an embodiment are described below with reference to [Fig.5]. In this [Fig.5], axes corresponding to 1) the multicast server, 2) the GTW gateway including the nCDN device, 3) a set of data processing devices and 4) the STB reading device including the HAS download module are represented.

[0073] A time axis makes it possible to represent the direction of execution of the steps.

[0074] In this [Fig.5], arrowed links are illustrated between the axes in order to illustrate message exchanges between the different devices.

[0075] During a step ET1, the management entity ENT, present in the home gateway in our example, receives data representative of physical and / or software resources of all or part of the data processing devices of the local network LAN, namely in our example the mobile MOB and the PC computer.

[0076] During a step ET2, in our example, the management entity ENT is interested in a physical resource in particular, namely the volatile RAM type memory of the different devices, more particularly in the size in bytes of these memories. The invention is not limited to this resource but extends to other resources; for example, other resources can be taken into account, namely the power of the processor, the communication links available to the data processing devices, for example allowing the reception of a data flow from the network RES, etc.

[0077] During a step ET3, the entity ENT classifies the devices according to the sizes of the respective RAM memories and selects in our example the device having the largest size in bytes.

[0078] It is assumed that the selected device is the PC computer.

[0079] During a step ET4, the management entity ENT requests the downloading of the nCDN processing entity into the selected device PC. Alternatively, the selected device may be equipped with a deactivated processing entity. During this step ET4, instead of transmitting the processing entity, the processing entity is simply activated.

[0080] During a step ET5, the management entity ENT having the IP address available in the premises of the PC computer designates this IP address and transmits this IP address to the HAS client installed in the reading device STB.

[0081] In our example, the PC computer with a Wi-Fi connection is able to communicate directly with the STB reading device.

[0082] Note that in the case where the selected device cannot communicate directly with the STB playback device, the selected device communicates with the STB playback device via the home gateway. GTW.

[0083] In our example, at this stage, the PC computer, meaning the nCDN processing entity installed on the nCDN entity, can transmit segments to the STB playback device in Unicast mode.

[0084] It is then assumed that the STB reading device transmits, during a step ET6, a request for access to content. This request is transmitted to the PC computer equipped with the nCDN processing entity.

[0085] The nCDN entity, installed on the PC computer, receives and then requests, during a step ET7, access to the content from a multicast server SRV chosen in our example based on a quality entered in the request from the STB playback device. The request passes through the home gateway in our example. The gateway routes the request during a step ET8.

[0086] During a step ET9, the home gateway GTW receives in return a data flow which it routes to the PC computer during a step ET10 so that the nCDN processing agent can process the received data flow.

[0087] During a step ET11, the nCDN processing entity then receives IP data packets from the GTW gateway. After reception, the nCDN processing entity performs processing via its processor. The processing is known to those skilled in the art and will not be described further because it is of no interest for the presentation of the invention. Let us simply recall that the received IP packets are divided into content segments; during a step ET12, the segments are then transmitted successively to the STB playback device.

[0088] At this stage the STB playback device can read and receive the segments, decode them and request playback on the TV playback device.

[0089] The embodiment described above may be subject to variations.

[0090] According to a variant, the location of the nCDN processing entity can be determined after each request for access to content from the STB playback device. The location therefore varies over time.

[0091] According to another variant, the choice of location can be made during the reception of the content segments. Indeed, the initial choice may no longer be suitable later, for example the CPU decreases on the chosen equipment and is suddenly requested for another task. In this case, another data processing device is selected to carry out the processing of the nCDN processing entity.

[0092] We have seen previously in our exemplary embodiment that the processing capacities include a volatile memory size. In addition, according to a variant, the management entity ENT also takes into account the encoding rate associated with the received stream. Indeed, the encoding rate varying over time when the download is adaptive, the RAM requirements when processing the data stream also vary. The number of data processing devices suitable for processing may therefore increase depending on the current encoding rate.

[0093] We have seen previously that the home gateway GTW routes the data flow to the chosen processing device, in the example the PC computer. Alternatively, the data processing device is chosen according to its ability to receive the data flow from a communication network. This mode allows access to the content even if the gateway is unavailable; in this case the selected device accesses the flow and receives the flow from the RES network instead of the gateway.

[0094] According to another variant, as indicated above, nCDN processing entities are stored natively on the data processing devices of the local network and can be activated on demand. This variant avoids a step of transmitting the nCDN processing entity.

[0095] Finally, let us specify here that the term “entity” can correspond to a software component as well as to a hardware component or a set of hardware and software components, a software component itself corresponding to one or more computer programs or sub-programs or, more generally, to any element of a program capable of implementing a function or a set of functions as described for the modules concerned. In the same way, a hardware component corresponds to any element of a hardware assembly capable of implementing a function or a set of functions for the module concerned (integrated circuit, smart card, memory card, etc.).

Claims

Claims

1. Method for managing the processing of a data flow in a local network comprising a set of data processing devices (GTW, PC, MOB), characterized in that it comprises a step of selecting (ET3) a device in the set of data processing devices and processing the flow in the selected device.

2. Management method according to claim 1, characterized in that the data processing devices have an address in the network, and in that the selection of the device is followed by a transmission of the address to a reading device capable of reading the data flow resulting from the processing.

3. Management method according to claim 1, characterized in that the device is selected according to its processing capabilities.

4. Management method according to claim 1, characterized in that the selection is carried out by comparing processing capacities of devices of the local network and by selecting a device at the base of the comparison.

5. Management method according to claim 3 or 4, characterized in that the processing capabilities include a volatile memory size.

6. Management method according to one of the preceding claims, characterized in that the data flow is associated with an encoding rate, and in that the choice of the installation location of the entity also depends on said encoding rate.

7. Management method according to claim 1, characterized in that the local network comprises a home gateway capable of interfacing a wide area network and the local network, and in that the gateway routes a data flow from the network to the processing location in the local network.

8. Management method according to claim 1, characterized in that the data processing device is capable of receiving the data stream from a communication network.

9. Management entity (ENT) for processing a data flow in a local network comprising a set of data processing devices (MOB, PC, GTW), characterized in that it comprises a processor capable of carrying out a step of selecting a device in the set of data processing devices and processing the flow in the selected device.

10. Reading device (STB) comprising a management entity (ENT) as defined in claim 9.

11. Computer program capable of being implemented on a management entity (ENT) as defined in claim 9, the program comprising code instructions which, when executed by a processor, performs the steps of the method defined in claim i

12. 1. Data carrier on which at least one series of program code instructions for executing a method according to claim 1 has been stored.

Citation Information

Patent Citations

  • Method for delivering audio and / or video contents to a player

    EP3833038A1

  • Contents conversion apparatus and transcode system

    US20060227864A1

  • System and method for optimized delivery of live ABR media

    US20160269801A1