Method for managing access, via a reading device, to multimedia content after the sound has been muted.

Abstract

Method for managing the playback of audio content. The invention relates to a method for managing access, by a playback device (STB), to multimedia content comprising audio (Sa1) and video (Sv1) segments downloaded successively for playback, characterized in that the reception of data representing a sound interruption (SND OFF) by the playback device (STB) of the content results in a stoppage of the download of the audio segments (Sai, Sai+1,…). Figure 3.

Description

Title of the invention: Method for managing access, by a reading device, to multimedia content after the sound has been cut off. technical field

[0001] The invention relates to the field of telecommunications.

[0002] The invention relates to a method of managing access, by a reading device, to multimedia content, after the sound has been cut off.

[0003] A reading device refers to devices capable of receiving a multimedia stream and requesting a rendering of the content on a rendering device. State of the art

[0004] When accessing multimedia content, the playback device sends a request to a content server indicating the selected multimedia content (video and / or audio). The playback device receives in return a stream of digital data relating to this content. The received data is then decoded by the playback device and subsequently displayed.

[0005] In the case of audio-video content, the rendering is carried out in the form of a display of the corresponding video with its associated soundtrack.

[0006] The distribution of multimedia content over the Internet is often based on client-server protocols of the HTTP (Hyper Text Transport Protocol) family. In particular, progressive downloading of content, also called streaming, allows data to be transported and read in real time; that is, digital data is transmitted over the network and received by the playback device as it arrives. After receiving the stream, the playback device stores the received data in a buffer before playing it back. This distribution method is particularly useful when the user's available bandwidth is not guaranteed for real-time video transfer.

[0007] Adaptive progressive downloading, in English HTTP Adaptive Streaming, abbreviated HAS, also allows data to be transmitted and received at different qualities corresponding, for example, to different respective encoding bitrates. These different qualities are described in a description file, also called a "Manifest" by those skilled in the art.

[0008] When a user accesses the Live stream broadcast via HTTP Adaptive Streaming (HAS), the playback device, through an HAS download management entity, retrieves successive description files at regular intervals, generally every two seconds, each of which generally describes the last sixty seconds of the stream (30 two-second segments) by providing segment addresses. corresponding to the last sixty seconds. This description file includes URLs of downloadable segments.

[0009] When reading multimedia content in adaptive streaming, the reading device, understood to be the downloading entity HAS, regularly retrieves the audio segments and video segments using the addresses on the network (for example URLs, the Anglo-Saxon acronym for "Uniform Resource Locator") of the segments described in the last description file received, respectively.

[0010] The audio and video segments are downloaded at approximately the same rate, and the playback device stores (those skilled in the art refer to this as "buffering") the audio and video segments received by the playback device at the same buffer depth. The terms buffer and buffer will be used interchangeably in this text.

[0011] Also, when playing audio and / or video content, it is possible for the user to mute the audio output so as to completely cut off the sound.

[0012] The inventors observed that after the sound was turned off, the playback device continued to download audio segments unnecessarily. These unnecessary downloads consume bandwidth on the telecommunications operator's network, which is undesirable.

[0013] The invention improves the situation.

[0014] To this end, the invention relates to a method of managing access to audio segments of multimedia content downloaded successively, the segments being intended to be received by a playback device for the purpose of sound playback, characterized in that the reception of data representing a break in the sound by the playback device during the playback of the content causes a stoppage of the reception of audio segments.

[0015] According to the invention, when the sound is muted, the playback device ceases to receive audio segments; these are no longer unnecessarily downloaded, thereby improving the bandwidth on the network over which the segments are downloaded. It will be seen later that, when the content is audio-video content, the playback device continues to play the content only at the base of the downloaded video segments.

[0016] According to a first particular embodiment of the invention, a sound interruption results in a halt to the transmission of requests to access the audio segments. This first embodiment is a simple way to terminate the transmission of audio segments by stopping the messages requesting segments. Note that in this first embodiment, the interruption may affect all or part of the audio access requests.

[0017] According to a second particular embodiment of the invention, which may be implemented alternatively or cumulatively with the previous one, following the interruption of the sound, the reading of the content continues by reading a substitute audio segment. This mode is useful when the content is audio-video and the playback device can only play the content if both audio and video segments are stored in its buffer. In this second mode, since the playback device no longer downloads audio segments, the replacement segment allows the device to fill the audio buffer and continue playback based on a downloaded video segment and the replacement segment. The replacement segment can be the same audio segment used for each video playback; the chosen replacement segment can also be different for each playback. This second mode prevents abrupt playback interruptions due to the cessation of audio segment downloads and the resulting empty audio buffer.

[0018] According to a first variant of the second mode, the replacement segment is a segment downloaded and stored in the playback device before the sound is cut off. In most playback devices, several segments are stored in an audio buffer before being played and then erased after playback; indeed, in some playback devices, once playback has started, the playback device attempts to fill a buffer with a data level reaching approximately twenty seconds, or roughly ten two-second segments. The replacement segment can be chosen from among the last ten stored segments.

[0019] According to a second variant of the second mode, before the sound stops, a segment can be deleted after playback; in this configuration, following the stoppage, the method includes preventing the deletion of a downloaded audio segment and using this segment as a replacement segment. Using the above example of ten ten-second segments, the replacement segment can be chosen from among the last ten stored segments.

[0020] According to a sub-variant of this second variant, preventing deletion involves intercepting a deletion command. Once intercepted, the command is not executed, the segment targeted for deletion is not erased, and can be used as a substitute audio segment during continued playback of the content.

[0021] According to a third embodiment of the invention, which may be implemented alternatively or cumulatively with the preceding ones, the content further includes video segments; in this case, as indicated above, following the cessation of the downloading of the audio segments, the playback of the content is continued by downloading and playing the video segments.

[0022] From a material perspective, the invention relates to an access management entity, via a reading device, for multimedia content comprising audio and video segments downloaded successively for playback, characterized in that it comprises a receiving module capable of receiving data representative of a sound interruption by the content playback device and a stop module capable of causing, following the reception of data representing a sound interruption, a stop to the downloading of audio segments.

[0023] According to another material aspect, the invention relates to a reading device characterized in that it includes a management entity as defined above.

[0024] According to another material aspect, the invention relates to a computer program suitable for implementation in a management entity as defined above, said program comprising code instructions which, when the program is executed, performs the step defined in the process defined above.

[0025] According to another material aspect, the invention relates to a data processor readable recording medium on which is recorded a program comprising program code instructions for the execution of the steps of the process defined above.

[0026] It should be specified here that the data carrier can be any entity or device capable of storing the program. For example, the carrier can include a storage means, such as a ROM, for example a CD-ROM or a microelectronic circuit ROM, or a magnetic recording means, or a hard drive. On the other hand, the information carrier can be a transmissible medium such as an electrical or optical signal, which can be transmitted via an electrical or optical cable, by radio, or by other means. The program according to the invention can, in particular, be uploaded to a network such as the Internet. Alternatively, the information carrier can be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the method in question.

[0027] The invention will be better understood upon reading the following description, given by way of example and with reference to the accompanying drawings in which:

[0028] [Fig. 1] represents a computer system in which the invention can be implemented.

[0029] [Fig.2] is a schematic view of the circuits present in the reading device.

[0030] [Fig.3] is an algorithm illustrating a sequence of steps implemented according to a mode of possible realization of the invention in which the accessed content is audio and video content.

[0031] Detailed description of an example embodiment illustrating the invention:

[0032] Figure 1 represents a computer system SYS in which a content distribution network, referred to as a CDN (Content Distribution Network) by those skilled in the art, is implemented. Content is transmitted from this network to client devices or content playback devices, along with description files associated with the multimedia content. The content delivery server, referred to in the This text is a content server, broadcasting on several broadcast channels associated with television channels.

[0033] In our example, for the sake of simplicity, the SYS system comprises a single STB reading device. However, the invention applies to any number of reading devices, as the principle of the invention can be implemented on all or part of the STB reading devices.

[0034] The STB reading device is a digital content reading device such as a decoder.

[0035] The multimedia content referred to here is audio and / or video content. Audio content is, for example, a radio broadcast, and video content is, for example, a television channel. The content is broadcast from one or more servers described below. It will be seen later that the invention applies equally to audio content and to audio-video content.

[0036] In our example, the STB playback device is connected to a TV output terminal such as a television. The device can transmit data to be output to the TV output device. A mute command allows the sound on this TV output device to be muted. The command can be sent from a remote control received directly by the TV output device or via the STB playback device.

[0037] In our example, the STB reading device is connected to a port of the TV playback device; the STB reading device and the TV playback device could also form a single device.

[0038] In our example, the STB reading device is located in a local area network (LAN) managed by a GTW home gateway.

[0039] The GTW gateway is capable of communicating via a communication link LU which may be a telecommunications network such as a WAN known to a person skilled in the art.

[0040] In our example, the SYS computer system implements a content distribution network called a CDN (Content Distribution Network) by those skilled in the art, from which content is transmitted to STB content reading devices.

[0041] The CDN network consists of networked servers in the wide area network; these servers cooperate to make multimedia content available to users. To simplify the description of the invention, a single SRV content server will be shown in [Fig. 1] to represent the CDN. In our example, the SRV content server is located in the wide area network (WAN).

[0042] The SRV content server receives, for example, digital television content channels from a broadcast television network (not shown), and makes them available in real time to client terminals, here the STB playback device, via broadcast channels.

[0043] Figure 2 represents the architecture of an STB reading device. This STB device typically comprises MEM1 memories associated with a CPU1 processor. The memories can be of the ROM (Read Only Memory) or RAM (Random Access Memory) type, or even Flash.

[0044] The STB reading device can transmit content to be played back to the TV playback device via a COM 12 communication module. This COM 12 module is, for example, an LI2 link of the HDMI type.

[0045] The STB reading device communicates with the gateway via an Ethernet module for wired local communication or via a Wi-Fi radio module for wireless local communication with the GTW residential gateway. The module in question is referenced as C0M11 in [Fig.2].

[0046] In our example, the STB reading device includes a download management entity in streaming mode H AS (http Adaptive Streaming), not shown, capable of managing the downloading of content segments when the content is transmitted over the LU network in the form of segments in accordance with the so-called adaptive streaming technique known to the person skilled in the art.

[0047] Let us briefly recall here that when a user accesses a live stream broadcast via HTTP Adaptive Streaming (HAS), the STB playback device receives, at regular intervals, for example every two seconds, successive description files that generally describe the last sixty seconds of the stream (30 segments of 2 seconds each) by providing URL-type addresses of segments corresponding to these last sixty seconds. Using the received segment addresses, the STB playback device can download the segments into a MEM1 memory (an audio buffer for the audio portion and / or a video buffer for the video portion), decode them, and play them back one after the other for playback on the TV playback device.

[0048] The SRV server is also equipped with at least one processor and memory for performing computer processing. The SRV server communicates with the GTW gateway via a WAN network.

[0049] The steps according to one embodiment are described below.

[0050] When the STB reading device accesses the content to read it, the following steps are taken:

[0051] The HAS entity accesses the segments successively by transmitting a download request for each segment. Requests for audio and video access are transmitted generally at roughly the same time and are also received by the STB reading device at almost the same time;

[0052] After reception, the STB playback device stores a number of audio and / or video segments in a RAM memory (an audio buffer and a video buffer) and decodes the segments so that they can be played back on the TV playback device.

[0053] Once transmitted to the TV playback device, the segments are erased from RAM memory.

[0054] Following a sound interruption on the TV playback device, according to the invention, the STB playback device no longer receives audio segments.

[0055] We will see later that, in the case of audio-video content, playback continues only at the base of the downloaded video segments.

[0056] In our example, the STB playback device stops receiving audio segments by ceasing to transmit access requests for the audio segments. According to an alternative, the STB playback device could also stop receiving audio segments by transmitting a request to the SRV server to stop the transmission of audio segments.

[0057] Figure 3 illustrates an embodiment of the method of the invention based on audio-video content.

[0058] On this [Fig.3]:

[0059] Requests to access audio segments will be referenced REQai;

[0060] Requests to access video segments will be referenced REQvi;

[0061] These requests include the URLs for accessing an audio segment Sai and a video segment Svi respectively.

[0062] The audio segments will be referenced Sai;

[0063] The video segments will be referenced Svi;

[0064] The index "i" denotes the nth segment.

[0065] Figure 3 shows two axes associated with the SRV server and the STB reading device, including the ENT management entity. Arrows represent data exchanges between the two entities. Note that the time differences between request transmission times or segment transmission times are not representative of reality; the illustrated example is simplified to highlight the principle of the invention, namely, the interruption of audio segment reception following a sound interruption.

[0066] This [Fig.3] illustrates two main phases: a first phase PHI of reading the content before the sound is cut off, and a second phase PH2 of reading the content after the sound is cut off.

[0067] During the first PHI phase preceding a sound interruption, the STB playback device transmits successive requests to access the audio and video segments: a first request REQal and RQvl, and receives in return an audio segment al and a video segment vl; and so on, the STB playback device transmits requests and receives in return the requested segments (not shown in the figure as they are not relevant to the description of the invention). Only the requests to access the first segment are shown in the figure for the sake of simplicity.

[0068] We now assume that a user of the TV playback device turns off the sound. This step is referenced SND OFF in [Fig.3].

[0069] The second phase PH2 comprises the following steps:

[0070] The STB reading device, meaning the ENT management entity, first receives data representing a sound interruption and executes the following steps.

[0071] Upon receiving the data relating to the sound cut-off, the ENT entity requests a halt to the transmission of access requests to the audio segments. In our example, the STB playback device then continues playback by transmitting successive access requests to the video segments only; in [Fig. 3], an access request to a video segment REQvi is transmitted and a video segment Svi is received in return, and so on, a REQv(i+1) request and a segment Vi+1, etc.

[0072] Another way of not receiving audio segments could also consist of intercepting requests to access the audio segments and preventing their respective transmissions to the server storing the audio segments.

[0073] It is now assumed, according to a particular embodiment of the invention, that the HAS management entity reads the content only if there is both an audio segment and a video segment in the respective buffers and that otherwise, reading is blocked and the content cannot be rendered.

[0074] In order to continue playback without interruption, one or more substitute audio segments are recorded in the audio buffer; For example, if the HAS entity has to record ten audio segments in the buffer to guarantee playback, the ten segments are replaced, for example, by the same substitute segment; the segments recorded in the buffer can also be reused.

[0075] Since the replacement audio segments and the downloaded video segments are stored in the audio and video buffers, the HAS entity can read the segments and request playback of the segments on the TV playback device.

[0076] In other words, the audio segments that should have been downloaded are replaced by other substitute audio segments. A substitute segment can be chosen in several ways, including the following:

[0077] According to a first method, the replacement segment is the last segment received by the STB playback device. Instead of being erased after reading from the audio buffer, The ENT management entity prevents the segment from being deleted from the audio buffer. This mode allows a replacement audio segment to be maintained in the audio buffer, reusable multiple times during the playback of successive video segments.

[0078] According to a second variant, following the interruption of the sound, the audio segments downloaded into the audio buffer are not deleted after playback. These audio segments can be reused during content playback in place of the segments that should have been downloaded and described in the last description file received after the sound was interrupted. In other words, after the sound is interrupted, the audio segments described in the description files are not used and are replaced by substitute segments. The player therefore does not take into account the URLs of the audio segments.

[0079] The prevention referred to above may consist of intercepting a deletion command so that it is not executed by the processor of the STB playback device. This prevention makes it possible to keep the downloaded segments in the audio buffer so that they can be reused as needed during content playback.

[0080] Let us specify here that, in our example, the audio segment is received and recorded in an audio buffer; the segment player installed in the STB playback device is, in our example, an "Adaptive Streaming" player running in a web browser. This player manages not only the storage in the audio buffer but also the storage of a sufficient number of segments to ensure uninterrupted playback of the content; generally, the buffer depth is fifteen to twenty seconds.

[0081] Preferably, a replacement segment is a segment that has already been decoded and is ready to be transmitted for playback. This method avoids decoding the replacement segment each time a reading of that segment is requested; this reduces the processor resource of the STB playback device with each segment read.

[0082] Note that when the sound is activated again, the download process resumes as normal by downloading both audio and video segments until the next possible interruption.

[0083] Let us also specify here that the term segment referred to in the embodiment of HAS type segments; however, the invention extends to any type of similar segments.

[0084] Finally, it should be noted here that, in this text, the term "module" or "entity" can refer to a software component, a hardware component, or a set of hardware and software components. A software component itself corresponds to one or more computer programs or subprograms, or more generally to any element of a program capable of implementing a function or set of functions as described for the modules concerned. Similarly, a hardware component corresponds to any element of a set hardware capable of implementing a function or set of functions for the module in question (integrated circuit, smart card, memory card, etc.).

Claims

Demands

1. Method of managing access, by a playback device (STB), to multimedia content comprising audio and video segments downloaded successively for playback, characterized in that the reception of data representing a sound cut-off (SND OFF) by the playback device (STB) causes the downloading of audio segments to stop.

2. Management method according to claim 1, characterized in that a cut-off results in a stoppage of the transmission of requests to access the audio segments.

3. Management method according to claim 1, characterized in that, following the interruption of the sound, the playback of the content continues by playing a substitute audio segment.

4. Management method according to claim 3, characterized in that the replacement segment is a segment downloaded and stored in the playback device before the sound cut-off.

5. A management method according to claim 3, characterized in that following the interruption of the sound, the method includes preventing the deletion of an audio segment downloaded after playback and using this segment as a replacement segment.

6. Management method according to claim 5, characterized in that an prevention of erasure includes an interception of an erasure command.

7. Management method according to claim 4, characterized in that the substitution segment is a segment that has been decoded.

8. Management method according to claim 1, characterized in that the content further includes video segments, and in that following the stoppage, the reading of the content is continued by downloading and reading the video segments.

9. Management entity (ENT) for managing access, by a playback device (STB), to multimedia content comprising audio and video segments downloaded successively for playback, characterized in that it comprises a receiving module capable of receiving data representing a sound interruption by the content playback device and a stopping module capable of causing, following the reception of the data representing a sound interruption, a stop to the downloading of the audio segments.

10. Reading device (STB) characterized in that it comprises a management entity (ENT) as defined in claim 9.

11. A computer program capable of being implemented in a management entity as defined in claim 9, said program comprising code instructions which, when the program is executed, performs the step defined in claim 1.

12. Data processor readable recording medium on which is recorded a program comprising program code instructions for carrying out the steps of the process defined in any one of claims 1 to 6.

Images