Advanced management of a visual code being displayed in multimedia content

Abstract

In order to transmit data associated with a visual code appearing at least temporarily in multimedia content being played on a connected screen, the following steps are provided: - establishing pairing (IDTV, IDSM) between the screen (ECR) and at least one second connected terminal (SM), separate from the connected screen (ECR); - at least during playback of the multimedia content comprising the visual code, making available to a user of the screen a human / machine interface (RC) connected to the screen to send a request for data associated with the visual code; and - upon receiving the request for data associated with the visual code from the connected screen, transmitting said data associated with the visual code to the second connected terminal (SM), the visual code appearing at a given timestamp after the start of playback of the multimedia content, a request for data associated with the visual code, originating from the connected screen, is interpreted as being associated with said visual code if the request is received within a predefined time range after said given timestamp.

Description

Improved handling of visual code being displayed in multimedia content

[0001] This disclosure relates to the field of data transmission associated with a visual code appearing at least temporarily in multimedia content.

[0002] Such a visual code can be, for example, a one- or two-dimensional barcode, also known as a “QR code” for “quick response code”.

[0003] Such codes may be temporarily present in multimedia content, such as a television program currently being broadcast. Optical reading of such a code, for example using a smartphone-type terminal, usually makes it possible to retrieve information on the smartphone relating to a service associated with this code (for example after activating a hyperlink displayed on the smartphone).

[0004] For example, some television programs display a 2D QR code to access information from a mobile device. Sometimes, the display time of this code is only a few seconds at most.

[0005] A viewer then has to take a photo with a barcode scanning app using their smartphone.

[0006] However, not all viewers necessarily have this application on their smartphone, or their smartphone within reach when they watch television, or some are not very comfortable with this manipulation.

[0007] Furthermore, such manipulation involves getting up and moving closer to the television screen during the broadcast of the program in order to correctly enter the visual code with your smartphone and sometimes the duration of the code display is not sufficient to carry out this operation successfully. Summary

[0008] This disclosure improves the situation.

[0009] A method is proposed for transmitting data associated with a visual code appearing at least temporarily in multimedia content being played on a connected screen, the method comprising: - establishing a pairing between the screen and at least one second connected terminal, distinct from the connected screen, - at least during the playback of the multimedia content comprising said code, providing a user of the screen with a human / machine interface connected to the screen to issue a request for the data associated with the visual code, and - upon receipt of the request for the data associated with the visual code from the connected screen, implementing a transmission of said data associated with the visual code to the second connected terminal, the visual code appearing at a given timestamp after the start of playback of the multimedia content, a request for the data associated with the visual code, from the connected screen,is interpreted as associated with said visual code if the request is received within a predefined time range after said given timestamp.,

[0010] Thus, in such an embodiment, the user only has to activate the human / machine interface connected to the screen (for example a television remote control with a specific button) to launch a request for data associated with the visual code currently being displayed by the screen, and, thus, the user's second terminal (for example a smartphone separate from the television screen) receives this data, without disrupting the current playback of the multimedia content, nor disturbing the user during this playback.

[0011] Advantageously, such a time range can take into account a user reaction latency and extend over a minute or more for example.

[0012] For example, in one embodiment, the screen can be connected to a remote server to receive and play the multimedia content, and: - the connected screen transmits to this remote server the request for the data associated with the visual code, and, - a pairing data item being stored in the memory of the remote server, the remote server identifies, based on this pairing data item, the second terminal as the recipient of the data associated with the visual code.

[0013] Thus, the second terminal can receive (for example by SMS or other means of messaging) the data associated with the visual code.

[0014] Alternatively to such an embodiment, the connected screen can transmit to the second terminal this data that it has previously acquired from the server, for example via a local network powered by a gateway and to which both the second terminal and the connected screen are connected. This alternative embodiment is described in detail below.

[0015] For example, the second terminal receives this data in the form of an access link to a service associated with the visual code (for example a hyperlink, html type or others).

[0016] In an exemplary embodiment, the multimedia content is received by the connected display by implementing a broadcast protocol. Thus, this content may typically be a television program for example.

[0017] The broadcast protocol may be, for example, of the HBBTV type (for "Hybrid Broadcast Broadband TV"), for example over IP. Such a protocol in particular offers the advantage of including in the television image data stream descriptive metadata of events in the stream, such as, for example, the expected appearance of the aforementioned visual code, including a timestamp expected for such an appearance.

[0018] In one embodiment, the visual code is typically a barcode (one or two dimensions) whose optical reading usually makes it possible to retrieve the data associated with the visual code, this data being associated with a service accessible via the second terminal (for example via a hyperlink). However, in the present disclosure, the human / machine interface uses a means distinct from conventional optical reading to request the data associated with the visual code.

[0019] For example, the human / machine interface may include a remote control with a specific button, pressing this specific button causing the transmission of the data request associated with the visual code.

[0020] Alternatively or in addition, the human / machine interface may include a voice recognition module (and more particularly speech recognition), and a pronunciation of at least one specific keyword (or a predefined succession of specific keywords) by the user causes the transmission of the request for data associated with the visual code.

[0021] In the case of a specific remote control button, the connected screen can be integrated into a connected television, and the human / machine interface available to the user can then include a remote control for the television, this remote control including a specific button for sending the request for data associated with the visual code.

[0022] In addition or as a variant, the screen can also be connected to a content reception terminal, of the set-top box type, and the human / machine interface available to the user can include a remote control of the set-top box terminal, this remote control then including the aforementioned specific button for sending the request for said data associated with the visual code.

[0023] The present disclosure also relates to a connected screen, configured to display multimedia content in which a visual code appears at least temporarily, the screen comprising: - a first communication interface with a human / machine interface for receiving a command to receive data associated with the visual code, and - a second communication interface with a remote server for transmitting to the remote server a request for said data associated with the visual code, the visual code appearing at a given timestamp after the start of playback of the multimedia content, a request for data associated with the visual code, originating from the connected screen, is interpreted as associated with said visual code if the request is received within a predefined time range after said given timestamp.

[0024] The present disclosure also relates to a system comprising at least one such connected screen and a human / machine interface, for implementing the method defined above.

[0025] In such a system, the aforementioned human / machine interface can then include a remote control comprising a specific button for sending the request for said data associated with the visual code.

[0026] However, such an embodiment is optional and as an alternative to providing a remote control having a specific button, a specific button can be provided on a computer keyboard connected to the aforementioned screen.

[0027] According to another aspect, there is provided a computer program comprising instructions for implementing the method as defined herein when this program is executed by a processor. According to another aspect, there is provided a non-transitory recording medium, readable by a processor, on which such a program is recorded.

[0028] Other features, details and advantages will become apparent upon reading the detailed description below, and upon analyzing the attached drawings, in which: Fig. 1

[0029] illustrates an example system for implementing the above method, according to one embodiment. Fig. 2

[0030] illustrates the main steps of an example method according to one embodiment. Fig. 3

[0031] illustrates a processing circuit comprising a processor, for example of a server capable of implementing the method illustrated in the, according to an exemplary embodiment.

[0032] Reference is now made to the. A connected screen ECR is connected via a wide area network NET to a server SER capable of delivering multimedia content CM which can be displayed on the connected screen ECR. At a predefined time of broadcasting of the multimedia content, a visual code CB such as a QRC barcode appears in the content and the screen ECR then displays this code CB. A user UT viewing the multimedia content on the screen ECR has a remote control RC comprising in particular a specific button BC. Pressing this button BC causes the emission of a remote control signal (for example infrared) received by a receiver RRC of the connected screen and interpreted by the connected screen ECR as being a request from the user UT to receive data associated with this visual code CB.

[0033] In the example illustrated in solid lines, the connected screen ECR is part of a connected television, capable of communicating directly with the remote server SER.

[0034] Alternatively, the ECR screen can be connected to a video stream receiving STB terminal, such as a set-top box. This STB terminal (represented by dotted lines in this variant) can itself be connected to the SER server, for example via a gateway of a local network GW. In this variant, the RC remote control controls the operation of the STB terminal (for example to change broadcast channels, increase the sound, etc.) and the STB terminal has a receiver RRC' for this purpose to receive the signals from the remote control, and in particular the data request signal associated with the visual code CB, which follows pressing the specific button BC on the remote control.

[0035] In either of these embodiments, pressing the BC button allows a request to be sent to the SER server, provider of the CM content currently being broadcast, via a link according to the HBBTV protocol for example (for "Hybrid Broadcast Broadband TV") over IP for example. Upon receipt of this request, the SER content provider server sends a notification (by SMS or other) to at least one second connected terminal, for example the smartphone of the SM user, with for example in the notification data of a link allowing the UT user to have access to a service associated with the CB code (the link giving for example access to a web page presenting such a service).

[0036] In order for the second SM terminal to receive this data from the server, the UT user first registers, with the SER content provider server, one or more smartphone IDSM numbers in association with an IDTV identifier for their connected television (this identifier may be, for example, an email address, an IP address or other). This registration can be done directly on the television user's customer account, online on the content provider's customer account or on the GW box of the Internet service provider.

[0037] Thus, referring now to the, in the example shown, during a first step S1, the server for example stores in memory at least one pairing data between a connected screen identifier and an identifier of the second terminal SM (for example an MSISDN number). During a current step S2, the server then broadcasts multimedia content CM from a known timestamp. This broadcasting can be carried out according to the HBBTV protocol (for example over IP), which makes it possible to add metadata to the broadcast stream, in particular time metadata. Thus, the start time of broadcasting of the content can be known in particular to the connected screen, as well as a possible time of appearance of a visual code in the images of the content. In step S3, the connected screen (or the set-top box device) can read this metadata and in particular determine whether such a visual code is or will soon be present in the images of the content.If applicable, the connected screen can then open a time range at step S4 which begins, for example, at the expected time of appearance of the visual code in the multimedia content.

[0038] This time range can take into account a user reaction latency and close well after the code appears, for example a few minutes later. Such an implementation allows the user to have time to react by pressing the specific remote control button to obtain the data associated with the visual code.

[0039] Alternatively, this time range can be opened to listen to a specific succession of keywords (for example “access to this service”) that the user could pronounce to access the data associated with this visual code, in an embodiment where the human-machine interface is a voice interface. Advantageously in this embodiment, the operation of the connected screen is not disturbed if the user pronounces such keywords in a different context, outside this time range.

[0040] Of course, in another variant, the connected screen can send all requests, for example if a specific button on the remote control has been detected. The server, for its part, can open the aforementioned time window when a visual code is determined to appear in the images of multimedia content being broadcast. Then, the server processes these requests if they arrive within this time window, or ignores them otherwise.

[0041] Of course, the previous implementation, where the connected screen filters the requests itself, can be preferred so as not to overload the NET network or the SER server.

[0042] In any of these embodiments, when the server receives such a request in step S5, the server can consult in its memory the pairing data between the connected screen which transmits this request and the second terminal to which it must send the data of the access link to the service associated with the code which has just been broadcast.

[0043] Advantageously, the request may contain, for example: - information on the program currently being broadcast (for example, a particular television channel among a group of channels), allowing the server to identify the visual code that has been inserted into this program, - a current timestamp at which the user pressed the specific remote control button, which may allow the server to confirm that this timestamp is indeed compatible with the planned time of broadcasting of the visual code in the given program, and that this timestamp is indeed within a current time range, - and at least one connected screen identifier (or set-top box device, or gateway) such as an IP address, or an account address (email address or customer account number for the content broadcasting service, or other), which allows the server to find in its memory, in step S6, the coordinates of the second terminal SM.

[0044] In step S7, the server then sends the data associated with the visual code to the second terminal, in a message addressed according to the IDSM coordinates of this second terminal based on the contents of its memory. Of course, the server can store several smartphone-type terminal identifiers and send this data to a plurality of terminals.

[0045] Furthermore, the choice of at least one terminal to which to send the notification can be left to the user. For example, upon action of the human-machine interface (remote control or voice), a choice can be offered to the user by overlay in the current display on the screen in order to let the user select the second terminals to which he wishes the notification of the link to be sent (for example: all, or smartphone number 1 (possibly an identifier of the “pseudo” type), smartphone number 2 (or pseudo), etc.) in order to receive the notification of the link on all terminals or only on the selected terminals.

[0046] In this example of the, the server can carry out the illustrated steps S1 to S7. For this purpose, the server that can comprise, as illustrated on the, a communication interface COM with a wide area network NET, as well as a processor PROC and a storage memory MEM for storing in particular the pairing data. In an exemplary embodiment, this memory MEM also stores the instruction data of a computer program for implementing the method according to the, when the processor PROC reads and executes these instructions.

[0047] However, the embodiment according to which the method is carried out by a server allows for possible variants. For example, the connected screen can temporarily store metadata of the HBBTV stream which can typically include the data of the access link to the service associated with the visual code currently being displayed. Upon detection of the pressing of the specific button on the remote control, the connected screen retrieves this link data in its temporary memory and transmits it itself to the second terminal, without going through the content server, for example via a GW gateway of a local network to which the ECR screen and the second terminal are connected (for example by Wi-Fi connection).

[0048] Furthermore, a specific button for a remote control of a connected television or set-top box type device has been described above. However, this specific button can also be provided on a computer keyboard (physical or tactile), this keyboard being connected to a screen (computer, tablet, television or other).

Claims

A method for transmitting data associated with a visual code appearing at least temporarily in multimedia content being played on a connected screen, the method comprising: - establishing a pairing between the screen and at least one second connected terminal, distinct from the connected screen, - at least during the playback of the multimedia content containing said code, providing a user of the screen with a human-machine interface connected to the screen to issue a request for the data associated with the visual code, and - upon receipt of the request for the data associated with the visual code from the connected screen, implementing a transmission of said data associated with the visual code to the second connected terminal. The visual code appears at a given timestamp after the start of playback of the multimedia content, and a request for the data associated with the visual code originates from the connected screen.is interpreted as associated with said visual code if the request is received within a predefined time range after said given timestamp. A method according to claim 1, wherein, the screen being connected to a remote server to receive and read said multimedia content: - the connected screen transmits to said remote server the request for the data associated with the visual code, and, - a data of said pairing being stored in the memory of the remote server, the remote server identifies, according to said pairing data, the second terminal as the recipient of the data associated with the visual code. A method according to any one of the preceding claims, wherein the second terminal receives said data in the form of an access link to a service associated with the visual code. A method according to any one of the preceding claims, wherein the multimedia content is received by the connected screen by implementing a broadcast protocol. A method according to any one of the preceding claims, wherein the visual code comprises a barcode whose optical reading allows the retrieval of said data associated with the visual code, said data being associated with a service accessible via the second terminal, and wherein the human / machine interface uses a means distinct from optical reading to request said data associated with the visual code. A method according to any one of the preceding claims, wherein the human / machine interface comprises a remote control including a specific button, pressing said specific button causing the transmission of said request of the data associated with the visual code. A method according to any one of the preceding claims, wherein the human / machine interface includes a speech recognition module, the pronunciation of at least one specific keyword by the user causing the transmission of said request of the data associated with the visual code. A method according to any one of the preceding claims, wherein, the connected screen being integrated into a connected television, the human / machine interface available to the user includes a remote control of the television, said remote control having a specific button to issue the request for said data associated with the visual code. A method according to any one of the preceding claims, wherein, the screen being connected to a content receiving terminal, of the set-top box type, the human / machine interface available to the user includes a remote control of the set-top box terminal, said remote control having a specific button to issue the request for said data associated with the visual code. Computer program comprising instructions for implementing a method according to one of the preceding claims, when this program is executed by a processor. Connected screen, configured to display multimedia content in which a visual code appears at least temporarily, the screen comprising: - a first communication interface (RRC; RRC', STB) with a human / machine interface (RC) to receive a command to receive data associated with the visual code, and - a second communication interface with a remote server (SER) to transmit to the remote server a request for said data associated with the visual code, the visual code appearing at a given timestamp after the start of playback of the multimedia content, a request for data associated with the visual code, from the connected screen, is interpreted as associated with said visual code if the request is received within a predefined time range after said timestamp. System comprising at least one connected screen according to claim 11 and a human / machine interface, for implementing the method according to one of claims 1 to 9. System according to claim 12, wherein the human / machine interface comprises a remote control including a specific button for issuing the request for said data associated with the visual code.

Images