Method and device for obtaining at least one piece of data associated with audiovisual content being viewed by a user

Abstract

The invention relates to a method for obtaining at least one piece of data associated with audiovisual content being broadcast, said method being implemented by a data acquisition device (DISP) and characterized in that it comprises: a step of obtaining (300) a portion of said audiovisual content during a current time period, referred to as the current segment; a step of determining (301) a digital fingerprint of said current segment; a step of transmitting (302) said digital fingerprint to an application server; a step of receiving (303), from said application server, at least one piece of data associated with said audiovisual content. Figure 1

Description

Title of the invention: Method and device for obtaining at least one piece of data associated with audiovisual content currently being viewed by a user

[0001] 1. Field of the invention

[0002] The present invention relates to the field of telecommunications and more particularly concerns digital audiovisual services provided to a user.

[0003] 2. Prior Art

[0004] There are many options available to users for information and entertainment. Television, radio, and Internet content remain the preferred means of doing so. In 2019, the estimated average time spent per day in front of television and the Internet worldwide was approximately six hours.

[0005] Generally speaking, it is not uncommon for these audiovisual contents to be consumed while the user is busy doing something else (driving, working, cooking, etc.). Note that these audiovisual contents can be content broadcast live or delayed. When the user is interested in content, for example a radio program, he may be frustrated at not being able to listen to it in its entirety if the task he is performing at the same time does not allow him to do so. This is the case, for example, when the user is waiting for someone and that person has just arrived while the program is not yet finished. Similarly, the user may wish to listen to the beginning of a radio program taken during broadcasting.

[0006] To do this, the user has the option of viewing the recording of the radio program (podcast) via specialized service platforms. However, this assumes that the user knows how to find the desired content. In concrete terms, for the search, the user must at least know certain information such as the name of the program and / or the broadcaster. However, this information is not always known to the user.

[0007] Furthermore, even if the user obtains the desired content, it may take some time to find the passage of interest within that content.

[0008] Thus, there is a need for a technical solution allowing a user to consult and / or resume consultation of partially consulted audiovisual content, previously consulted by the user during its broadcast by a television broadcasting medium (radio, internet, television, etc.).

[0009] 3. Statement of the invention

[0010] The invention improves the state of the art and proposes for this purpose a method for obtaining at least one piece of data associated with audiovisual content being diffusion, said method being implemented by a obtaining device and characterized in that it comprises: - a step of obtaining a part of said audiovisual content during a current time period, called current segment; - a step of determining a digital fingerprint of said current segment; - a step of sending said digital fingerprint to an application server; - a step of receiving, from said application server, at least one piece of data associated with said audiovisual content.

[0011] Advantageously, this mode of implementation allows a user to obtain information related to the audiovisual content being viewed. Concretely, the method obtains a part of the content being viewed, for example via an audio and / or video capture / recording of the part of the content that is being broadcast. The duration of the capture / recording may be, for example, a few seconds or a few minutes (current time period). The method then determines a digital fingerprint of the part of the content previously recorded (current segment within the meaning of the invention). Once the digital fingerprint has been determined, it is sent to an application server. The application server then compares the received fingerprint with a plurality of fingerprints stored in a database, each stored fingerprint being associated with an audiovisual content and information relating thereto.When the comparison is positive, the process receives data from the application server allowing access to all or part of the information associated with the audiovisual content and / or the current segment.

[0012] A digital fingerprint is understood to mean the result of the application of a cryptographic function such as a hash function.

[0013] Audiovisual content means a sequence of sounds and / or images.

[0014] According to a particular embodiment of the invention, a method as described above is characterized in that said at least one data item is chosen from a group comprising at least: - the title of said audiovisual content; - the duration of said audiovisual content; - the description of said audiovisual content; - the name of the publisher and / or broadcaster of said audiovisual content; - the electronic address for viewing said audiovisual content; - an interactive link adapted to trigger the restitution of said audiovisual content; an index indicating the start of said current segment within said content audiovisual; an interactive link adapted to trigger the restitution of said content audiovisual at the beginning of said current segment; etc.

[0015] This embodiment allows the user, when the data includes an index indicating the start of the current segment within said audiovisual content or an interactive link adapted to trigger the restitution of said audiovisual content at the start of said current segment, to resume the consultation of the audiovisual content at the time corresponding to the current segment. Concretely, the user triggers the method just before stopping the consultation of the audiovisual content in order to save the moment when the consultation stops.

[0016] According to a particular embodiment of the invention, a method as described above is characterized in that said reception step is followed by a step of restoring said at least one item of data to said user.

[0017] This embodiment makes it possible to restore to the user, for example vocally or graphically, the information associated with the audiovisual content and / or the current segment.

[0018] According to a particular embodiment of the invention, a method as described above is characterized in that the transmission and reception steps are repeated following the reception of a notification from said application server;

[0019] This embodiment makes it possible to restart the search (comparison) of the digital fingerprint within the database when the latter is updated.

[0020] In the case where the user executes the method with audiovisual content not referenced within the database (i.e. the digital fingerprint is not included in the database) the method can, when the application server notifies the method of an update of the database (addition of content / information and associated digital fingerprint(s)), restart the steps allowing the obtaining of information associated with the audiovisual content and / or the current segment. This embodiment is particularly suitable for content broadcast live (the broadcast content is not recorded content). Indeed, audiovisual content broadcast live is very often recorded during its broadcast.The recordings are then processed (creation of digital fingerprints and associated information), then all the data associated with the audiovisual content and / or the current segment added to the consultable content (updating the database) via specialized service platforms (application server).

[0021] According to a particular embodiment of the invention, a method as described above is characterized in that the transmission and reception steps are repeated at regular time intervals.

[0022] This embodiment makes it possible to restart the steps allowing the obtaining of information associated with the audiovisual content and / or the current segment at regular time intervals (for example every hour, every day, every week, etc.).

[0023] This embodiment is particularly suitable for content broadcast live (the broadcast content is not recorded content). Indeed, audiovisual content broadcast live is very often recorded during its broadcast. The recordings are then processed (creation of digital fingerprints and associated information), then all of the data associated with the audiovisual content and / or the current segment added to the consultable content (updating the database) via the specialized service platforms (application server). Thus, this embodiment allows the method to regularly query the application server in order to verify that an update of the contents of the database does not contain the consulted audiovisual content and / or the current segment.

[0024] The invention also relates to a device for obtaining at least one piece of data associated with audiovisual content currently being broadcast, said device being characterized in that it comprises: - a module for obtaining a part of said audiovisual content during a current time period, called the current segment; - a module for determining a digital fingerprint of said current segment; - a module for transmitting said digital fingerprint to an application server; - a module for receiving, from said application server, at least one piece of data associated with said audiovisual content.

[0025] The term module can correspond to a software component as well as to a hardware component or a set of hardware and software components, a software component itself corresponding to one or more computer programs or subroutines or more generally to any element of a program capable of implementing a function or a set of functions as described for the modules concerned. In the same way, a hardware component corresponds to any element of a hardware assembly capable of implementing a function or a set of functions for the module concerned (integrated circuit, smart card, memory card, etc.).

[0026] The invention also relates to a terminal comprising an obtaining device as described above.

[0027] The invention also relates to a computer program comprising instructions for implementing the above method according to any of the particular embodiments described above, when said program is executed by a processor. The method can be implemented in various ways, in particular in hard-wired form or in software form. This program can use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0028] The invention also relates to a recording medium or information medium readable by a computer, and comprising instructions of a computer program as mentioned above. The recording media mentioned above can be any entity or device capable of storing the program. For example, the medium can comprise a storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or a magnetic recording means, for example a hard disk. Furthermore, the recording media can correspond to a transmissible medium such as an electrical or optical signal, which can be conveyed via an electrical or optical cable, by radio or by other means. The programs according to the invention can in particular be downloaded from a network such as the Internet.

[0029] Alternatively, the recording media may correspond to an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the method in question.

[0030] This obtaining device and this computer program have characteristics and advantages similar to those described previously in relation to the obtaining method.

[0031] 4. List of figures

[0032] Other characteristics and advantages of the invention will appear more clearly on reading the following description of particular embodiments, given as simple illustrative and non-limiting examples, and the appended drawings, among which:

[0033] [Fig-1] [Fig.l] illustrates an example of an environment for implementing the method of obtaining according to a particular embodiment of the invention;

[0034] [Fig.2] [Fig.2] represents the hardware architecture of a device for obtaining according to a particular embodiment of the invention;

[0035] [Fig.3] [Fig.3] represents in the form of an organizational chart the main stages of the method of obtaining according to a particular embodiment of the invention;

[0036] 5. Description of an embodiment of the invention

[0037] [Fig.l] illustrates an example of an environment for implementing the invention according to a particular embodiment of the invention. This environment can correspond to any location where the user is located (office, home, public transport, gym, etc.).

[0038] The user environment UT includes in particular one or more user devices EQ such as a tablet, a smartphone EQ1, a computer EQ2, a connected watch / bracelet (not shown) or any other connected object capable of interacting with the user.

[0039] These user devices are capable of communicating via, for example, point-to-point communication (WiFi®, Bluetooth®, etc.) or via a local LAN communication network. This network can be managed by a residential / professional / mobile PAS gateway connected to a data communication network of an R_EXT operator.

[0040] Advantageously, the user equipment EQ comprises one or more sensors, identical or different, configured to capture / record a part of an audiovisual content (current segment within the meaning of the invention). Note that the current segment can be an audio and / or video sequence.

[0041] The user equipment may also be able to determine at least one digital fingerprint of the current segment obtained.

[0042] In a variant, the EQ user equipment may be capable of rendering the audiovisual content to the user.

[0043] The user equipment(s) EQ may furthermore be capable of transmitting the digital fingerprint of the current segment to an application server SA.

[0044] The EQ user equipment(s) may comprise a DISP device implementing all or part of the obtaining method according to the invention which will be detailed below in relation to Figures 2 and 3. The DISP device may be partially or totally embedded in an EQ user equipment or in the plurality of EQ equipments.

[0045] According to one embodiment of the invention, the user equipment(s) EQ connected to the LAN communication network, the home / professional / mobile gateway and the application server SA form a system for obtaining at least one piece of data associated with audiovisual content.

[0046] We will now describe an example of hardware architecture of a obtaining device according to a particular embodiment of the invention in connection with [Fig.2].

[0047] The device DISP has the classic architecture of a computer, and notably comprises a memory MEM, a processing unit UT, equipped for example with a processor PROC, and controlled by the computer program PG stored in memory MEM. The computer program PG comprises instructions for implementing the steps of the obtaining method as described later in support of [Fig.3], when the program is executed by the processor PROC.

[0048] At initialization, the code instructions of the computer program PG are for example loaded into a memory before being executed by the processor PROC. The processor PROC of the processing unit UT notably implements the steps of the obtaining method according to any one of the particular embodiments described in relation to [Fig. 3] and according to the instructions of the computer program PG.

[0049] The DISP device comprises a GET module capable of obtaining a portion of audiovisual content (current segment) currently being viewed by the user UT. The audiovisual content is, for example, broadcast by a user device EQ or by another device. Obtaining the current segment is, for example, carried out via a camera and / or a microphone integrated or associated with the DISP device.

[0050] The DISP device also comprises a CALC module capable of calculating a digital fingerprint of the current segment obtained via the GET module. The digital fingerprint is for example obtained following the application of a cryptographic function (for example a hash function) to the data contained by the current segment.

[0051] The device DISP further comprises a module C0M1 capable of transmitting to the application server SA a request which comprises at least one digital fingerprint of the current segment. The digital fingerprint of the current segment can be electronically signed and / or encrypted by the device.

[0052] The DISP device also comprises a COM2 module capable of receiving a message from the application server SA comprising at least one piece of data associated with the audiovisual content consulted by the user. The data may be electronically signed and / or encrypted by the application server SA.

[0053] According to a particular embodiment, the COM2 module is also capable of receiving a notification from the application server SA indicating an update of the database of the contents managed by the application server.

[0054] According to a particular embodiment, the modules C0M1 and COM2 are configured to communicate via an IP network and / or circuit.

[0055] According to a particular embodiment, the modules C0M1 and COM2 can be a single communication module.

[0056] According to a particular embodiment, the DISP device comprises a restitution module (not shown) for audiovisual content and / or associated data. The restitution module may be a screen (touch or not), a video projector, a television, a speaker, or any other device capable of fulfilling the same objective.

[0057] [Fig. 3] illustrates steps of the obtaining method according to a particular embodiment of the invention. The environment for implementing the obtaining method corresponds to that described in support of [Fig. 1].

[0058] For example, user UT is at home and is waiting for a friend. While waiting for his friend, user UT listens to a web / IP radio using his EQ2 laptop connected to the PAS home gateway. More precisely, the user is listening to a program whose subject corresponds to one of his passions. The user's friend arrives and user UT must stop listening while the program is not yet finished.

[0059] Wishing to be able to listen to the rest of the broadcast a little later, the user UT triggers the execution of the obtaining process at the level of his smartphone (smartphone in English) EQ1.

[0060] During a first step 300, the method obtains / records for a predefined period of time (for example a few seconds or one to two minutes) the program broadcast by the laptop EQ2. The recording is for example carried out via the microphone of the smartphone EQ1. The recording corresponds to the current segment within the meaning of the invention.

[0061] According to a particular embodiment, the user equipment that broadcasts the audiovisual content can also be the one that executes the obtaining method. In this case the smartphone receives and broadcasts the content offered by the web radio. In addition, the current segment can then correspond to the data received from the web radio during the predefined period of time.

[0062] During step 301, the method determines at least one digital fingerprint of the current segment. The digital fingerprint(s) are for example obtained after applying a cryptographic function to the data constituting the current segment. The cryptographic function used to generate the digital fingerprint is for example a hash function.

[0063] According to a particular embodiment, the current segment can be divided into a sequence of segments of a predefined duration (for example one second) in order to obtain a sequence of digital fingerprints.

[0064] During step 302, the method transmits to the application server SA the digital fingerprint(s) determined during step 301 (digital fingerprint(s) associated with the current segment). Once the digital fingerprint(s) have been received by the application server SA, the latter searches for a total or partial match in a database (not shown). The database references, for example, a plurality of digital fingerprints of audiovisual content and associated data (information). This operation (comparison / search for the digital fingerprint(s)) makes it possible to identify the audiovisual content consulted by the user and to obtain associated information / data.

[0065] Note that when the match is a partial match, a threshold may be applied by the application server (for example 75%) in order to determine if the match is sufficiently high.

[0066] During step 303, the method receives, from the application server SA, a message comprising the data associated with the audiovisual content consulted by the user UT, data obtained from the database. The data may correspond to one or more elements of the following list: - the title of said audiovisual content; - the duration of said audiovisual content; - the description of said audiovisual content; - the publisher and / or broadcaster of said audiovisual content; - the electronic address for viewing said audiovisual content; - an interactive link adapted to trigger the restitution of said audiovisual content; - an index indicating the start of said current segment within said audiovisual content; - an interactive link adapted to trigger the playback of said audiovisual content at the start of said current segment; - etc.

[0067] Of course, other data may be associated with the audiovisual content consulted by the UT user in addition to or in replacement of these.

[0068] According to a particular embodiment, when no correspondence is found in the database or when the level of correspondence is determined as insufficient by the application server SA (lower than a predefined threshold), then the method receives a message, from the application server SA, notifying the absence of correspondence.

[0069] According to a particular embodiment, once the data has been received by the method, the latter restores the data to the user UT vocally (for example via a loudspeaker) or graphically (for example via a screen and / or a video projector). Note that the data can be restored to the user before, after (for example following), or during the restoration of the current segment.

[0070] It should also be noted that the current segments and the associated data obtained from the application server SA can be stored by the method in a digital storage space (database, file, memory card, etc.) for the purpose of being consulted later by the user.

[0071] According to a particular embodiment, steps 302 and 303 are repeated following the receipt of a notification from the application server SA.

[0072] The notification may for example indicate that the database has been updated with new audiovisual content fingerprints and new associated data. Once the notification has been received by the method, the latter re-emits the digital fingerprint(s) of the current segments of the audiovisual content previously consulted by the user UT for which the application server SA has not found any correspondence in order to obtain associated information.

[0073] This embodiment is particularly suitable for content broadcast live (the broadcast content is not recorded content). Indeed, audiovisual content broadcast live is very often recorded during its broadcast. The recordings are then processed (creation of digital fingerprints and associated information), then all of the data associated with the audiovisual content and / or the current segment added to the consultable content (updating the database) via specialized service platforms (application server).

[0074] According to a particular embodiment, steps 302 and 303 are repeated at regular time intervals. This embodiment allows the method to regularly check that the database has not been updated with new audiovisual content fingerprints and new associated data. Similarly, this embodiment is particularly suitable for content broadcast live (the broadcast content is not recorded content).

[0075] According to a particular embodiment, steps 302 and 303 are executed after a predetermined period of time (for example one hour, one day, etc.).

[0076] This embodiment allows the method, in the case where the audiovisual content consulted by the user is content broadcast live, to wait for the database to be updated with the fingerprint(s) of the audiovisual content consulted and the associated data.

[0077] According to a particular embodiment, the triggering of the method can be carried out via a voice command. This embodiment is particularly suitable when the user is performing a task that requires his attention. For example, the user may want to trigger the method vocally while driving (content listened to using the vehicle's radio).

[0078] It goes without saying that the embodiment described above has been given for purely indicative purposes and is in no way limiting, and that numerous modifications can easily be made by those skilled in the art without departing from the scope of the invention. According to other particular embodiments of the invention, the invention also applies to video-type content.

Claims

Claims

1. Method for obtaining at least one piece of data associated with audiovisual content currently being broadcast, said method being implemented by an obtaining device (DISP) and characterized in that it comprises: - a step of obtaining (300) a part of said audiovisual content during a current time period, called current segment; - a step of determining (301) a digital fingerprint of said current segment; - a step of transmitting (302) said digital fingerprint to an application server; - a step of receiving (303), from said application server, at least one piece of data associated with said audiovisual content; - reiteration, as a function of said at least one piece of data, of the transmission and reception steps following the reception of a notification from said application server.

2. Method according to claim 1 characterized in that said at least one data item is chosen from a group comprising at least: - the title of said audiovisual content; - the duration of said audiovisual content; - the description of said audiovisual content; - the name of the publisher and / or broadcaster of said audiovisual content; - the electronic address for viewing said audiovisual content; - an interactive link suitable for triggering the playback of said audiovisual content; - an index indicating the start of said current segment within said audiovisual content; - an interactive link suitable for triggering the playback of said audiovisual content at the start of said current segment.

3. Method according to claim 1 characterized in that said reception step is followed by a step of restoring said at least one piece of data to said user.

4. Device for obtaining at least one piece of data associated with audiovisual content being broadcast, said device being characterized in that it comprises:

5.

6. - a module for obtaining (GET) a part of said audiovisual content during a current time period, called the current segment; - a determination module (CALC) of a digital fingerprint of said current segment; - a transmission module (C0M1) of said digital fingerprint to an application server; - a reception module (COM2), from said application server, of at least one piece of data associated with said audiovisual content; - a module for repeating, based on said at least one piece of data, transmission and reception steps following the receipt of a notification from said application server. Terminal characterized in that it comprises an obtaining device according to claim 4. Computer program comprising instructions for implementing the method according to any one of claims 1 to 3, when the program is executed by a processor.

Images