Personalization of multimedia streams based on dynamic data from connected devices
The method personalizes multimedia streams using connected object data for real-time adaptation, addressing the limitations of outdated data-based personalization in existing systems by enabling dynamic and localized content selection.
Patent Information
- Application Number
- FR2020012149
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-11-25
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2040-11-25
AI Technical Summary
Existing multimedia broadcast systems lack real-time personalization based on dynamic user data, requiring prior subscription and using outdated semi-constant data for personalization, which does not adapt to changing user preferences or environments.
A method and device for personalizing multimedia streams by selecting a version of a multimedia stream segment based on dynamic data from connected objects, allowing real-time adaptation and local data processing without transmitting personal information to the transmitter.
Enables personalized multimedia streams that adapt to current user data, providing different views for the same user at different times and within households, reducing broadcaster data access, and optimizing bandwidth use.
Smart Images

Figure 00000026_0000 
Figure 00000026_0001 
Figure 00000026_0002
Abstract
Description
Title of the invention: Personalization of multimedia streams based on dynamic data from connected objects Technical field
[0001] The present invention relates to the field of multimedia stream broadcasting or distribution services. More specifically, the present invention relates to a method for personalizing a multimedia stream. In particular, the personalization of multimedia streams is carried out based on data originating from connected objects, in particular from the Internet of Things. Prior art
[0002] Television generally broadcasts the same content to all viewers.
[0003] As a growing number of televisions (currently 80% in France) are already connected to the Internet, personalized, i.e. segmented or targeted, television streaming services are currently emerging. These personalized television streaming services are also possible with non-connected televisions, in particular by using TV decoders. In particular, targeting television streaming is of interest to broadcasters for television news, advertising, etc.
[0004] These new forms of personalized television are planned based on the target's personal criteria, such as their geographic area, sociocultural category or even the number of people living in the household.
[0005] The same segmentation criteria are applied for advertising purposes by different online video content distribution platforms.
[0006] The prior art has several drawbacks. First of all, the personalization of the broadcast requires a prior subscription: the personalization of the broadcast is therefore carried out not for any user but for a customer. In addition, the personalization of the broadcast is pre-programmed according to data that are known in advance (for example data from the subscription, in particular the Internet subscription). Indeed, this data, such as the country or even the region of residence, the age, etc., is initially entered by the customer, for example, when subscribing to a service, and is rarely updated. In addition, this data used for the personalization of the broadcast is semi-constant data for a customer because it requires a modification of the subscription profile by the customer and / or the broadcast service provider, which only happens rarely. Summary
[0007] The present disclosure improves the situation.
[0008] A method for personalizing a multimedia stream is proposed, implemented by at least one data processing device, the method comprising, following detection of a multimedia stream segment comprising several personalized versions according to a predefined criterion, called customizable multimedia stream: a selection of a version of the multimedia stream segment from among the plurality of multimedia stream segment versions according to the predefined criterion and at least one value relating to the predefined criterion, the value having been obtained, prior to the selection, from at least one object connected to the processing device, the selection triggering a generation of a personalized multimedia stream whose personalized multimedia stream segment is constituted by the selected version of the customizable multimedia stream segment.
[0009] Also provided is a data processing device capable of personalizing a multimedia stream, comprising: a switch capable of selecting, following detection of a multimedia stream segment comprising several personalized versions according to a predefined criterion, called customizable multimedia stream, a version of the multimedia stream segment from among the plurality of multimedia stream segment versions according to the predefined criterion and at least one value relating to the predefined criterion, the value having been obtained prior to the selection of at least one object connected to the processing device, the selection triggering generation of a personalized multimedia stream whose personalized multimedia stream segment is constituted by the selected version of the customizable multimedia stream segment.
[0010] Such a reproduction device can be implemented internally to a receiver, this is the case for example of connected televisions or on the contrary be implemented in the form of a separate device capable of communicating with a receiver, this is the case for example of TV decoders.
[0011] Thus, it is possible to personalize the multimedia stream intended for a user by relying on data from an object connected to the processing device performing the personalization. Such data are, for example and in a non-limiting manner, recent personal data of the user, of his household or his accommodation, or even recent meteorological data.
[0012] The multimedia stream broadcast to a given user is therefore personalized in real time and, in particular, takes into account data likely to vary over time during the broadcasting of the multimedia stream.
[0013] This allows in particular that the same multimedia stream potentially gives different visualizations by the same user depending on the moment when he accesses this media stream. Such dynamic customization of the media stream allows for interactive playback of the media stream.
[0014] This also allows that within the same household, different users do not have the same visualization of a multimedia stream, in the case where at least one connected object provides strictly personal and not family data.
[0015] Knowledge of personal data by multimedia content broadcasters is further reduced because the broadcasters do not have access to the basic data from one or more connected objects. On the contrary, the data processing for the purpose of selecting a segment version is carried out exclusively locally, either by a data processing device communicating, for example via a local network, with at least one connected object, or directly by at least one connected object.
[0016] To the extent that such a customizable multimedia stream includes, for at least one segment, several possible versions, it is advantageous for these versions to be provided from the generation of the multimedia stream.
[0017] In this respect, a method for generating a customizable multimedia stream is proposed, implemented by a multimedia stream generator, the generation method comprising an integration into the multimedia stream of several personalized versions of at least one given stream segment, a personalized version of the stream segment being associated with a predefined criterion.
[0018] A multimedia stream generator is also proposed comprising an integrator capable of integrating into a multimedia stream several personalized versions of at least one given stream segment, a personalized version of the stream segment being associated with a predefined criterion.
[0019] Thus, for example in a so-called “multicast” scenario of broadcasting from a transmitter to a group of receivers, it is possible to generate a customizable multimedia stream based on a predefined criterion. Such a multimedia stream can then be personalized on the receiver side, for example by relying on personal or family data which are also accessible on the receiver side.
[0020] According to another aspect, there is provided a multimedia stream transmitter comprising the aforementioned processing device generating from a customizable multimedia stream a personalized multimedia stream intended for a predetermined user; and a transmitter capable of transmitting the personalized multimedia stream to a predetermined user multimedia stream receiver.
[0021] Thus, prior to the selection, provision may be made for receiving the plurality of personalized versions of the customizable multimedia stream segment. Such an implementation allows, among other things, recording of the multimedia stream. customizable locally and later viewing of recorded content, with real-time personalization, without the need for a connection.
[0022] Thus, it is possible to personalize the multimedia stream upstream of its transmission to the multimedia stream receiver. This personalization can be carried out for example at the level of any network equipment communicating elsewhere, directly or indirectly, with a connected object of the user.
[0023] According to another aspect, there is provided a receiver of a multimedia stream of a predetermined user comprising the aforementioned processing device generating from a received customizable multimedia stream a personalized multimedia stream intended for a predetermined user, the processing device being connected to a reproduction device to which the processing device provides the personalized multimedia stream.
[0024] Thus, provision may be made not for prior reception of the plurality of personalized versions of the customizable multimedia stream segment, but for reception, occurring after the selection, of only the selected personalized version of the customizable multimedia stream segment. Such an implementation is appropriate, for example, in the case of video-on-demand broadcasting, where one issue is to optimize the use of bandwidth and where one consequence is to obtain, ideally, only the multimedia content intended for the generation of the personalized multimedia stream for a given user at a given time.
[0025] Thus, it is possible to carry out the customization of the multimedia stream exclusively locally at the multimedia stream receiver.
[0026] In a multicast scenario with such an implementation, the customizable multimedia stream is entirely broadcast by a transmitter, i.e. with all the personalized versions, and therefore received by all the receivers. It is only at the time of restitution that the selection of a personalized version takes place. The selection therefore does not require transmitting personal information of the user to the transmitter of the multimedia stream.
[0027] According to another aspect, there is provided a computer program comprising instructions for implementing all or part of a method as defined herein when this program is executed by a processor. According to another aspect, there is provided a non-transitory recording medium, readable by a computer, on which such a program is recorded. According to another aspect, there is provided a data processing device, comprising a processor (101) connected to such a non-transitory recording medium. The data processing device may also comprise, or be connected to, a communication interface.
[0028] The features set out in the following paragraphs may, optionally, be implemented, independently of one another or in combination with one another:
[0029] In certain exemplary embodiments, the personalization method comprises, following detection and prior to selection, at least one of the following steps: - reception of a value relating to the predefined criterion originating from an object connected to the processing device; - an emission of a value request relating to the predefined criterion to at least one object connected to the processing device.
[0030] By "value relative to the predefined criterion" is meant any value allowing the processing device to carry out, directly or after prior processing of this value, the selection of a personalized version of a customizable flow segment according to the predefined criterion.
[0031] Thus, it is possible: either to send a request to one or more connected objects, to allow the processing device to have one or more values, from this or these connected objects, and relating to the predefined criterion,
[0032] or to provide that the connected objects transmit such values to the processing device regularly and without prior sending of a request.
[0033] In certain exemplary embodiments, the personalization method comprises, following detection and prior to selection, a comparison of the value obtained with respect to the predefined criterion, the result of the comparison triggering the selection of a version associated with the result of the comparison.
[0034] This makes it possible in particular to determine, for example on the basis of the value(s) obtained and one or more threshold values, or reference values, which version of the customizable segment to select.
[0035] In some exemplary embodiments, the media stream is a succession of data packets and a version of a given segment of a media stream is a succession of data packets adapted to be inserted as a given segment in a media stream being customized.
[0036] Thus, it is possible to personalize a streaming media stream, for example of the MPEG-TS type. This type of media stream is designed for multiplexing video and audio, as well as program and service description data. In an exemplary implementation, the program or service description data may include the segmentation start indication, and the segmentation may only concern the video and audio. The personalization start indication may further be repeated in the customizable media stream. This allows, in a multicast broadcast scenario of the stream customizable multimedia, to start customization as quickly as possible for a given user regardless of when this user chose to access this multimedia stream.
[0037] In certain exemplary embodiments, the request comprises an indication of at least one type of current value relating to said predefined criterion and the method further comprises: for each type of current value indicated in the request, obtaining at least one current value of said type, each current value obtained being respectively from a connected object, and a determination of the indication of fulfillment of the criterion on the basis of each current value obtained relative to the predefined criterion.
[0038] In certain exemplary embodiments, the method further comprises, upon detection of the segmentation start information: obtaining a combination function between a plurality of current value types and the indication of filling the criterion, and the indication of fulfillment of the criterion is determined on the basis of the combination function and on the basis of a plurality of current values, corresponding respectively to said types of current values, originating from at least one connected object.
[0039] Thus it is possible to personalize the multimedia stream according to a complex concept that cannot be directly measured by a single sensor, for example the current mood or the intensity of the user's effort. This concept can be determined or inferred using the aggregation of different types of relevant data from different sources, or even different temporal profiles of such types of relevant data.
[0040] In some example embodiments, the customizable media stream further comprises an undifferentiated stream segment and generating the personalized media stream comprises including the undifferentiated stream segment.
[0041] Thus, it is possible, for example, that the user chooses to view a given program, and that the multimedia stream associated with this given program includes not only one or more customizable segments, but also one or more undifferentiated, therefore non-customizable, segments. For example, a personalized segment may precede an undifferentiated segment, or vice versa. For example, several personalized segments may be grouped between two parts of undifferentiated segments, or vice versa. For example, the personalized and undifferentiated segments may be intermingled.
[0042] As indicated above, it is possible for the multimedia stream to comprise several customizable segments, i.e. several segments each comprising multiple customized versions based on a respective predefined criterion. In other words, the predefined criterion to be considered, or how it is determined, may be different from one customizable segment to another.
[0043] In certain exemplary embodiments, at least two segments of the multimedia stream are customizable (hereinafter, “the segment” and “the new segment”) and each comprise several customized versions based on the same predefined criterion. In these exemplary embodiments, the method may further comprise, following detection of a new multimedia stream segment comprising several customized versions based on the predefined criterion:
[0044] an updated selection of a version of the new multimedia stream segment from among the plurality of versions of the new multimedia stream segment as a function of the predefined criterion and at least one updated value relating to the predefined criterion, the updated value having been obtained, prior to the selection, from at least one object connected to the processing device, the updated selection triggering a generation of a personalized multimedia stream of which the new personalized multimedia stream segment is constituted by the selected version of the new segment of the customizable multimedia stream.
[0045] Thus, the personalization of the broadcast content can be scalable depending on the dynamic evolution of the current values from the connected device(s).
[0046] In certain exemplary embodiments, at least one current value relates to a measurement of data by at least one sensor of at least one connected device.
[0047] In certain exemplary embodiments, the measured data is physiological data of the user.
[0048] In certain exemplary embodiments, the measured data is user habitat data.
[0049] Thus, it is possible to personalize the content broadcast to the user on the basis of measured, current personal data relating to the user or his environment.
[0050] In certain exemplary embodiments, the personalization method comprises, following detection and prior to selection, an emission of a value request relating to the predefined criterion to an object connected to the processing device, the value request emitted comprising a function for determining the value from at least one type of current data accessible to said connected object.
[0051] The request sent may further comprise a command, intended for the at least one connected device, indicating to determine said value on the basis of the determination function and to provide, in response to the command, said value.
[0052] Such an embodiment allows maximum restriction of the circulation of the user's basic personal data. Indeed, these personal data base are then never transmitted, either via a wide area network or via a local network, to the processing device responsible for selecting the multimedia content to be rendered. Brief description of the drawings
[0053] Other characteristics, details and advantages will appear on reading the detailed description below, and on analyzing the attached drawings. Fig.l Fig. 2
[0054] [Fig.l] and [Fig.2] show a video content management system according to one embodiment. Fig. 3
[0055] [Fig.3] shows a data processing device according to one embodiment. Fig. 4
[0056] [Fig.4] shows a method of personalizing a multimedia stream by the device of [Fig.3] according to one embodiment. Fig. 5
[0057] [Fig.5] represents an example of a non-customizable multimedia stream. Fig. 6
[0058] [Fig.6] represents an example of a customizable multimedia stream. Fig. 7
[0059] [Fig.7] represents different examples of customizations of the multimedia stream of [Fig.6]. Fig. 8
[0060] [Fig.8] shows an example of processing the multimedia stream of [Fig.6] allowing a limited degree of customization of the stream for a user. Fig. 9
[0061] [Fig.9] shows a processing of the multimedia stream of [Fig.6] allowing dynamic customization of the stream for a user, according to an exemplary embodiment. Fig. 10 Fig. 11
[0062] [Fig. 10] and [Fig. 11] show processing of the multimedia stream of [Fig.6] allowing dynamic customization of the stream for a user, according to alternative embodiments. Description of the embodiments
[0063] Multimedia streams are understood to mean, in particular, video streams and / or audio streams. Multimedia streams are, in particular, broadcastable regardless of the broadcasting mode: multicast, unicast... or even transmissible, particularly over the Internet. Multimedia streams are used, in particular, by television channels (television streams), replay platforms for multimedia content, platforms for the distribution and / or broadcasting of multimedia content on demand (for example, video on demand or VoD), etc.
[0064] The data processing device is also called a data operator. By data operator is meant a physical device performing processing on the data, such as an electronic data processing circuit, a computer processor executing a program implementing a data processing method, etc. The data operator performs at least one processing on at least one piece of data.
[0065] The aim of the invention is to automatically and directly adapt the broadcasting or restitution of content to a user by relying on relevant data from the user's connected devices.
[0066] Thus, it is proposed to generate a customizable multimedia stream. This stream is actually customized downstream of the generation, either: at a point in the transmission chain, i.e. before transmission to the device responsible for reproducing the multimedia stream, therefore restoring it to the user, or after the transmission chain, directly at the level of the device reproducing the multimedia stream.
[0067] The values of the data on which it is proposed to rely to personalize the multimedia stream are variable over time, possibly during the broadcasting of the same content and are used to automatically determine the personalization of the stream broadcast and returned to this user.
[0068] Many applications are possible, in particular in so-called “streaming” services, this English term designating a broadcast of video content in continuous mode.
[0069] Reference is now made to Figures 1 and 2 which illustrate a multimedia content management system, in an exemplary embodiment of the invention.
[0070] The system comprises a multimedia stream generator (200) configured to generate and possibly manage, for example centrally, the broadcasting of a multimedia stream, for example in streaming mode, to a plurality of receivers (140).
[0071] There are different standards defining the aspects of transporting multimedia streams, therefore video and / or audio, for example multiplexed, across networks. We can consider for example the multimedia stream in the form of a continuous set of TS packets, for “Transport Stream”, such as according to the MPEG-TS standard.
[0072] The multimedia stream generator (200) is more precisely configured to define, within the multimedia stream to be broadcast, one or more common segments and one or several customizable segments as well as to associate at least one predefined personalization criterion with at least one customizable segment.
[0073] In other words, the multimedia stream generator (200) comprises an integrator (201), as a physical or logical module, capable of integrating into a multimedia stream several personalized versions of at least one given stream segment, a personalized version of stream segment being associated with a predefined personalization criterion.
[0074] A common segment, or undifferentiated segment, is a multimedia subset without personalization. It comprises multimedia content, stored for example on a first storage memory (210) and intended to be broadcast to all potential users. By considering the multimedia stream as a continuous set of TS packets, each TS packet associated with a segment without personalization will have a single version.
[0075] A customizable segment is a multimedia subset with personalization. Personalization consists of providing, for each customizable segment, a plurality of versions associated with at least one given predefined criterion. A customizable segment thus comprises several versions, each of which is not intended to be rendered to all potential users, but only to certain potential users. This may for example be personalized advertising content. Thus, a customizable segment comprises a version to be selected from a plurality of possible versions, stored for example on a second storage memory (220). By considering the multimedia stream as a continuous set of TS packets, each TS packet associated with a customizable segment has as many versions as there are desired customization cases.As explained below, the actual personalization of the multimedia stream, involving the selection of a version intended for a user, is carried out either by the transmitter of the multimedia stream, or by a device located in the transmission chain of the multimedia stream, or by the receiver responsible for rendering the personalized multimedia stream.
[0076] A personalization criterion is a criterion linked to current values of relevant data. For example, multimedia content of the type of a sports activity program can be customizable according to the current physiological data of the target watching the program to present more or less intense sports activities. For example, a television channel focused on the well-being of viewers can provide for optional personalization of its multimedia content according to the current mood of the viewers.
[0077] The multimedia stream generator (200) is configured to communicate as a transmitter, for example via a wide area network (310), with multimedia stream processing devices (100) installed at the potential users.
[0078] The generator (200), which emits the customizable multimedia stream, can be considered as being located at the start of a plurality of transmission chains. Each transmission chain comprises a succession of transmitters (150) and ends at a receiver (140). The receiver is connected to, or integrates, a reproduction device (141) which reproduces the multimedia stream, i.e. restores it to the user.
[0079] The processing device (100) may be integrated into any transmitter (150) or be integrated into the receiver (140). A function of the processing device is to personalize the media stream, i.e., to receive the customizable media stream and transform it into a personalized media stream.
[0080] A function of a transmitter is to relay the multimedia stream, that is to say to retransmit it using an integrated transmitter (151). The multimedia stream retransmitted by a given transmitter may be identical to the multimedia stream received by this transmitter. If the processing device (100) is integrated into a transmitter, then on the contrary, the multimedia stream received by this transmitter is customizable but not actually personalized, whereas the multimedia stream retransmitted by this transmitter is actually personalized.
[0081] The multimedia stream generator (200) transmits in particular by this means any information useful for the recovery and personalization of the multimedia stream by the multimedia stream processing devices. In particular, the multimedia stream manager transmits indications of the start of the customizable segment as well as the personalization criterion(s). The multimedia stream manager (200) can also transmit other types of information, for example indications of the end of the customizable segment or requests for re-evaluation of the personalization criterion(s).The multimedia stream manager can also define, for a given customizable segment, a default version intended to be rendered, for example in the event of hardware or software incompatibility resulting in an inability of a processing device (100) to carry out the segmentation, or if the evaluation of the criterion is incompatible with the selection of each of the other versions of the customizable segment.
[0082] Each data processing device (100) thus defined is configured to be able to communicate both:
[0083] - with the multimedia stream generator (200) and the storage memory(s) (210, 220) storing common and personalized multimedia contents, for example through the wide area network (310),
[0084] - with various communicating equipment (110, 120, 130), or connected devices, or still connected objects, for example through a local network (300), and
[0085] - with at least one reproduction or restitution device (141), separate or integrated into the processing device (100), making it possible to reproduce or restore the multimedia stream to one or more users.
[0086] The examples of communicating equipment (110, 120, 130) are numerous and cover, for example, any object connected to the Internet allowing communication between the physical object and its digital existence. Such objects are currently ubiquitous and find applications in the fields of transport, logistics, health, smart environments, social life, marketing, etc. Some communicating equipment (110, 120, 130) may be equipped with sensors allowing them to detect current local values of data associated with a user or a location. For example, some connected watches are equipped with accelerometers, possibly coupled to a heart rate monitor, making it possible to detect the physical activity of the wearer. For example, a smart thermostat may include one or more temperature sensors whose readings are used to automatically regulate a heating system.
[0087] Reference is now made to [Fig. 3] which illustrates the physical or logical modules of the data processing device (100) and to [Fig. 4] which illustrates a general algorithm of a computer program which, when executed by at least one processor of a data processing device, implements a method for personalizing multimedia content, in an exemplary embodiment of the invention.
[0088] We are in a situation where a user has selected for example a particular television channel, or a particular program such as a film or a series that he wishes to watch. This selection has the effect that the processing device (100) has selected a particular multimedia stream, corresponding to this particular television channel or this particular program, and analyzes (1) the information, relating to this particular multimedia stream, which has been previously defined by the multimedia stream manager (200).
[0089] It is also considered that this information relating to this particular multimedia stream defines at least one customizable segment comprising several possible versions, each version comprising different multimedia content, on a given segmentation criterion. Thus, this information relating to this particular multimedia stream includes an indication of the start of the customizable segment, which may specify for example that the customizable segment begins after a certain delay from the reception of said indication, or after successive reception of a certain number of TS packets from the reception of said indication. The expressions “customizable segment” and “customization criterion” are to be understood as defined above. Taking the example of a viewer wishing to watch a In a sports activity program, four customizable versions of a segment can be predefined, each version corresponding to a different physical exercise associated with a different level of physical activity. A personalization criterion can be based on the viewer's pulse at a current time. For example, four pulse ranges can be defined and respectively associated with one of the four possible versions.
[0090] The information relating to the particular multimedia stream may also include, in addition to an indication of the start of a customizable segment on the given criterion, an indication of the end of a customizable segment. Furthermore, the information relating to the particular multimedia stream may also include, in a case where a customization has previously been carried out on the given criterion and where a version of a customizable segment has been selected, an indication of re-examination of the relevance of this customization.
[0091] Information relating to the particular media stream is detected (2) and processed by the processing device (100). Based on this information, the processing device (100) is able to process the media stream as defined by the media stream generator (200). Generally, the processing device (100) is configured to interpret, for example, a received customizable segment start indication, associated with a given customization criterion, so as to evaluate the criterion and accordingly select a particular version from a plurality of possible versions of the customizable segment.
[0092] Different possible customization criteria are detailed below with different ways of evaluating these criteria.
[0093] The example of a television channel focused on the well-being of viewers was cited above. In this example, the current mood of the viewers can constitute a personalization criterion. The current mood of a viewer can be evaluated, or predicted, based on data of multiple nature, originating for example from multiple sensors hosted by multiple communicating devices (110, 120, 130), or previously obtained by one or other of these communicating devices by any other means, such as a download from a remote server. Examples of such data include the sound level, the temperature of a room, weather information, the viewer's facial expression, the brightness, the viewer's agitation, the nature of the news, etc.With this in mind, the processing device (100) can obtain (21) an indication of the start of segmentation associated with a combination function defining how to evaluate the criterion from the current values of said data of multiple nature, likely to come from these multiple communicating devices.
[0094] In the example of a sports activity program segmented according to the current heart rate value of the viewer, the processing device (100) can, more simply, obtain a customizable segment start indication associated with an instruction to determine whether the current heart rate of the viewer is within one or other of the predefined heart rate ranges in order to select on this basis a particular version of the customizable segment.
[0095] It is also possible to retrieve, for customers who have previously given their consent to this effect, a set of values from sensors in the connected home and making it possible to define needs. For example, a connected fireplace detecting poor combustion or a connected swimming pool signaling a clogged filter can be cited. Depending on these needs, it may be possible to select a particular version from a plurality of possible versions corresponding to multimedia content such as a tutorial for maintaining your fireplace or a targeted advertisement for a swimming pool filter.
[0096] The above examples show that the data from the communicating equipment (110, 120, 130) may include, more specifically, and without limitation:
[0097] - current values of physiological data of a user, or of several users, measured by a sensor of communicating equipment, for example in the health sector, or
[0098] - current values of environmental data, or habitat, of one or several users, these values being measured by a sensor of communicating equipment, for example in the field of the connected home, or
[0099] - current data values downloaded by communicating equipment.
[0100] In each of the above examples, and in general, the personalized multimedia contents are presented in the form of possible versions of a multimedia stream. A version corresponds to a respective personalization category. As already explained, several possible versions are previously defined by the multimedia stream generator (200) for a given customizable segment of multimedia stream. For a given customizable segment, the choice of a version from among all the possible versions is made on the basis of a personalization criterion which is predefined during generation by the multimedia stream generator (200).The processing device (100) proceeds, following the detection (2) of an indication of the start of a customizable segment indicating the start of this given customizable segment, to a data processing aimed at selecting a particular version from this plurality of predefined possible versions, for example with a view to its restitution to a user. The data processing in question is detailed below.
[0101] Following the detection (2) of the customizable segment start indication, the processing device (100) can, in an exemplary embodiment, transmit (3) a request to one or more communicating devices (110, 120, 130).
[0102] The nature of this request depends on the predefined personalization criterion associated with the customizable segment start indication.
[0103] If the predefined criterion is linked to a link function between several current values from multiple connected devices, then it is necessary to designate a master device, which can for example be the processing device (100), whose role is to gather these current values, apply the link function and obtain (4), as a result of the link function, a resulting value making it possible to operate a selection, according to the criterion, of a particular version among the possible versions of the customizable segment. For example, three possible versions can be predefined and the link function can have three possible results, for example 1, 2 and 3, each of these possible results being associated, according to an example of predefined criterion, with a particular version. In this example, the resulting value obtained as a result of the link function is, in itself, a value relative to the predefined criterion.Thus, in such a situation, the issued request (3) comprises the link function, i.e. a function for determining the indication of fulfillment of the criterion from at least one type of current value accessible to at least one connected device. The issued request (3) further comprises a command, intended for the master device, indicating to determine the result of the link function, i.e. to determine the resulting value on the basis of the link function, and to provide, in response to the command, the resulting value thus determined.
[0104] If the predefined personalization criterion is linked to a current value of a single data item from a single connected device, this current value can be sent directly by this connected device, to the processing device (100), which thus obtains it (4).
[0105] Alternatively, the processing device may dispense with sending a request to one or more communicating devices (110, 120, 130) following the detection (2) of the customizable segment start indication. It may in fact be provided that the processing device recovers, periodically and without prior request, the current values of one or more types of data from one or more communicating devices (110, 120, 130). These recovered current values may for example be stored in memory (102).
[0106] In this way, following the detection (2) of the indication of the start of a customizable segment on a predefined customization criterion, the processing device (100) accesses (41) any current value which is both originally from communicating equipment and already accessible to the processing device and which allows to determine the value relative to said predefined criterion. The processing device (100) is then able to determine (42) the value relative to the predefined personalization criterion by processing the current value recovered.
[0107] In all the examples above, considering that the processing device (100) and the communicating equipment (110, 120, 130) communicate with each other exclusively via a local network (300), the current value relating to the criterion is always determined by a device in this local network (300), so that the personal data of the user or of his habitat remain limited to the equipment in this local network (300), as does the exploitation of this personal data for the purpose of personalizing the multimedia content intended to be returned to the user.
[0108] Based on the indication of fulfillment of the criterion obtained by the processing device (100), the latter selects (5), for a customizable segment of the multimedia stream identified on the basis of the customizable segment start indication, a particular version of the particular customizable segment from a plurality of possible versions.
[0109] In an exemplary embodiment, the processing device (100) specifically obtains (6) the particular version selected, for example by downloading from a storage memory (220), in order to, for example, transmit it (7) to the rendering device (140) for the purpose of reproducing or rendering it to the user. Such an exemplary implementation can be adapted, for example, to an application such as a VoD type broadcasting service, so that only the particular version selected, intended to be actually rendered to the user, is obtained, and not all possible versions.
[0110] In another exemplary embodiment, the processing device (100) obtains (6) all the possible versions of the customizable segment, in order to, for example, transmit (7) only the selected version to the rendering device (140) with a view to its rendering to the user.
[0111] Such an implementation example can be adapted for example to an application such as a television stream rebroadcasting service. Indeed, in such an example, all possible versions are obtained beforehand, then the personalization by choice of a particular version is carried out locally only at the time of restitution to the user. A first advantage is that regardless of the time at which the user triggers the rebroadcast, the personalization takes into account the most recent current values obtained from the communicating equipment(s) (110, 120, 130). A second advantage is that the transmitter of the multimedia stream is not aware of the personalization chosen, and therefore has no access, directly or indirectly, to any personal data of the user.
[0112] Various possible ways of using a processing device (100) in connection with one or more communicating devices (110, 120, 130) have now been described to personalize a customizable segment of a multimedia stream intended to be rendered to a user.
[0113] In one case, a customizable segment of the multimedia stream may be followed, for example, by an undifferentiated segment. A possible way of using the processing device to stop the customization of the stream once the personalized version of the customizable segment has been fully obtained (6) or selected for its reproduction (7) by a reproduction device is now described.
[0114] The processing device obtains (22) a customizable segment end indication, indicating the upcoming end of the customizable segment, associated for example with the upcoming start of an undifferentiated segment. For example, such an indication may specify that the customizable segment ends after a certain delay from the reception of said indication, or after successive reception of a certain number of TS packets from the reception of said indication.
[0115] The processing device is configured to obtain (61), on the basis of the end of customizable segment indication obtained, the unique, undifferentiated version associated with said undifferentiated segment of the multimedia stream and intended to be rendered to all potential users. This multimedia content is obtained for example by downloading from a storage memory (210), in order to for example render it (71) to the user using a rendering device (140). Thus, during a first period of time, a personalized version of a customizable segment is rendered to the user and then, at the end of this first period of time, a unique version of an undifferentiated segment is in turn rendered to the user.
[0116] In another case, a first customizable segment on a first predefined customization criterion can be followed by a second customizable segment on a second predefined customization criterion, which can be identical to the first criterion, or which can be distinct. A possible way of selecting, for the second customizable segment, a personalized version from a plurality of possible versions provided in the multimedia stream generated by the generator (200), with a view to its restitution to a user is now described.
[0117] In such a situation, after the selection (5) of a particular version corresponding to the personalization of the first customizable segment, the processing device (100) detects (23) new customizable segment start information based on the second predefined criterion associated with the second customizable segment.
[0118] The processing device (100) obtains a value relating to the second predefined criterion. This value comes from at least one communicating device (110, 120, 130). As explained previously, obtaining such a value can be triggered at the initiative of the processing device, i.e. initiated by sending a request following detection of the indication of the start of the second customizable segment, or on the contrary be planned periodically without the need to send such a specific request.
[0119] This means in particular that, if two consecutive portions of the multimedia stream are segmentable on the same criterion, that is to say if a second criterion is identical to a first criterion, then the processing device obtains (43) an updated value of the criterion, the value being determined on the basis of at least one updated relevant current value, originating from at least one communicating device.
[0120] Based on this updated value, the processing device (100) performs, for the second customizable segment, an updated selection (51) of a personalized version from among the plurality of possible versions that can be selected for the second customizable segment.
[0121] Different examples of multimedia streams are now described with reference to Figures 5 to 7.
[0122] [Fig.5] illustrates a multimedia stream comprising a continuous set of packets (1000) labeled TS A to TS k, each packet having only one possible version.
[0123] Such a multimedia stream corresponds for example to a non-customizable television stream known from the prior art.
[0124] [Fig.6] illustrates a multimedia stream comprising: - a first undifferentiated segment (1001) corresponding to a succession of packets entitled TS A to TS C, each of these packets having only one possible version, then - a customizable segment (1002, 1003, 1004, 1005) corresponding to a succession of consecutive packets having several versions, in this case a succession of two packets having four possible versions, the packets being respectively titled TS DI and TS El for the first version, TS D2 and TS E2 for the second version, and so on, then - a second undifferentiated segment (1006), analogous to the first undifferentiated segment.
[0125] Such a multimedia stream corresponds to a customizable stream that can be generated by the generator (200) in an exemplary embodiment of the invention.
[0126] It is further considered that a personalization criterion, noted criterion X, is predefined. Depending on a value relating to criterion X obtained on the basis of at least one current value of data from at least one communicating device, one or other of the planned versions of the customizable segment is selected, which triggers the generation of a personalized multimedia stream. In other words, each different version of the customizable segment is associated with at least one possible value relating to criterion X.
[0127] [Fig.7] schematically illustrates several possible versions of the multimedia stream customizable from [Fig.6], after effective customization by the processing device (200) in an exemplary embodiment of the invention.
[0128] In this case, the customizable segment of the personalized multimedia stream comprises one of the four possible versions (1002, 1003, 1004, 1005) which is inserted, or interposed, between the first undifferentiated segment (1001) and the second undifferentiated segment (1006).
[0129] An example of processing the multimedia stream of [Fig. 6] by a processing device (100) is now described with reference to [Fig. 8]. Such an example of processing allows a limited degree of personalization of the multimedia stream in that the personalization is a function of pre-recorded data, pre-associated with the user and unlikely to vary over time.
[0130] For each segment, the multimedia content encapsulated in the retrieved packets can be broadcast, as the packets are retrieved, to a user.
[0131] The processing device (100) recovers a succession of packets (1001) corresponding to the first undifferentiated segment. During this recovery, the processing device (100) detects a start indication (1010) of the customizable segment on the criterion X, with an indication making it possible to determine a value relating to the criterion X.
[0132] Following this detection, the processing device determines the value relating to criterion X. The decoder retrieves the value relating to criterion X for the user. This value is either locally accessible data or data retrieved from a remote server at the request of the processing device.
[0133] Based on the value relating to the criterion X thus determined or recovered, the processing device selects a particular version (1004) of the customizable segment, then recovers the succession of packets corresponding to this selected version.
[0134] During this recovery, the processing device (100) detects an end indication (1020) of the customizable segment on the criterion X, combined here, in this case, with an indication of the start of an undifferentiated segment. The processing device (200) then recovers a succession of packets (1006) corresponding to the second undifferentiated segment.
[0135] We now describe, with reference to [Fig.9], the processing of the multimedia stream of [Fig.6] by the processing device (100) in two exemplary embodiments of the invention.
[0136] The difference with the processing illustrated in [Fig.8] concerns the determination of the value relative to criterion X, with a view to selecting a particular version of the customizable segment, therefore with a view to effectively personalizing the flow intended to be returned to the user.
[0137] The value relating to the criterion X is determined on the basis of current values of one or more relevant data. These current values come from one or more communicating devices (110, 120, 130) and are likely to vary over a short time interval, i.e. to vary for example during the broadcasting of the multimedia stream.
[0138] In a first exemplary embodiment, the processing device already has the current values of the relevant data making it possible to determine the value relating to the criterion X. These current values are communicated to the processing device (100) periodically and without prior request by the communicating equipment(s).
[0139] In a second exemplary embodiment, the processing device (100) does not have the current values of the relevant data beforehand for determining the value relating to the criterion X. Thus, the processing device interacts with one or more connected objects, or communicating devices (110, 120, 130). This interaction may comprise, for example, the transmission of a request to said one or more communicating devices and the obtaining, in response to the transmission of this request, of the current value of the relevant data(s), originating from this or these communicating devices, to determine the value relating to the criterion X.
[0140] In an alternative embodiment illustrated in [Fig. 10], the processing device (100) retrieves the current values of several data from different communicating devices (110, 120, 130) and combines these current values to determine the value relating to the criterion X. For example, physiological data such as heart rate, body temperature and blood pressure can be combined to choose which personalized version of the customizable segment to select. The combination function can either be carried in the multimedia stream received by the processing device or be retrieved upon specific request from the processing device.
[0141] In an alternative embodiment illustrated in [Fig. 11], several customizable segments are linked together in the customizable multimedia stream. For example, we consider the same multimedia content, in the sense of a program or a film, which provides possibilities for intermediate recalculation of the personalization data, insofar as this data can evolve rapidly over time during the restitution of the multimedia content to a user. An example of such multimedia content is a sports activity program with personalized exercises proposed according to the user's physiological data at the time he watches the program. In this example, the personalization is always carried out according to the same criterion X, therefore on the basis of different successive values relating to criterion X, but this is not essential, and different segments can be personalized on different criteria.
[0142] For each customizable segment, the processing device (100) detects a corresponding customizable segment start indication. Following this detection, the processing device (100) takes into account the most recent values of the relevant data for calculating the value relating to the criterion X. Thus, if, for example, during the viewing of the sports activity program, the user's physiological data vary, then it is possible to continually adapt the exercises presented to always present the exercise corresponding to the intensity level most suited to the user at the time he or she is viewing the program.
Claims
Claims
1. Method for personalizing a multimedia stream, implemented by at least one data processing device, the method comprising, following a detection (2) of a multimedia stream segment comprising several personalized versions according to a predefined criterion, called customizable multimedia stream: a selection (5) of a version of the multimedia stream segment from among the plurality of multimedia stream segment versions according to the predefined criterion and at least one value relating to the predefined criterion, the value having been obtained, prior to the selection (5), from at least one object connected to the processing device, the selection triggering a generation of a personalized multimedia stream whose personalized multimedia stream segment is constituted by the selected version of the segment of the customizable multimedia stream, the at least one value relating to the predefined criterion comprising at least one value of data relating to the user,to a user's home or user's environment.,
2. Personalization method according to the preceding claim, in which the personalization method comprises, following detection and prior to selection, at least one of the following steps: - sending a request for a value relating to the predefined criterion to at least one object connected to the processing device; - receiving a value relating to the predefined criterion from an object connected to the processing device; - comparing the value obtained with the predefined criterion, the result of the comparison triggering the selection of a version associated with the result of the comparison.
3. A method according to claim 1 or 2, wherein the media stream is a succession of data packets and a version of a given segment of a media stream is a succession of data packets adapted to be inserted as a given segment in a media stream being personalized.
4. Method according to claim 2, in which the query comprises an indication of at least one type of current value relating to said predefined criterion and the method further comprises: for each type of current value indicated in the query, obtaining (41) at least one current value of said type, each current value obtained being respectively from a connected object, and a determination (42) of the indication of fulfillment of the criterion on the basis of each current value obtained relating to the predefined criterion.
5. Method according to claim 4, further comprising, upon detection (2) of segmentation start information: obtaining (21) a combination function between a plurality of types of current values and the indication of filling the criterion, and in which the indication of filling the criterion is determined on the basis of the combination function and on the basis of a plurality of current values, corresponding respectively to said types of current values, from at least one connected object.
6. The method of one of claims 1 to 5, wherein the customizable media stream further comprises an undifferentiated stream segment and generating the personalized media stream comprises including the undifferentiated stream segment.
7. Method according to one of claims 1 to 6, further comprising, following a detection (23) of a new multimedia stream segment comprising several personalized versions according to the predefined criterion, an updated selection (51) of a version of the new multimedia stream segment from among the plurality of versions of the new multimedia stream segment according to the predefined criterion and at least one updated value relating to the predefined criterion, the updated value having been obtained, prior to the updated selection (51), from at least one object connected to the processing device, the selection triggering a generation of a personalized multimedia stream of which the new personalized multimedia stream segment is constituted by the selected version of the new segment of the customizable multimedia stream.
8. Method according to one of claims 1 to 7, in which the personalization method comprises, following detection and prior to selection, an emission of a value request relating to the predefined criterion to an object connected to the processing device, the value request emitted comprising a value determination function from at least one type of current data accessible to said connected object.
9. A method for generating a customizable multimedia stream implemented by a multimedia stream generator, the generation method comprising an integration into the multimedia stream of several personalized versions of at least one given segment of stream, a personalized version of stream segment being associated with a predefined criterion, a personalized version of stream segment associated with the predefined criterion being selectable according to at least one value relating to the predefined criterion, the at least one value relating to the predefined criterion comprising at least one value of data relating to the user, to a user's household or to an environment of the user.
10. Computer program comprising instructions for implementing the method according to one of the preceding claims when this program is executed by a processor.
11. Non-transitory recording medium readable by a computer on which is recorded a program for implementing the method according to one of claims 1 to 9 when this program is executed by a processor.
12. Multimedia stream generator comprising an integrator capable of integrating into a multimedia stream several personalized versions of at least one given stream segment, a personalized version of the stream segment being associated with a predefined criterion, a personalized version of the stream segment being associated with a predefined criterion, a personalized version of the stream segment associated with the predefined criterion being selectable according to at least one value relating to the predefined criterion, the at least one value relating to the predefined criterion comprising at least one value of data relating to the user, to a user's home or to an environment of the user.
13. Data processing device (100) capable of personalizing a multimedia stream, comprising: a switch (103) capable of selecting, following detection of a multimedia stream segment comprising several personalized versions according to a predefined criterion, called customizable multimedia stream, a version of the multimedia stream segment from among the plurality of multimedia stream segment versions according to the predefined criterion and at least one value relating to the predefined criterion, the value having been obtained prior to the selection of at least one object connected to the processing device, the selection triggering a generation of a personalized multimedia stream whose segment of personalized multimedia stream is constituted by the selected version of the segment of the customizable multimedia stream, the at least one value relating to the predefined criterion comprising at least one value of data relating to the user, to a user's household or to a user's environment.
14. Multimedia stream transmitter (150) comprising a processing device (100) according to the preceding claim generating from a customizable multimedia stream a personalized multimedia stream intended for a predetermined user; a transmitter (151) capable of transmitting the personalized multimedia stream to a multimedia stream receiver (140) of the predetermined user.
15. Receiver (140) of a multimedia stream of a predetermined user comprising a processing device (100) according to claim 13 generating from a received customizable multimedia stream a personalized multimedia stream intended for a predetermined user, the processing device being capable of being connected to a reproduction device (141) and of providing the personalized multimedia stream to said reproduction device.
