A method comprising generating an augmented reality visual associated with a personalization object

Abstract

The method (10) comprises acquiring an image stream (ET6); identifying a support object in the image stream (ET7); identifying a personalization object in the image stream (ET7); if the identified support object and personalization object correspond to a pair of associated objects, providing access to an image stream transformation model (ET8) associated with that personalization object, such as generating an augmented reality visual in the image stream. Figure for the abstract: Fig 1

Description

Title of the invention: Method comprising a generation of an augmented reality visual associated with a personalization object

[0001] Embodiments and implementations of the invention relate to data processing methods, in particular a method comprising generating an augmented reality visual in an image stream.

[0002] There is a need to benefit from virtual aesthetic ornaments, such as conventionally color filters for photographs, or such as augmented reality objects inserted into a stream of images of the video type, which are unique and exclusive for virtual identities of particular users.

[0003] The term "augmented reality" means the conventional meaning given to these terms, that is to say, in summary, the techniques which make it possible to realistically embed virtual objects, such as 2D or 3D images, in a sequence of images of the real world, typically in a manner calculated by a computer system in real time.

[0004] “Virtual identity” means the content chosen by a user to be shared with an audience or a community, for example via social media (usually called “social networks”), i.e. for example online applications which are based on the philosophy and technology of the Internet and allow the creation and exchange of content generated by users.

[0005] Indeed, with the continuous improvement in the performance of augmented reality techniques, the renderings obtained are sufficiently aesthetic to be used to provide virtual ornamentation, that is to say, in the broad sense, a virtual decorative object, such as a virtual jewel, to embellish and personalize the virtual identity of a user.

[0006] Embodiments and implementations defined below provide a personalized, unique and exclusive experience of augmented reality generation of aesthetic ornamentation for a user's virtual identity.

[0007] According to one aspect, there is provided in this regard a method comprising: - acquisition of an image stream; - an identification of a support object in the image stream; - an identification of a personalization object in the image stream; - if the identified support object and personalization object correspond to a pair of associated objects, provision of access to a transformation model of the image flow associated with this personalization object.

[0008] According to one embodiment, providing access to the image stream transformation model comprises: executing the transformation model generating an augmented reality visual in the image stream; and a display of the image stream including the augmented reality visual.

[0009] In other implementations, providing access to the image stream transformation model may include: a loading of the transformation model of the image stream into a memory of the device having acquired the image stream; or unlocking the use of the image flow transformation model, for example in a manner associated with a user profile.

[0010] For example, the acquisition of the image stream can be done in real time with a camera-type sensor; and the display of the image stream comprising the augmented reality visual can be done in real time with a display of the LCD, LED, OLED screen type (well-known acronyms designating respectively a liquid crystal screen, a light-emitting diode screen, and an organic light-emitting diode screen) or others.

[0011] For example, the step of identifying the support object can be performed using a conventional object recognition technique, such as for example implemented by the object recognition module belonging to the photographic filtering engine described in publication US 2016 / 0203586 A1 (dated 07 / 14 / 2016).

[0012] For example, the step of identifying the personalization object can be performed using: either the machine learning technology named “SnapML” of the design tool “Lens Studio” distributed by the company Snap Inc., also known as the social media application “Snapchat”; or another technique such as an image tracking technique; or an entry of a code linked to the purchase of the personalization object.

[0013] For example, the generation of the augmented reality visual can be done by a conventional technique, such as for example the technique described in publication KR20230038604A (dated 03 / 20 / 2023) allowing virtual objects to be moved relative to a real environment and manipulated in other ways; or such as for example the technique described in publication KR20190089091A (dated 07 / 29 / 2019), allowing the generation and manipulation of 3D models of an object of interest based on changes in positions in a field of vision of an image capture device.

[0014] According to one embodiment, the augmented reality visual comprises at least one part superimposed on the personalization object, in the image stream, so as to transform the aesthetics of the personalization object.

[0015] According to one embodiment, the augmented reality visual is adapted to dynamically display in the image stream an animation of an artistic line. virtual, for example the drawing of an artistic makeup, on the support object, evolving from the personalization object.

[0016] According to one embodiment, the identification of the support object comprises an identification of markers specific to a given type of support object, such as facial markers if the support object is a face; the identification of the personalization object comprises a detection of a location of the personalization object in a suitable region of the support object determined by the positions of the specific markers.

[0017] According to one embodiment, a preliminary step comprises a near-field communication of preliminary information by a contactless transponder contained in the personalization object, the communicated preliminary information being capable of determining at least one pair of associated objects.

[0018] “Near field communication” means a technique as defined in the ISO 14443 standard, usually designated by the acronym “NFC” from the English term “Near Field Communication”. “Contactless transponder” means an NFC chip of the card type (or “tag” according to the usual English term) capable of communicating with a reader in a manner powered by inductive coupling with an electromagnetic field generated by the reader.

[0019] According to one embodiment, the communicated preliminary information is furthermore capable of controlling, in the preliminary step, an activation of the following steps of said method, that is to say in particular the acquisition of the image stream, the identification of the objects, the generation of the augmented reality visual and the display.

[0020] Thus, in this mode of implementation, it is the contactless communication of the NFC type, typically by bringing an NFC reader close to the personalization object, which triggers the augmented reality experience associated with this object. This makes it possible to provide an immediate experience, offering the user a delightful surprise effect and a feeling of exclusivity.

[0021] According to one embodiment, the personalization object is a label suitable for being stuck on human skin, for example a skin jewel.

[0022] According to one embodiment, the support object is a human face.

[0023] There is further provided a computer program product comprising instructions which, when the program is executed by a computer such as a multifunction telephone, cause the latter to implement the method defined above.

[0024] Further provided is a computer-readable recording medium comprising instructions which, when executed by a computer such as a multifunction telephone, cause the latter to implement the method defined above.

[0025] According to another aspect, a personalization object is further defined which is adapted to the implementation of the method defined above.

[0026] According to another aspect, a system is further defined comprising a computer, such as a multifunction telephone, and a personalization object, for example as defined above, configured to cooperate so as to implement the method defined above.

[0027] For example, the personalization object is a label adapted to be stuck on human skin and intended to be worn on a face, the personalization object thus being adapted to the method comprising a provision of access to a transformation model of the image stream associated with this personalization object, such as a transformation model generating an augmented reality visual in the acquired image stream, if the identified support object and the personalization object correspond to the pair of associated objects comprising a support object consisting of a human face, and a personalization object consisting of this label.

[0028] For example, the tag is intended to be worn in proximity to an eye, thus being suitable for the method wherein said identification of the personalization object comprises detecting a location of the personalization object in a suitable region of the support object, i.e. a region in proximity to an eye, determined by the facial marker positions.

[0029] For example, the tag contains a contactless transponder adapted for near-field communication of preliminary information, the preliminary information being able to determine at least one pair of associated objects, and being able to control the implementation of said method, in particular an activation of the acquisition of the image stream, and of said identifications of the objects.

[0030] In other words, embodiments and implementations of the invention provide a skin jewel equipped with an NFC chip that allows the person wearing it to trigger a personalized experience on their multifunction phone, for example on a social media application, using the front or rear camera. This unique and exclusive experience is only accessible to those who own and wear the tag on their face. Thanks to the magical sensation of augmented reality, the user can push the limits of the physical world and enter a surprising and astonishing beauty universe that corresponds intimately to them.

[0031] The experience will be reserved for owners of the label, in particular due to the step of identifying the personalization object.

[0032] The label itself can generate the opening of the exclusive experience linked to the world of skin jewelry and for example its trademark.

[0033] Other advantages and characteristics of the invention will appear on examining the detailed description of embodiments and implementations, which are in no way limiting, and the appended drawings, in which the figures:

[0034] [Fig.l] ;

[0035] [Fig.2] ;

[0036] [Fig.3] ;

[0037] [Fig.4] ;

[0038] [Fig.5] ;

[0039] [Fig.6] illustrate embodiments and implementations of the invention.

[0040] [Fig.l] illustrates an example of the experience lived by a user benefiting from the unique and exclusive augmented reality ornamentation.

[0041] In a step ET1, the user acquires, for example by a purchase, a personalization object. The personalization object is for example a decorative accessory intended to be worn on a support object, such as a self-adhesive label.

[0042] In a first example, the personalization object can thus be a self-adhesive label intended to decorate a support object such as a vehicle.

[0043] [Fig.2] illustrates a preferred example, in which the personalization object BU is a beauty accessory intended to be worn on a part of the user's body VIS, for example a skin jewel, that is to say a label adapted to be stuck on human skin.

[0044] The skin jewel BU may be intended in practice to be worn on the one hand on a particular limb of the body, for example on the face VIS, or possibly on a wrist or a shoulder, and furthermore in a suitable region REG of the limb, for example on the contour of the right eye of the face VIS.

[0045] For example, publications FR2966704A1 (04 / 05 / 2012), FR3007955A1 (09 / 01 / 2015), WO2013164521A1 (07 / 11 / 2013) describe skin jewelry technologies, called body decoration articles, as well as the manufacturing processes for such articles.

[0046] Referring again to [Fig.l], at a step ET2 of experiment 10, the user sticks the skin jewel BU on the suitable region REG of his body, that is to say for example near his right eye.

[0047] For an advantageously immediate user experience 10 and offering a delightful surprise effect and a feeling of exclusivity, it is a contactless communication of the NFC type, typically by bringing an NFC reader close to the personalization object at a reading step ET3, which triggers the augmented reality experience associated with this object, in a preliminary step ET4.

[0048] In this regard, the BU tag contains a contactless transponder, suitable for near field communication (NFC) of preliminary information.

[0049] The NFC reader may typically be a computer adapted for this functionality, such as a multifunction telephone.

[0050] On the one hand, the preliminary information can determine at least one pair of associated BU-VIS objects used at the end of the identification steps ET7 described above. After.

[0051] On the other hand, the preliminary information can command, after the preliminary step ET4, an activation ET5 of the following steps of the experiment ET6, ET7, ET8.

[0052] In this regard, the preliminary information may, for example, contain a request to open an ET5 social media application, or an invitation to download the social media application if it is not installed in the multifunction telephone used as an NFC reader.

[0053] The social media application, for example the application named "Snapchat" is opened in a commercial private functionality mode, for example as described in publication US2016203586A1 (dated 07 / 14 / 2016) in relation to access to private photo filters offered by third-party merchants, in collaboration with said Snapchat social media.

[0054] Then, in a step ET6, the user shows in the field of vision of a photographic sensor, such as the front or rear camera of the multifunction telephone, the person (or the support object) carrying the personalization object BU from the private functionality of the social media. Thus, in this step ET6, a continuous image stream is acquired in real time with a camera-type sensor.

[0055] First, in a detection step ET7, the commercial private functionality of the social media is configured to identify, in the acquired image stream, a corresponding VIS support object, i.e. in this example to detect the presence of a VIS face in the field of view of the sensor.

[0056] For example, the identification of the support object can be done using a conventional object recognition technique, such as for example implemented by the object recognition module belonging to the photographic filtering engine described in the publication US 2016 / 0203586 A1.

[0057] The identification of the VIS support object may comprise in this regard an identification of markers specific to a given type of support object, such as facial markers (conventionally: the position of the pupils, the zygomatic cheekbones, the nose, the mouth, etc.) if the support object is a VIS face.

[0058] Secondly in the detection step ET7, the commercial private functionality of the social media is configured to identify, in the acquired image stream, a corresponding BU personalization object, i.e. in this example to detect the presence of the BU skin jewel in the field of vision of the sensor.

[0059] The identification of the personalization object BU may comprise a detection that the positioning of the personalization object is well located in the adapted region REG of the support object VIS. This positioning may be determined relative to the positions of the aforementioned specific markers.

[0060] For example, step ET7 of identifying the personalization object BU can be executed using: either the machine learning technology named “SnapML” of the design tool “Lens Studio” distributed by the company Snap Inc., also known under the name of the social media application “SnapChat”; or another technique such as an image tracking technique; or an entry of a code linked to the purchase of the personalization object.

[0061] If the identified support object and personalization object correspond to a pair of associated objects, for example as communicated in the preliminary information ET4, then the experience can advantageously comprise a generation ET8 of an augmented reality visual associated with this personalization object BU, in the image stream.

[0062] For example, the generation of the augmented reality visual can be done by a technique such as the technique of publication KR20230038604A (dated 03 / 20 / 2023) allowing virtual objects to be moved relative to a real environment and manipulated in other ways; or such as the technique of publication KR20190089091A (dated 07 / 29 / 2019) allowing the generation and manipulation of 3D models of an object of interest based on changes in positions in a field of vision of an image capture device.

[0063] For example, the user may choose to record a sequence of the image stream comprising the augmented reality visual, displayed in real time on his multifunction telephone, typically on an LCD, LED, OLED, or other screen (well-known acronyms designating respectively a liquid crystal screen, a light-emitting diode screen, and an organic light-emitting diode screen).

[0064] Alternatively, step ET8 comprises providing access to a transformation model of the image stream associated with the detected personalization object, in the event of successful detection of the pair of objects in step ET7.

[0065] By “providing access to the transformation model”, we mean for example a “live” application of the augmented reality visual as mentioned previously and as described below in relation to Figures 3 to 6, but also other access possibilities such as loading the transformation model into a memory of the device having acquired the image stream, or unlocking a use of the model for later use.

[0066] Thus, for example, loading the image stream transformation model may comprise downloading a program code capable of implementing the model, for example from a web server and via an Internet connection such as a WiFi or 4G, 5G, LTE connection; and adding the downloaded program code to a bank of transformation models, contained in a memory of the multifunction telephone.

[0067] And also for example, the unlocking of the use of the image stream transformation model can for example be associated with a user profile, for possible use on different devices on which this profile is connected. The transformation model can already be contained in the bank of transformation models, or can be accessed online in a “streaming” type operation (common English term having no usual translation in French, literally “in flow”) or single-use download type, or even loading into a local memory, as described above.

[0068] Furthermore, if in the detection step (step ET9), the private commercial functionality of the social media does not identify the support object VIS in the image stream; or does not identify the personalization object BU in the image stream; or if the identified support object and personalization object do not correspond to a pair of associated objects VIS-BIJ; or possibly if the identified personalization object BU is not positioned in the adapted region REG of the identified support object VIS; then the augmented reality visual is not generated or displayed in the image stream (step ET 10).

[0069] Thus, the user was able to live an exclusive experience 10, because it was reserved for the owners of this skin jewel (or personalization object) and who wear it in the appropriate region of the body (or support object).

[0070] The exclusive experience can be linked to the aesthetic universe of the skin jewel trademark, and, thanks to the magical sensation of augmented reality, the user can push back the limits of the physical world and enter a surprising and astonishing beauty universe that corresponds intimately to him.

[0071] Furthermore, in the step ET8 of displaying the augmented reality effect, the effect may be chosen randomly, for example from a given number (for example 5) of different themes. Since the user does not know which augmented reality effect he will obtain, this will create a feeling of rarity and excitement.

[0072] In these respects, reference is made to Figures 3 to 6, illustrating four examples of themes for augmented reality visuals, generating aesthetic ornamentations intended to embellish the virtual identity of the user. These examples all correspond to a personalization object which is a BU skin jewel, adapted to be placed on the contour of an eye.

[0073] [Fig.3] illustrates examples a, b, c, d, e, f, of augmented reality visual 30 comprising at least one part superimposed on the personalization object BU, so as to transform the aesthetics of the personalization object BU.

[0074] Thus, the examples of the augmented reality visual 30 can for example develop and extend in space the shape of the skin jewel, such as for example following a universe corresponding to a commercial brand, for example a sty- Japanese calligraphy list.

[0075] The augmented reality visuals 30 may advantageously be animated so as to follow in real time the movements of the user's face in the image stream, in a conventional manner known per se.

[0076] [Fig.4] illustrates examples a, b, c, d, e, f, of augmented reality visual 40 dynamically displaying in the image stream, an animation of a virtual artistic line on the face, and which can for example evolve from the skin jewel.

[0077] In these examples 40, explosions of colors of different shapes and different energies can arise from the center of the eye or from the skin jewel.

[0078] [Fig.5] illustrates examples a, b, c, d, of augmented reality visual 50 dynamically displaying in the image stream, an animation of a virtual artistic line on the face, and which can for example evolve from the skin jewel.

[0079] In these examples 50, drawings having a visual watercolor texture are generated on the face of the user who wears the skin jewel. The drawings may for example represent an animal representative of a universe of a commercial brand, for example Koi carp (ornamental fish of Japanese culture), which may appear from behind the jewel while swimming.

[0080] [Fig.6] illustrates steps a, b, c, d, e, f, of a cinematic (i.e. the “storyboard” according to the English cinematographic term) of an augmented reality visual 60 dynamically displaying in the image stream, an animation of a virtual artistic line on the face, evolving from the skin jewel.

[0081] In this kinematic 60, the scene of step a corresponds to the actual face of the user wearing the skin jewel. The scene of step b corresponds to a tear generated in augmented reality in the corner of the user's eye. In the scene of step c, the tear expands so as to draw a Tsubaki tree shape, with a liquid ink effect flowing into it. In the scene of step d, the ink and the tear dry, and flowers begin to bloom. In the scene of step e, the flowers grow to a final size. In the scene of step f, the largest of the flowers may explode into falling petals, advantageously in response to a movement of the user. For example, the movement may be a wink, or a nod of the head, or the like.

[0082] It will be noted, in all the examples presented in relation to figures 3 to 6, that it is possible for the user to interact with the augmented reality visual to animate it further by using facial expressions, for example, the eyes, the eyebrows and the movements of the mouth.

[0083] This interaction brings the skin jewel to life on the user's face, animating it as if by magic following an artistic direction chosen by the brand and trend boards that correspond to it. The animation possibilities can for example, including swirling particles, light trails, flying butterflies, sticker colors that glow randomly, colored marks that break down into particles that draw calligraphy patterns, etc., so as to create a sense of personalization and dynamism.

Claims

Claims

1. Method (10) comprising: - an acquisition of an image stream (ET6); - an identification of a support object (VIS) in the image stream (ET7); - an identification of a personalization object (BU) in the image stream (ET7); - if the identified support object and the personalization object correspond to a pair of associated objects, a provision of access to a transformation model of the image stream (ET8) associated with this personalization object.

2. The method of claim 1, wherein said providing access to the transformation model of the image stream (ET8) comprises: executing the transformation model generating an augmented reality (AR) visual in the image stream (ET8); and displaying the image stream including the augmented reality visual (30, 40, 50, 60).

3. Method according to claim 2, in which the augmented reality (AR) visual comprises at least one part superimposed on the personalization object (BU), in the image stream, so as to transform the aesthetics of the personalization object (30).

4. Method according to one of claims 2 or 3, in which the augmented reality (AR) visual is adapted to display, dynamically in the image stream, an animation of a virtual artistic line on the support object, evolving from the personalization object (40, 50, 60).

5. Method according to one of claims 1 to 4, wherein: - the identification of the support object (VIS) comprises an identification of markers specific to a given type of support object, such as facial markers if the support object is a face; - the identification of the personalization object (BU) comprises a detection of a location of the personalization object in a suitable region (REG) of the support object (VIS) determined by the positions of the specific markers.

6. Method according to one of claims 1 to 5, in which a preliminary step (ET4) comprises a near-field communication of preliminary information by a transponder contained in the personalization object (BU), the communicated information being capable of determining at least one pair of associated objects (BU, VIS).

7. Method according to claim 6, in which the communicated preliminary information is further capable of controlling, after the preliminary step (ET4), an activation (ET5) of the following steps of the method from the acquisition of the image stream (ET6).

8. Method according to one of claims 1 to 7, in which the personalization object (BU) is a label suitable for being stuck on human skin.

9. Method according to one of claims 1 to 8, in which the support object (VIS) is a human face.

10. Computer program product comprising instructions which, when the program is executed by a computer, cause the latter to implement the method according to one of claims 1 to 9.

11. A computer-readable recording medium comprising instructions which, when executed by a computer, cause the computer to implement the method according to one of claims 1 to Q

12. y. Personalization object (BU) adapted to the implementation of the method according to one of claims 1 to 9.

13. System comprising a computer and a personalization object (BU) configured to cooperate so as to implement the method according to one of claims 1 to 9.

Images