CONTROL METHOD OF THE FUNCTIONAL APPLICATIONS OF A WRISTWATCH
Patent Information
- Application Number
- DE602019076309
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-12-06
- Publication Date
- 2025-10-01
- Estimated Expiration
- 2039-12-06
AI Technical Summary
Existing watch authentication methods allow unauthorized access once the wearer is authenticated, lacking robustness and transparency in maintaining user identity.
A method and system using a multispectral biometric skin sensor to periodically verify the wearer's identity through vascular network and skin texture, ensuring automatic and non-intrusive access control by comparing digital identification elements generated from biometric information with a reference, and optionally using thermal imaging.
Ensures continuous, discreet, and reliable identity verification of the watch wearer, preventing unauthorized access by automatically re-authenticating based on biometric data without requiring repeated user interaction.
Description
Technical field
[0001] The present invention relates to a method for managing the use of the functions of a watch and a system implementing such a method.
[0002] The invention also relates to a watch comprising such a system as well as a computer program. Prior art
[0003] A watch includes a set of functions that can be used by the wearer. Such functions may involve, in addition to setting the time or date, the use of confidential or private data specific to the wearer and useful for accessing personalized services. This data is, for example, keys, certificates, authentication codes, passwords and personal codes that allow a secure connection of the watch to a private network of a company, authentication with secure servers such as a banking server, or secure messaging for sending and receiving signed and / or encrypted emails. Therefore, it is understandable that it is important to be able to secure access to the use of the functions of such a watch.
[0004] To do this, methods are known in the state of the art for managing the use of the functions of a watch by strengthening the authentication criteria authorizing / prohibiting this use, for example by implementing additional authentication steps.
[0005] However, one of the major drawbacks of such methods is linked to the fact that once the wearer of the watch is authenticated, it is then possible for any individual to have access to the functions of the watch, particularly in the case where the latter has been Document US 2015 / 242605 A1 describes a method for managing the use of the functions of a watch comprising a step of authenticating the wearer of the watch in order to authorize access to said functions and also comprising a step of checking the identity of the wearer of the watch by verifying the validity of a digital identification element determined from at least one biometric information element of the wearer of said watch in order to maintain access to said functions.
[0006] It is understood that there is a need to find an alternative solution, in particular one which does not have the disadvantages of the prior art. Summary of the invention
[0007] An aim of the present invention is therefore to propose a method for managing the use of the functions of a watch which is reliable and robust.
[0008] Such a process has the advantage of ensuring the identity of the wearer of the watch in an automatic, transparent and non-intrusive manner for the wearer.
[0009] For this purpose, the invention relates to a method for managing the use of the functions of a watch according to claim 1.
[0010] In other embodiments: the selection sub-step comprises a phase of visualizing at least one of said identification portions of the sequence in said graphic representation; the visualization phase comprises a sub-phase of pre-selecting at least one area of interest of the graphic representation capable of comprising said at least one identification portion; the validation sub-step comprises a phase of comparing said selected sequence with a reference sequence; the control step comprises a sub-step of generating a digital identification element from said at least one biometric information element; the control step comprises a sub-step of validating a digital identification element generated in anticipation of checking the identity of the bearer;the validation sub-step comprises a comparison phase comprising a sub-phase of retaining the authorization to access said functions of the watch if the generated digital identification element is substantially similar or similar to a reference digital identification element; the acquisition sub-step comprises a phase of illuminating the portion of skin according to different wavelengths; the acquisition sub-step comprises a phase of capturing images of the portion of skin illuminated at different wavelengths; the generation sub-step comprises a phase of characterizing said at least one biometric information element included in the acquired images relating to said portion of skin; the generation sub-step comprises a phase of designing the digital identification element from the characterization of said biometric information element;the biometric information element relates to a vascular network or a texture of this skin. ;
[0011] The invention also relates to a system for managing the use of the functions of a watch implementing this method, the system comprising the following elements connected together: a processing unit, a multispectral biometric skin sensor, an input interface and an interface for broadcasting visual information.
[0012] The invention also relates to a watch, in particular a connected mechanical watch, comprising such a system.
[0013] The invention also relates to a computer program comprising program code instructions for executing the steps of this method when said program is executed by the processing unit of said management system in the watch. Brief description of the figures
[0014] Other features and advantages will become clear from the description given below, for information purposes only and in no way limiting, with reference to the appended figures, in which: there figure 1 is a schematic representation of a watch comprising a system for managing the use of the functions of a watch, according to one embodiment of the invention, and the figure 2 is a flowchart relating to a method for managing the use of the functions of the watch, according to the embodiment of the invention. Detailed description of the invention
[0015] On the figure 1a watch 100 is shown comprising a system for managing the use of the functions of this watch 100. Such a system 1 is included in the watch 100 which is preferably a connected mechanical watch 100 with a hybrid display. In this context, this electronic device 100 comprises a body such as the watch case, and a fastening element such as a bracelet making it possible to fix this body for example to the wearer's wrist. This system 1 more precisely comprises in a non-limiting and / or non-exhaustive manner: a processing unit 2 comprising hardware and software resources, in particular at least one processor cooperating with memory elements 6; an interface for broadcasting visual information 3 such as a hybrid display dial provided with a first analog display component and a second digital and / or alphanumeric display component; an interface for broadcasting sound information 4 such as a loudspeaker; a wireless communication interface 5 (for example cellular, WLAN Bluetooth, etc.); an input interface 35 such as a keyboard or a touch interface included for example in the interface for broadcasting visual information 3, and a biometric sensor (34) in particular a multispectral skin biometric sensor 34 in this embodiment, such a sensor 34 comprising at least one photographic sensor 36, at least one multispectral lighting source 37 and at least one thermal image sensor 38, the lighting source 37 being able to emit light radiation in wavelengths between 300 and 1100 nm, in addition this lighting source 37 can be of the laser type.
[0016] In this system 1, the processing unit 2 is connected, among other things, to the interfaces for broadcasting visual and sound information 3, 4, to the input interface 35 as well as to the wireless communication interface 5 and to the multispectral biometric sensor 34. It will also be noted that the multispectral biometric sensor 34 is arranged in the body of the electronic device 100 and / or in the attachment element.
[0017] This system 1 implemented in the electronic device 100 is capable of ensuring the control of the identity of the authenticated wearer of the watch in a discreet manner, that is to say without direct intervention / interaction of the wearer with this watch 100, so that he can use the functions of the watch 100 all the time he wears it and this, without having to authenticate himself again. The identification of the wearer is then carried out in a transparent and discreet manner and this, from at least one element of biometric information included in the skin of this wearer such as the vascular network of the skin or the texture of this skin. This skin of the wearer which covers his body has a particularity, less obvious to envisage by the person skilled in the art because it cannot be naturally visualized by the human eye, linked to the absorption and reflection characteristics at different wavelengths (spectrum) of the components of the skin, located at different depths.In a simplified model, the skin is made up of a layer called the "epidermis", semi-transparent and located on the surface, then, under the epidermis, a layer called the "dermis" and comprising, among other things, the blood vessels (or vascular network) in which hemoglobin is highly reflective at high wavelengths close to red, for example between 760 and 930 nm, which here makes it possible to reveal or highlight the vascular network of the wearer's skin. In other words, the light absorption spectrum of the components of the epidermis and dermis constituting the skin is not uniform according to the electromagnetic wavelengths, the appearance and color of the skin result from a complex combination of these phenomena.Thus, when it is a question of highlighting or revealing an element of biometric information such as the texture of the skin of this wearer, a texture essentially formed of crevices or cavities, the lighting of the skin can then be ensured by a lighting source restricted to wavelengths around red which tends to make the phenomenon of shadows at the bottom of the crevices disappear. Indeed, a back projection effect occurs by reflection on the dermis and through the epidermis of these wavelengths close to red, whereas the lighting of the skin by a source of colorimetric spectrum far from red, typically the band of wavelengths located between violet (400 nm) and up to yellow-orange (600 nm), allows on the contrary to put these crevices of the skin in strong contrast by the appearance of shadows at the bottom of these crevices.It will be noted that the identification of a biometric information element included in the skin can be improved by the use of the thermal image sensor 38 preferably without illumination. For example, to highlight the texture of the skin, in particular when the portion of the skin concerned of this wearer is provided with hairs, the use of the thermal image sensor 38 makes it possible to reveal the crevices of this texture of the skin which are generally warmer than the surrounding skin and the hairs colder than this surrounding skin. Thus in this configuration the hairs can be thermally distinguished from the crevices of the texture of the skin due to this difference between their respective temperatures.
[0018] It should be noted that thermal image capture can be performed under illumination in a given wavelength depending on the biometric information element that needs to be highlighted or revealed.
[0019] It is therefore understood, according to the principle of the invention, that the periodic identification of the wearer is carried out from at least one biometric information element included in images of a portion of skin of this wearer which can be illuminated if necessary according to different wavelengths in order to capture images comprising the desired biometric information element. Thus, this biometric information element, included in these images, can be highlighted by the illumination carried out in different wavelengths or without illumination for example when it is a question of carrying out a capture of thermal images.
[0020] In this system 1, the memory elements 6 of the processing unit 2 comprise data relating to a previously defined / generated reference digital identification element. These memory elements 6 also comprise digital image processing algorithms 39 making it possible to characterize at least one biometric information element relating to the wearer's skin and which is included in the images relating to the wearer's skin portion. These memory elements 6 also comprise generation algorithms 40 of the reference digital identification element but also of the digital identification element which is generated periodically as part of the identity check of the wearer.
[0021] These memory elements 6 of the processing unit 2 also comprise at least one graphic representation 41 intended to participate in unlocking access to the functions of the watch 100. This graphic representation 41 may for example be an image comprising at least one object. For example, this image defines a scene comprising a plurality of objects such as dwellings, vehicles and / or a star such as the moon, etc. It is obviously understood that this image may define other types of scene comprising at least one object. These memory elements 6 also comprise data relating to a reference sequence 42 comprising reference identification portions of this graphic representation 41, said portions having been previously selected by the wearer of the watch during the configuration of a process for unlocking access to the functions of the watch 100.
[0022] Such a system 1 of the watch 100 is capable of implementing a method for securing access to the use of the functions of the watch 100, shown in the figure 2 . Such a method aims to ensure discreetly, that is to say in a non-intrusive and automatic manner, the identity of an authenticated wearer so that he can use the functions of the watch 100 all the time he wears it without having to authenticate himself again. The functions of the watch 100 may concern the setting of the time, the date or even the use of a stopwatch, a navigation system, a pedometer, an activity tracker, a messaging service, access to confidential or private data specific to the wearer and useful for accessing personalized services, etc.
[0023] This method comprises a step 10 of authenticating the wearer of the watch 100 in order to authorize access to said functions of this watch 100. This step 10 allows the wearer to provide proof of his identity. Indeed, the wearer can interact with the input interface 35 for authentication using an authenticator or a secret code.
[0024] This method then comprises a discrete control step 12 at a determined period of the identity of the wearer of the watch by verifying the validity of a digital identification element determined from at least one biometric information element included in a portion of skin of this wearer of said watch in order to retain / delete the authorization to access said functions. During this step 12, the determined period is a regular or irregular control period which can be configured automatically by the processing unit 2 or defined by the wearer. For example, this period can be a few seconds or a few minutes.Such a control step 12 makes it possible to verify at the end of each period that the wearer of the watch is still the same by checking his “biometric” identity from a digital identification element established as a function of at least one biometric information element included in the skin of this wearer.
[0025] This control step 12 then comprises a sub-step 13 of acquisition by the sensor 34 of a plurality of images of a portion of the wearer's skin, said skin being arranged adjacent to said sensor, said images comprising said at least one biometric information element included in this portion of skin. This sub-step 13 comprises a phase 14 of illumination of the portion of skin according to different wavelengths. More precisely, during this phase 14, the processing unit 2 controls the multispectral biometric sensor 34 and in particular the lighting source 37 so that the latter emits light radiation towards the portion of skin according to a precise wavelength adapted to highlighting or revealing said at least one specific biometric information element of the skin, here sought in the context of checking the identity of the wearer, and which is included in this portion of the wearer's skin.Once the lighting has been configured, the acquisition sub-step 13 comprises a phase 15 of capturing images of this portion of skin illuminated at at least one wavelength capable of highlighting or revealing said at least one element of biometric information. During this phase 15, the processing unit 2 controls the multispectral biometric skin sensor 34 and in particular the photographic sensor 36 synchronously with the activation / deactivation of the lighting source 37, in order to capture at least one image relating to the portion of skin illuminated for at least one wavelength.
[0026] This acquisition sub-step 13 may also comprise a phase 16 of capturing at least one thermal image of the portion of skin. Such a phase 16 is preferably carried out without illumination but in other alternatives illumination of the portion may be carried out in at least one given wavelength, this obviously depending on the biometric information element that is to be highlighted or revealed. This phase 16 may be carried out before or after the illumination 14 and image capture 15 phases.
[0027] The control step 12 then comprises a sub-step 17 of generating the digital identification element from said at least one biometric information element included in the acquired images of the portion of skin. Such a sub-step 17 comprises a characterization phase 18 of said biometric information element included in the images relating to said portion of skin. During this phase 134, the processing unit 2 implements algorithms 39 for processing the acquired images aimed at identifying / detecting in each of them said at least one biometric information element that they comprise. As already mentioned previously, these may be information elements relating for example to the texture of the skin or to the vascular network included in this portion of the wearer's skin. The implementation of these algorithms 39, 40 by the processing unit 2 may, for example, provide a process of cutting these images into segments.It is understood here that each acquired image gives an overall view of the portion of the wearer's skin, and then comprises zones of variable relevance for the identification of said at least one biometric information element. Such a cutting process helps to extract the segments to be processed and to eliminate the parts not to be processed in these images. These algorithms 39 can then provide an indexing of these image segments comprising characteristics relating to said at least one particular biometric information element to be identified, by location zones in the portion of skin and this, in order to be able to assign to each zone the appropriate processing with respect to the morphological typology of the characteristic of this geographical zone of the portion.In this context, these algorithms 39 process each segment of these images by highlighting the information carried by the pixels of each of these images by performing image analysis operations of the processing, transformation and detection type. Subsequently, these algorithms 39 carry out filtering and feature extraction or vectorization operations, in order to convert the image data relating to said at least one identified and extracted biometric information element, into parametric data, typically relative numerical values expressed for example as an index or as a percentage.
[0028] We understand here that the acquisition of several images representing the same portion of skin helps to improve the precision and efficiency of this characterization phase 18.
[0029] Subsequently, the generation sub-step 16 comprises a design phase 19 of the digital identification element from the characterization of said at least one biometric information element. During this phase 19, the processing unit 2 implements generation algorithms 40 of such a digital identification element specifically provided for the processing of the parametric data obtained during the characterization phase 18, which parametric data relate to the biometric information element.
[0030] Then, the control step 12 comprises a validation sub-step 20 of the digital identification element generated in anticipation of a check of the identity of the bearer. This validation sub-step 20 comprises a comparison phase 21, implemented by the processing unit 2, between the generated digital identification element and the reference digital identification element. In this method, the reference digital identification element can be created, as soon as the bearer has been duly authenticated and his identity is certain, and this, during a definition step 11 of this reference digital identification element providing sub-steps similar to the acquisition 13 and generation 17 sub-steps implemented during the control step 12.In this method, once the wearer of the watch 100 is authenticated, the processing unit 2 implements this definition step 11 and then performs archiving of the obtained reference digital identification element in the memory elements 6 of the processing unit 2. This reference digital identification element can therefore be determined automatically by the processing unit 2 or configured by the wearer during a setting process aimed at guiding the wearer in defining this reference digital identification element.
[0031] The comparison phase 21 also comprises a sub-phase 22 of conservation of the authorization of access to said functions of the watch 100 if the generated digital identification element is substantially similar or similar to the reference digital identification element. In this case, the control unit 2 executes again, according to the determined period, the sub-steps of acquisition 13 and generation 17 of the control step 12 in order to carry out the comparison phase 21 again.
[0032] Conversely, this comparison phase 21 includes a sub-phase 23 of deleting the authorization to access said functions of the watch 100 if the generated digital identification element is substantially different or different from the reference digital identification element. In this case, access to the functions of the watch 100 is then deleted because the wearer and owner of the watch 100 may no longer be in possession of it. Therefore, in this context, this sub-phase 23 then provides for a locking of access to the functions of this watch. Thus, to use the functions of the watch 100 again, it is necessary to unlock this access.
[0033] To do this, the method comprises a step 24 of unlocking access to the functions of the watch 100 once this access has been locked following a verification of the digital identification element highlighting its invalidity.
[0034] This step 24 comprises a sub-step 25 of presenting a graphic representation 41 on the interface for broadcasting visual information 3 of said watch 100. This sub-step 25 comprises a phase 26 of generating the display, on / in the interface for broadcasting visual information 3, of the graphic representation 41 provided for implementing this unlocking of access to the functions of the watch 100. This phase 26 may comprise a sub-phase of selecting by the wearer from a sample of at least two graphic representations displayed on the interface for broadcasting visual information 3, the graphic representation 41 provided for implementing this unlocking. It will be noted that the wearer is the only one to know the graphic representation 41 that he chose during the configuration of the process of unlocking access to the functions of the watch 100.
[0035] This presentation sub-step 25 then comprises a triggering phase 27 of a countdown as soon as the generation phase 26 is carried out. In other words, the preconfigurable countdown is triggered once the graphic representation 41 is presented on the broadcast interface 3. Such a phase 27 participates, from a limited time interval defined by this countdown, in counting down the estimated time necessary for entering the sequence of identification portions of the graphic representation 41 displayed on / in the broadcast interface 3.
[0036] Subsequently, the unlocking step 24 comprises a sub-step 28 of selecting in the limited time interval a sequence of at least two identification portions of said graphic representation 41 aimed at identifying said wearer, said sequence corresponding to an identification code of the wearer. Such identification portions are not directly visible in the graphic representation 41 presented on / in the broadcast interface 3. According to the claimed invention, the sub-step 28 of selecting comprises a phase 29 of viewing at least one of said identification portions of the sequence in said graphic representation 41. This viewing phase 29 comprises a sub-phase of selecting at least one area of interest of the graphic representation 41 capable of comprising said at least one identification portion.During this sub-phase, the wearer selects for example a first area of interest or a second area of interest by enlarging this first area or this second area from the input interface 35. Once this first or second area of interest has been selected, the identification portions then become visible. In this configuration, each identification portion useful for the production / constitution of the sequence can be selected from the input interface 35.
[0037] IlIt should be noted that the sequence comprises an ordered number of identification portions and that the selected area of interest may comprise, for example, three identification portions of which only two are ordered successively one after the other in the sequence. In this context, the remaining identification portion requires, in order to be part of the sequence, the selection of an identification portion included in another area of interest of the graphical representation 41.
[0038] Then, the unlocking step 24 comprises a validation sub-step 30 of the selected sequence. This validation sub-step 30 comprises a control phase 31 that the selection of the sequence of identification portions has been carried out within the limited time interval defined by the countdown. To the extent that this selection has been carried out within this limited time interval, the validation sub-step 30 then comprises a comparison phase 32, implemented by the processing unit 2, between said selected sequence and the reference sequence 42. This comparison phase 32 comprises a sub-phase of prohibiting access to the functions of the watch 100 if said sequence is substantially different or different from the reference sequence 42. Conversely, this comparison phase 32 comprises a sub-phase of authorizing access to the functions of the watch 100 if said sequence is substantially similar or similar to the reference sequence 42.
[0039] To the extent that this selection has not been carried out within the limited time interval, the validation sub-step 30 comprises a phase 33 of renewing the presentation 25 and selection 28 sub-steps. If subsequently, the selection of the sequence has again not been carried out within the limited time interval, the validation sub-step 30 then provides a sub-step of blocking the functions of the watch 100 for a given time or even definitively.
Claims
1. A method for managing the use of the functions of a watch (100) including: - a step (10) of authenticating the wearer of the watch (100) in order to authorise access to said functions, and - a step (12) of controlling the identity of the wearer of the watch at a determined period by verifying the validity of a digital identification element determined from at least one biometric information element of the wearer of said watch in order to maintain access to said functions, characterised int that said method comprised: - a step (24) of unlocking access to said functions of the watch (100) when this access has been locked following a verification of the digital identification element showing its invalidity, said step comprising the following sub-steps: • presentation (25) of a graphic representation (41) on an interface (3) for broadcasting a visual piece of information of said watch (100); • selection (28) within a limited time interval of a sequence of at least two identification portions comprised in said graphic representation (41) aiming at identifying said wearer, said sequence corresponding to an identification code of the wearer, and • validation (30) of the selected sequence, • said at least one biometric information element being comprised in a portion of the wearer's skin and the control step (12) comprising a sub-step (13) of acquiring by at least one multispectral biometric skin sensor (34) comprised in the watch (100), a plurality of images of a portion of the wearer's skin adjacent to said sensor (34), such a sensor (34) comprising at least one photographic sensor (36), at least one multispectral illumination source (37) and at least one thermal image sensor (38), the illumination source (37) being able to emit light radiation in wavelengths comprised between 300 and 1100 nm, in addition this illumination source (37) can be of the laser type, and said images comprising said at least one biometric information element comprised in this skin portion, and in that the selection sub-step (28) comprises a phase (29) of visualising at least one of said identification portions of the sequence in said graphic representation (41) comprising a sub-phase of selecting at least one area of interest of the graphic representation (41) comprising said at least one identification portion, during this sub-phase, the wearer selects a first area of interest or a second area of interest by carrying out an enlargement of this first area or this second area from the input interface (35) of the watch, once this first or second area of interest is selected, the identification portions then become visible.
2. The method according to the preceding claim, characterised in that the selection sub-step comprises a phase (29) of visualising at least one of said identification portions of the sequence in said graphic representation (41).
3. The method according to any one of the preceding claims, characterised in that the validation sub-step comprises a phase of comparison between said selected sequence and a reference sequence (42).
4. The method according to any one of the preceding claims, characterised in that the control step (12) comprises a sub-step (17) of generating a digital identification element from said at least one biometric information element.
5. The method according to any one of the preceding claims, characterised in that the control step (12) comprises a sub-step (20) of validating a digital identification element generated in anticipation of the control of the identity of the wearer.
6. The method according to the preceding claim, characterised in that the validation sub-step (20) comprises a comparison phase (21) including a sub-phase (23) of maintaining the authorisation to access said functions of the watch if the generated digital identification element is substantially similar or similar to a reference digital identification element.
7. The method according to any one of the preceding claims, characterised in that the acquisition sub-step (13) comprises a phase (14) of illuminating the skin portion according to different wavelengths.
8. The method according to any one of the preceding claims, characterised in that the acquisition sub-step (13) comprises a phase (15) of capturing images of the skin portion illuminated at different wavelengths.
9. The method according to any one of the preceding claims, characterised in that the generation sub-step (17) comprises a phase (18) of characterising said at least one biometric information element comprised in the acquired images relating to said skin portion.
10. The method according to any one of the preceding claims, characterised in that the generation sub-step (17) comprises a phase (19) of designing the digital identification element from the characterisation of said biometric information element.
11. The method according to any one of the preceding claims, characterised in that the biometric information element relates to a vascular network or to a texture of this skin.
12. A system for managing the use of the functions of a watch (100) implementing the method according to any one of the preceding claims, the system (1) comprising the following elements connected together: a processing unit (2), a multispectral biometric skin sensor (34), an input interface (35) and an interface for broadcasting a visual piece of information (3).
13. A watch (100), in particular a connected mechanical watch (100), including a system (1) according to claim 12.
14. A computer program comprising program code instructions for executing the steps (10 to 33) of the method according to any one of claims 1 to 11 when said program is executed by the processing unit (2) of said watch (100).