A method of managing fingerprint data at an electronic device

Abstract

The present disclosure generally relates to a method of managing fingerprint data at an electronic device, the electronic device for example being at least one of smart card, a mobile phone, and a fingerprint module. The electronic device is provided with a composite fingerprint template holding distinguishable information for a plurality of different fingers. The present disclosure also relates to a corresponding electronic device and to a computer program product.

Description

[0001] A METHOD OF MANAGING

[0002] FINGERPRINT DATA AT AN ELECTRONIC DEVICE

[0003] TECHNICAL FIELD

[0004] The present disclosure generally relates to a method of managing fingerprint data at an electronic device, the electronic device for example being at least one of smart card, a mobile phone, and a fingerprint module. The electronic device is provided with a composite fingerprint template holding distinguishable information for a plurality of different fingers. The present disclosure also relates to a corresponding electronic device and to a computer program product.

[0005] BACKGROUND

[0006] The use of biometric techniques to identify and / or authenticate the identity of a user is increasing. Biometric techniques that are promoted for this use include voice, fingerprint, iris, vein pattern, and other biometric scans. Currently, the use of fingerprint sensors for capturing a fingerprint representation of a user’s finger has shown to be specifically promising, for example, due to its ease of integration with different types of electronic equipment, such as smartphones, watches, tablets, and / or any other type of electronic devices where personalized and reliable user interaction is advantageous.

[0007] Traditionally, such fingerprint based biometric systems have relied on capturing and analyzing data from a single finger. This approach, while effective in many scenarios, can occasionally be limiting. For instance, a user might find it inconvenient or impossible to use the same finger consistently due to various circumstances, such as physical injury or practicality in different situations. Therefore, there’s a growing interest in systems that can capture and manage data from multiple fingers. Such systems offer not only an enhanced level of convenience and flexibility for the user but also provide a more robust framework for security. By accommodating multiple fingers, biometric systems can cater to a wider range of user needs and preferences, and in doing so, bolster the reliability and effectiveness of personal authentication.

[0008] The above-mentioned advancements towards systems capable of simultaneously processing fingerprint data from multiple fingers introduce new challenges and opportunities in the realm of fingerprint recognition technology. Such a transition reflects the growing need for sophisticated, yet user-friendly, systems capable of handling the complexity of scanning multiple fingerprints, particularly within the confines of compact electronic devices.

[0009] A recent development in this area, as demonstrated by US20220277583A1, offers a method for user authentication by simultaneously acquiring fingerprints from multiple fingers. The technique disclosed by US20220277583A1 emphasizes the creation of variation models to understand plausible mutual position variations among pairs of fingerprints and leverages these models in the authentication process. While the approach presented in US20220277583 Al signifies an advancement in multi-finger biometric data management, it is not without limitations, especially in terms of practical application.

[0010] Specifically, the complexity inherent in the system outlined in US20220277583A1, particularly in settings where streamlined user interaction is essential, presents notable challenges. The process of creating variation models and calculating the mutual position plausibility of fingerprint pairs can be computationally intensive, potentially rendering it less suitable for devices with limited processing capacities. Moreover, the reliance on intricate algorithms for fingerprint comparison might lead to increased processing times, potentially impacting the user experience, especially during quick authentication sequences.

[0011] Accordingly, there seems to be room for further improvement in managing multi-finger fingerprint data, especially for electronic devices, such as smart cards, with integrated fingerprint sensors. Enhancements are particularly desirable from the perspectives of computational efficiency, user interaction, and overall hardware simplicity. Such advancements would not only make the enrollment and authentication process more efficient but also more user-friendly and accessible across a variety of electronic devices.

[0012] SUMMARY

[0013] In view of the above-mentioned challenges, it is an object of the present disclosure to provide an improved method of managing fingerprint data at an electronic device.

[0014] According to an aspect of the present disclosure, it is therefore provided a method for managing fingerprint data at an electronic device, the electronic device comprising a fingerprint sensor configured for capturing a fingerprint representation of a finger of a user, and processing circuitry connected to and configured to control the operation of the fingerprint sensor, wherein the method comprising the steps of acquiring, using the fingerprint sensor, multiple fingerprint representations from different fingers of one or multiple users, extracting, using the processing circuitry, fingerprint features from each fingerprint representation, forming multiple sets of fingerprint features, consolidating, using the processing circuitry, the multiple sets of fingerprint features into a single composite fingerprint template, and providing, by the processing circuitry, a separation mechanism within the composite fingerprint template adapted to distinguish between fingerprint features of different fingers, wherein the separation mechanism includes forming separated clusters corresponding to each finger’s fingerprint features within the composite fingerprint template.

[0015] By means of the present disclosure, it is possible to significantly increase the computational efficiency and security in electronic devices utilizing fingerprint sensors. The proposed method streamlines the process of managing multiple fingerprints by efficiently consolidating the data into a single composite fingerprint template. This approach offers a distinct advantage over traditional methods, which often require separate templates for each finger, leading to increased enrollment and authentication complexity and usage of storage space.

[0016] An advantage following the present disclosure is the ability to maintain a high level of security while offering increased flexibility in handling of fingerprint data. The present disclosure specifically applies separation mechanism within the composite template, which allows for easy addition, identification, differentiation and removal of fingerprint features from different fingers of the above mentioned one or multiple users. Such an implementation may not only simplify the enrollment and authentication process but also ensures that the processing circuitry remains robust against potential security breaches. Furthermore, by utilizing a single template to manage multiple fingerprints, the present invention may possibly reduce the demand on storage and processing resources, making it particularly suitable for devices with limited capacities.

[0017] In addition to enhancing security and efficiency, the present disclosure offers an improved user interface by simplifying the fingerprint enrollment and verification process. The consolidation of multiple fingerprint data into a single template, coupled with the presented separation mechanism, means that user or users can seamlessly use different fingers for authentication without the need for repetitive enrollment processes for each and every finger that the user subsequently would like to use for authentication. Such a user- friendly approach can significantly enhance the adoption and satisfaction rates for biometric security systems in everyday electronic devices, ranging from smart cards, mobile phones, general fingerprint modules, smart buttons with integrated fingerprint functionality, and / or any form of similar devices where fingerprint functionality may be desirable. When the scheme according to the present disclosure is implemented in relation to a smart card, such a smart card may in one preferred embodiment be a hybrid smart card, implementing both of contactless and contact interfaces (electrical contact pads) on a single card. Accordingly, for achieving the contactless interface the smart card may further comprise a wireless transceiver for wireless communication with the electronic transaction terminal, such as for example with a so-called POS terminal. The wireless transceiver may for example be adapted for at least one of Bluetooth, Wi-Fi, and NFC communication. The wireless functionality could possibly be limited to use only once the user has enrolled his fingerprint with the smart card, for example for payment purposes as is known within the technical area of the present disclosure. In some embodiments, the fingerprint template is only amended if the smart card is arranged in a vicinity of the POS terminal, such as within a predetermined distance from the POS terminal. Such an implementation will of course provide further security to the activation process, reducing the risks with e.g. a hacker trying to falsely activate the fingerprint functionality for the smart card. The predetermined distance may in some embodiment of the present disclosure for example be set based on an “NFC field” provided by the electronic transaction terminal and used by the smart card.

[0018] As indicated above, a desirable feature of the present disclosure is provided by means of the implementation of the separation mechanism within the composite fingerprint template. This mechanism is specifically designed to differentiate and organize fingerprint data obtained from multiple fingers of the one or multiple users. Unlike conventional systems that typically require multiple templates for individual fingers, the disclosed mechanism facilitates the integration of multiple fingerprint datasets into a singular, coherent structure. By doing so, it allows for a more compact and efficient management of fingerprint data, reducing the storage and processing load on the electronic device. The separation mechanism functions by identifying unique characteristics inherent to each finger’s fingerprint and categorizing these into distinct clusters within the composite template. Accordingly, methodical clustering ensures that each fingerprint’s identity is preserved and readily accessible for authentication purposes, despite being part of a consolidated database.

[0019] The functionality of the separation mechanism may in some embodiments be allowed to center around its ability to accurately and effectively separate fingerprint features from different fingers of one or multiple users. When a new fingerprint representation is captured, the mechanism analyzes and compares it against the existing clusters in the template. It may for example assess characteristics such as ridge patterns, minutiae points, and other distinctive features to determine the appropriate cluster for the new data. Such a process not only simplifies the enrollment and subsequent updating of fingerprint data but also ensures that each fingerprint’s data is kept distinct and readily accessible for authentication. The separation mechanism as defined in line with the present disclosure as such allows for ongoing updates and refinements to the fingerprint data, accommodating natural changes in the fingerprints over time, thereby maintaining the accuracy and reliability of a subsequent fingerprint authentication process being possible once the user’s fingerprint or fingerprints have been enrolled.

[0020] Furthermore, the concept of a ’’single composite fingerprint template” as mentioned above is understood to relate to the concept of providing a single “placeholder” for the features relating to multiple fingers. However, it is important to clarify that the term “single” does not necessarily imply a singular, contiguous file of data. Rather, this composite template can be viewed as an aggregated set of data entries, potentially distributed across different areas of a memory element associated with the processing circuitry. Such a flexibility in data storage allows for more efficient use of memory resources, particularly in devices with limited storage capacities or specific memory architectures. In practice, the single composite template functions as a unified database entry that logically consolidates all the fingerprint data. It is structured in such a way that, despite the data potentially being physically distributed across multiple memory locations, it is seamlessly accessed and processed as a coherent unit. Thus, such an approach not only optimizes memory usage but also maintains the efficiency and speed of data retrieval and processing, crucial for real-time authentication tasks.

[0021] For reference, the expression “processing circuitry” as used above should be understood to include any type of computing device, such as an ASIC, a micro-processor, etc. It should also be understood that the actual implementation of such a processing circuitry may be divided between more than a single device / circuit.

[0022] Furthermore, within the context of the present disclosure, the expression “fingerprint representation” (or fingerprint image) should be interpreted broadly and to include both a regular “visual image” of a fingerprint of a finger as well as a set of measurements relating to the finger when acquired using the fingerprint sensor. A plurality of fingerprint images may be subsequently acquired and fused together during a single session, where the resulting information is used as an input for determining the sets of features.

[0023] It should also be understood that the fingerprint sensor preferably is a fingerprint touch sensor; however, the present disclosure may also be implemented using e.g. a swipe fingerprint sensor. The fingerprint sensor may be implemented using any kind of current or future fingerprint sensing principle, including for example capacitive, optical, or thermal sensing technology. However, at present capacitive sensing is most preferred. Both one and two-dimensional sensors are possible and within the scope of the present disclosure.

[0024] In a preferred embodiment of the present disclosure, the scheme according to the present disclosure further comprises determining, using the processing circuitry, a similarity level between each set of extracted fingerprint features and corresponding information within the composite fingerprint template, and selectively updating, using the processing circuitry, the composite fingerprint template with new fingerprint features based on the determined similarity levels.

[0025] Such an implementation may possibly enhance an accuracy and relevance of the fingerprint data by ensuring that the template is continually refined and updated, particularly beneficial for accommodating natural variations in fingerprints due to factors such as aging or minor injuries. Additionally, the selective updating optimizes memory usage by avoiding the storage of redundant or insignificant data, thereby efficiently managing the processing circuitry’s resources.

[0026] Furthermore, enhanced security is another key advantage of such an embodiment. By continuously refreshing the fingerprint data within the template, the overall implementation of the scheme according to the present disclosure becomes more resilient to unauthorized access attempts, including spoofing or using outdated fingerprint information. Additionally, the adaptability according to the present disclosure may also allow it to “learn” the user’s unique fingerprint characteristics over time, creating a more personalized and accurate fingerprint profile. Such an implementation of adaptive learning aspect may be particularly advantageous in environments where the fingerprint data must be current and highly secure.

[0027] Preferably, it may also be possible to dynamically manage a storage space for the composite fingerprint template by selectively retaining or discarding fingerprint features based on usage frequency and available storage capacity. In essence, such an implementation allows for selectively retaining or discarding fingerprint features based on their usage frequency and the memory element’s available storage capacity, by continuously monitoring each fingerprint feature’s usage within the template, prioritizing frequently used features for retention and identifying seldom -used data for potential removal.

[0028] The technical functionality of such an implementation allows for a storage space optimization, again particularly useful in devices with limited memory. By dynamically adjusting the stored fingerprint data in real-time, the processing circuitry adapts to the user’s unique behavioral patterns, ensuring that only the most relevant and frequently used data is kept. Accordingly, such an implementation not only maximizes the utility of available memory but also enhances the processing circuitry’s overall performance. Faster processing times, especially during authentication, are a direct result of this reduced data load, thereby significantly improving the user experience. Furthermore, such an adaptability makes it especially advantageous for devices like certain models of smart cards or wearables, which often operate under strict memory constraints, for example by enabling such devices to maintain advanced fingerprint capabilities without necessitating extensive memory resources, balancing advanced functionality with resource management.

[0029] Furthermore, it is in such an embodiment desirable to allow the dynamic management of the storage to also comprise protecting, using the processing circuitry, core clusters within the composite template to ensure the integrity of each enrolled cluster. Accordingly, the processing circuitry is in such an embodiment utilized to identify and safeguard these core clusters, which are integral parts of each fingerprint cluster essential for accurate identification. The focus is in this embodiment on preserving the uniqueness and precision of each fingerprint within the composite template, ensuring the integrity of enrolled clusters, especially as the template is dynamically updated with new data and older data is potentially discarded.

[0030] The protection of core clusters also serves different purposes. For example, it maintains the foundational characteristics of each fingerprint, pivotal for consistent and reliable user authentication. Such a preservation is highly desirable as it bolsters the processing circuitry against potential discrepancies that might occur during the updating process. On the other hand, it enhances the processing circuitry’s adaptability in managing fingerprint data. By balancing between updating and safeguarding critical fingerprint data, the processing circuitry demonstrates its proficiency in offering both flexibility in data management and robustness in security. Such an approach exemplifies how the processing circuitry skillfully manages biometric information while upholding the accuracy and integrity of each enrolled fingerprint.

[0031] In one preferred embodiment, the forming of the clusters within the composite template includes the creation of distinct sub-templates during the enrollment phase, and each sub-template being arranged to uniquely correspond to different fingers of the user. The creation of these distinct sub-templates is a desirable step in establishing the structure and functionality of the composite fingerprint template. It allows for a clear and systematic representation of the fingerprint data from each finger, ensuring that each finger’s data is stored and processed individually.

[0032] The creation of individual sub-templates for each finger offers several advantages. First of all, it facilitates efficient and accurate biometric authentication. By maintaining separate data clusters for each finger, the processing circuitry can quickly and accurately match a presented fingerprint against the correct sub-template, streamlining the authentication process. Furthermore, this method enhances user convenience and flexibility, as it accommodates the practicality of using different fingers in varying scenarios. Whether due to personal preference, injury, or environmental conditions, users can rely on the processing circuitry’s ability to recognize and authenticate their identity based on any of their enrolled fingers.

[0033] Advantageously, the scheme according to the present disclosure additionally comprises assessing, using the processing circuitry, the similarity level between newly acquired fingerprint representations and the existing clusters in the composite template to determine the need for updating the template. The process of assessing similarity levels serves as a basis for deciding how the fingerprint template should evolve. When new fingerprint data is obtained, the processing circuitry compares it against the established clusters in the template. If significant differences or new features are detected, which may be seen as an indication of a deviation from the existing data, it is possible for the processing circuitry to then updates the template to incorporate these new aspects. Such an ongoing assessment ensures that the fingerprint template remains a true and current representation of the user’s biometric data.

[0034] Furthermore, such an embodiment allows for a more dynamic and responsive approach to biometric data management. Instead of a static, unchanging record, the fingerprint template becomes a living entity that adapts and evolves with the user. The dynamic nature of the template ensures that it remains effective in authenticating the user, even as subtle changes occur in their fingerprints over time.

[0035] Preferably, the separation mechanism includes analyzing geometric and spatial characteristics of the extracted fingerprint features to form the distinct clusters. Such a process may enhance the ability to form distinct clusters within the composite fingerprint template. By examining the geometric shapes, patterns, and spatial arrangements of the fingerprint features, the processing circuitry can effectively differentiate and segregate data corresponding to different fingers. Furthermore, the inclusion of geometric and spatial analysis in the separation mechanism allows for a nuanced and precise organization of the fingerprint data. As each finger’s print comprises unique geometric properties and spatial layouts, the processing circuitry leverages this information to create clearly defined clusters within the template. Accordingly, such an implementation may be seen as going beyond mere pattern recognition, since it digs into the intricate details of each fingerprint, ensuring that the clusters formed are distinct and accurately representative of each finger. Additionally, such an implementation enhances the ability to handle complex biometric data. By dissecting and understanding the finer aspects of fingerprint geometry and space, the processing circuitry becomes more adept at distinguishing between fingerprints, even those with subtle differences. Such a level of detail in the separation mechanism not only contributes to the accuracy of the processing circuitry but also enhances its security, making it more resilient against potential authentication errors or spoofing attempts.

[0036] In one embodiment, the separation mechanism further comprises an algorithm for dynamically updating the distinct clusters based on subsequent fingerprint acquisitions, wherein the updates include adding new fingerprint features to the respective clusters or modifying existing features within the clusters. The dynamic updating process allows for the possibility of maintaining a high “relevance” of the fingerprint template. As new fingerprint data is captured, the algorithm assesses whether these new features are entirely novel or variations of existing ones. Based on this assessment, it either adds these features to the appropriate clusters or adjusts the current features within the clusters. Such a continuous refinement and updating of the clusters ensure that the fingerprint template is a living, evolving entity that accurately reflects the user’s biometric data over time.

[0037] Moreover, the inclusion of this dynamic updating algorithm enhances the processing circuitry’s ability to adapt to changes in the user’s fingerprints. Factors such as aging, injuries, or even temporary alterations (like cuts or abrasions) can affect fingerprint patterns. The algorithm’s ability to integrate these changes into the existing clusters without compromising the overall integrity and accuracy of the template is generally highly desirable, since it may ensure that the processing circuitry remains effective and reliable, providing robust user authentication irrespective of minor variations in the fingerprints.

[0038] It may also be possible to configure the separation mechanism to employ a pattern recognition process to distinguish between overlapping and non-overlapping fingerprint features across different clusters. Employing pattern recognition in the separation mechanism provides a nuanced approach to managing complex fingerprint data. For instances where fingerprints from different fingers exhibit overlapping features, the scheme according to the present disclosure may be configured to handle these patterns, accurately assigning them to their appropriate clusters. Such a function is particularly beneficial in scenarios where multiple fingers might display similar biometric traits, or in situations where partial prints from different fingers might otherwise be confused with one another. The pattern recognition process as defined in line with the present disclosure thus adeptly resolves these complexities, ensuring that each cluster is correctly associated with its corresponding finger.

[0039] Furthermore, the scheme according to the present disclosure may allow for enhancing the overall accuracy and reliability of the processing circuitry. By meticulously ensuring that each cluster in the template accurately and uniquely corresponds to its respective finger, the pattern recognition process significantly contributes to the integrity of the biometric data. Such a separation of overlapping and non-overlapping features not only strengthens the processing circuitry’s security but also promotes a seamless and efficient authentication experience for the user.

[0040] In another embodiment of the present disclosure the separation mechanism utilizes a prioritization protocol within the composite fingerprint template, which assigns higher priority to frequently used fingerprint features and clusters, such as for example for faster processing and retrieval during user authentication scenarios. Such an implementation of the prioritization protocol within the separation mechanism offers several advantages as compared to prior-art. For example, the scheme according to the present disclosure may allow for a streamlining of the authentication process by ensuring that the most commonly accessed fingerprint data is readily available for quick verification. Such an implementation not only accelerates the authentication procedure but also enhances the overall user experience, as the processing circuitry responds more promptly and efficiently to frequent authentication requests. Furthermore, such an approach may also allow for an optimization of the available computational resources as it focuses processing power and memory on the fingerprint data that is most relevant to the user’s regular interactions with the device.

[0041] Additionally, by emphasizing the most frequently used fingerprint data, this prioritization protocol ensures that the electronic device remains both responsive and efficient in everyday scenarios. Such an embodiment therefore reflects a user-centric approach in biometric data management, where the processing circuitry adapts to the individual usage patterns of the user, thus offering a personalized and seamless authentication experience. According to another aspect of the present disclosure, there is provided an electronic device adapted to manage fingerprint data, the electronic device comprising a fingerprint sensor configured for capturing a fingerprint representation of a finger of a user, and processing circuitry connected to and configured to control the operation of the fingerprint sensor, wherein the processing circuitry is adapted to acquire, using the fingerprint sensor, multiple fingerprint representations from different fingers of one or multiple users, extract fingerprint features from each fingerprint representation, forming multiple sets of fingerprint features, consolidate the multiple sets of fingerprint features into a single composite fingerprint template, and provide a separation mechanism within the composite fingerprint template adapted to distinguish between fingerprint features of different fingers, wherein the separation mechanism includes forming separated clusters corresponding to each finger’s fingerprint features within the composite fingerprint template. This aspect of the present disclosure provides similar advantages as discussed above in relation to the previous aspect of the present disclosure.

[0042] In accordance to a still further aspect of the present disclosure there is provided a computer program product comprising a non-transitory computer readable medium having stored thereon computer program means for operating electronic device adapted to manage fingerprint data, the electronic device comprising a fingerprint sensor configured for capturing a fingerprint representation of a finger of a user, and processing circuitry connected to and configured to control the operation of the fingerprint sensor, wherein the computer program product comprises code for acquiring, using the fingerprint sensor, multiple fingerprint representations from different fingers of one or multiple users, code for extracting, using the processing circuitry, fingerprint features from each fingerprint representation, forming multiple sets of fingerprint features, and code for consolidating, using the processing circuitry, the multiple sets of fingerprint features into a single composite fingerprint template, and code for providing, by the processing circuitry, a separation mechanism within the composite fingerprint template adapted to distinguish between fingerprint features of different fingers, wherein the separation mechanism includes forming separated clusters corresponding to each finger’s fingerprint features within the composite fingerprint template. Also this aspect of the present disclosure provides similar advantages as discussed above in relation to the previous aspects of the present disclosure.

[0043] The computer readable medium may be any type of memory device, including one of a removable nonvolatile random-access memory, a hard disk drive, a floppy disk, a CD-ROM, a DVD-ROM, a USB memory, an SD memory card, or a similar computer readable medium known in the art.

[0044] Further features of, and advantages with, the present disclosure will become apparent when studying the appended claims and the following description. The skilled person realize that different features of the present disclosure may be combined to create embodiments other than those described in the following, without departing from the scope of the present disclosure.

[0045] BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The various aspects of the present disclosure, including its particular features and advantages, will be readily understood from the following detailed description and the accompanying drawings, in which:

[0047] Figs. 1 A - 1C schematically illustrate exemplary electronic devices to be used in conjunction with the scheme according to the present disclosure,

[0048] Fig. 2 exemplifies a fingerprint sensor comprised with the electronic device,

[0049] Fig. 3 provides a flowchart illustrating the exemplary steps of the present disclosure for managing fingerprint data at an electronic device, and

[0050] Figs 4A - 4D present an evolving composite fingerprint template as used in relation to the present disclosure.

[0051] DETAILED DESCRIPTION

[0052] The present disclosure will now be described more fully hereinafter with reference to the accompanying drawings, in which currently preferred embodiments of the present disclosure are shown. This present disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided for thoroughness and completeness, and fully convey the scope of the present disclosure to the skilled person. Like reference characters refer to like elements throughout.

[0053] Turning now to the drawings and to Fig 1 in particular, there is schematically illustrated a smart card carrier 100 integrating a fingerprint sensing system including a fingerprint sensor 102 including a plurality of sensing elements and configured for capturing a fingerprint representation of a fingerprint pattern of a finger of a user, as well as a processing circuitry 104 connected to and configured to control the operation of the fingerprint sensor 102. In this embodiment the fingerprint sensor 102 is arranged on the front side of the smart card 100. However, the fingerprint sensor 102 may as an alternative (or also) be provided on a back side of the smart card, or alternatively laminated inside the smart card 100. The fingerprint sensor 102 may, for example, be used for authenticating the user when performing a payment and / or transaction, for example allowing the smart card 100, once the finger of the user has been enrolled, to interact with e.g. a POS terminal (not shown). Furthermore, the smart card carrier 100 may integrate a plurality of contact pads 106 electrically connected to at least the processing circuitry 104, possibly allowing for providing a wired connection with the POS terminal if / when the smart card carrier 100 is inserted in a card slot provided with the POS terminal.

[0054] In addition, the smart card carrier 100 may in some embodiments also include a user interface, such as for example a light source 108 (e.g. a light emitting diode, LED) integrated with the smart card carrier 100 and arranged in electrical connection with the processing circuitry 104. Still further, the smart card carrier 100 preferably comprises means (not shown) for allowing wireless interaction with the POS terminal, such as adapted for allowing near field communication (NFC) between the smart card carrier 100 and the POS terminal. Accordingly, in using wireless communication the user need not insert the smart card carrier 100 into the card slot of the POS terminal. The NFC connection between the smart card carrier 100 and the POS terminal may further be used for providing electrical power to the smart card carrier 100, in a manner known to the skilled person.

[0055] The smart card carrier 100 forms together with the fingerprint sensor 102, the processing circuitry 104, etc., a smart card system 110.

[0056] The processing circuitry 104 further comprises a memory, such as a database, e.g. for storing one or a plurality of fingerprint template for one or a plurality of fingers for the user. The processing circuitry 104 may each include a microprocessor, microcontroller, programmable digital signal processor or another programmable device. The processing circuitry 104 may also, or instead, each include an application specific integrated circuit, a programmable gate array or programmable array logic, a programmable logic device, or a digital signal processor. Where the processing circuitry 104 includes a programmable device such as the microprocessor, microcontroller or programmable digital signal processor mentioned above, the processor may further include computer executable code that controls operation of the programmable device. It should be understood that all or some parts of the functionality provided by means of the processing circuitry 104 (or generally discussed as “processing circuitry”) may be at least partly integrated with the fingerprint sensor 102. It should furthermore be noted that the invention may be applicable in relation to any other type of electronic devices, such as a mobile phone, a laptop, a remote control, a tablet computer, or any other type of present or future similarly configured device, including any type of loT devices where there is a desire to allow for user specific settings and / or identification / authentication of a user to be implemented. Figs. IB and 1C illustrates to two such exemplary electronic devices.

[0057] As an example, Fig. IB schematically illustrates a further example of an electronic device configured to apply the concept according to the present disclosure, in the form of a mobile phone 100’ with an integrated fingerprint sensor 102 and a display unit 110 with a touch screen interface. In this embodiment the fingerprint sensor 102 is arranged integrated with the display unit 110. It may of course be possible to arrange the fingerprint sensor 102 on a side / edge of the mobile phone 100’, where the display unit 110 is arranged at the front of the mobile phone 100’. The fingerprint sensor 102 may, for example, be used for unlocking the mobile phone 100’ and / or for authorizing transactions carried out using the mobile phone 100’, etc. The fingerprint sensor 102 may of course also be placed on the back or the front side of the mobile phone 100.

[0058] Preferably and as is apparent for the skilled person, the mobile phone 100’ shown in Fig. la further comprises a first antenna for WLAN / Wi-Fi communication, a second antenna for telecommunication communication, a microphone, a speaker, and a phone control unit. Further hardware elements are of course possibly comprised with the mobile phone.

[0059] A further exemplary electronic device configured to apply the concept according to the present disclosure is presented in Fig. 1C. Specifically, in Fig. 1C there is presented a switch 100” having an integrated fingerprint sensor. The switch 100” could for example be arranged to only allow the correct user to turn on / off the light or provide the user with user specific settings for the room where the switch 100” is arranged to control the light. It should be understood that the switch 100” must not necessarily be configured to control light. For example, the switch 100” may be arranged to control other features such as further equipment, including for example a computer / projector provided for showing a presentation, heating equipment, etc. The switch 100” could essentially be configured to control any type of equipment and the integrated fingerprint sensor 102 and the functionality provided by means of the present invention will allow the control to be user specific. For example, the switch 100” could be used for controlling a coffee maker to give a specific user a specific type of coffee or for charging the user for the coffee. Alternatively, the switch 100” could be used as a component within an interior of a vehicle, such as a car where e.g. a “start button” 100” is provided with a fingerprint sensor 102 for allowing user access and specific settings for the users to be applied once the user has been identified / authenticated. The fingerprint sensor 100” could of course also be arranged on the outside of the vehicle, thereby only allowing the correct user access to the interior of the vehicle.

[0060] One difference between the electronic devices as shown in Figs. 1 A - 1C is that the switch 100” shown in Fig. 1C lacks any form of user interface (UI) for the user operating the switch. Accordingly, the user may simply place his finger at the fingerprint sensor 102 provided with the switch 100”, and the switch 100” will perform the process of identifying / authenticating the user, even in a case where the user has not previously interacted with the switch 100”. The switch 100” must accordingly not necessarily be trained in regards to fingerprint interaction in an enrollment process; rather there is enough that the user provides his finger at the fingerprint sensor, whereby an unknown user may be enrolled with the switch 100”. Once the user has been enrolled the switch 100” may be used with specific possibly pre-allocated functions.

[0061] With further reference to Fig. 2, there is conceptually illustrated a somewhat enlarged view of the fingerprint sensor 102. In the case of employing a capacitive sensing technology, the fingerprint sensor 102 is configured to comprise a large plurality of sensing elements, preferably arranged as a two-dimensional array. The two-dimensional array may have sizes depending on the planned implementation and in an embodiment 160x160 pixels are used. Other sizes are of course possible and within the scope of the present disclosure, including two-dimensional array with less pixels as compared to the above example. A single sensing element (also denoted as a pixel) is in Fig. 2 indicated by reference numeral 202.

[0062] Turning now to Figs. 3 provided in in conjunction with Figs. 4A - 4D, there is conceptually illustrated a scheme according to the present disclosure for managing fingerprint data at an electronic device, such as at one of the above presented smart card 100, mobile phone 100’ and switch 100”.

[0063] The process as defined by the method according to the present disclosure may in some embodiments start with a scenario where no user has previously been enrolled with the electronic device. The process is however likewise applicable to a process where one or a plurality of finger already have been enrolled with the electronic device, and one or further fingers are to be “added” to the composite fingerprint template provided in conjunction with the electronic device. The process here starts with acquiring, SI, using the fingerprint sensor 102, multiple fingerprint representations from different fingers of one or multiple users. As such, in line with the present disclosure the scheme is likewise applicable to a situation where the electronic device is to be use for a single user but with multiple different fingers, or for a situation where the electronic device is user with multiple users, where each of the multiple users may enroll one or a plurality of different fingers.

[0064] The processing circuitry 104 proceeds to extract, S2, fingerprint features from each fingerprint representation, forming multiple sets of fingerprint features. The steps of acquiring and extracting may take place over an extended duration. For example, the steps of acquiring and extracting may be performed a large plurality of times for collecting enough fingerprint data for the multiple fingers to be successfully enrolled.

[0065] Once the fingerprint features have been collected, they are consolidated, S3 into a single composite fingerprint template 400 as is exemplified in Fig. 4A. Specifically, in Fig. 4A there is presented a large number of data points exemplifying different fingerprint features relating to different fingers.

[0066] The processing circuitry 104 will then provide, S4, a separation mechanism within the composite fingerprint template 400, where the separation mechanism is adapted to distinguish between fingerprint features of different fingers. Specifically, the separation mechanism is specifically designed to form separated clusters 402, 404, 406 as presented in Fig. 4B. The three separated clusters 402, 404, 406 correspond to fingerprint features for three separate fingers (or possibly three separate clusters of the same finger) comprised with the composite fingerprint template 400.

[0067] As discussed above, the scheme according to the present disclosure preferably comprises a methodology for dynamically managing a storage space holding the composite fingerprint template by selectively retaining or discarding fingerprint features based on usage frequency and available storage capacity. Accordingly and with further reference to Figs. 4C and 4D there is exemplified how the composite fingerprint template 400 may be progressing over time.

[0068] As is illustrated in Fig. 4C, a further fourth cluster 408 has been formed within the composite fingerprint template 400, the fourth finger being different from the previously stored three fingers 402, 404, 406.

[0069] However, over time, and with further reference to Fig. 4C, one of the fingers 404 has been identified, by the processing circuitry 104, to have been used for a prolonged period, such as for a period extending a predefined duration. As an example, in case the scheme according to the present disclosure is used in relation to a switch 100”’ and the switch 100’” is comprised with a coffee machine, then the reason for the finger 404 not being used anymore could be due to the fact that the person relating to the finger 404 has stopped using the coffee maker for some reason.

[0070] Accordingly, with further reference to Fig. 4D there is presented a situation where the data relating to the finger 404 has “faded away” from the composite fingerprint template 400, such that only the data relating to the fingers 402, 406 and 408 remain with the composite fingerprint template 400.

[0071] It should be highlighted that in some embodiments of the present disclosure, it may be possible to allow the electronic device 100, 100’, 100” to be operated in two separate states: a learning state and a locked state. When the electronic device 100, 100’, 100” is in the learning state, it is configured to accept new fingerprint data from any finger, provided there is sufficient memory available. Such a phase is specifically useful during the initial setup or when adding new users to the system, as it allows the device to build a comprehensive and diverse biometric database.

[0072] In contrast, when the electronic device 100, 100’, 100” is in the locked state, it ceases to accept new fingerprint data, thereby preventing the addition of new users or fingers. In this state, the electronic device 100, 100’, 100” focuses on utilizing the existing fingerprint data for regular authentication processes. The locked state is particularly useful in scenarios where security is of great importance, such as in controlled access environments or for personal devices requiring in comparison strong user verification. Such a state further ensures that the fingerprint system remains exclusive to the initially enrolled users.

[0073] For instance, consider a smart home 100” switch designed to recognize the fingerprints of family members. During the learning phase, the switch 100” can enroll fingerprints of all family members, adapting to recognize each one. Once the learning phase is complete, the switch 100” can be set to the locked state, ensuring that only the enrolled family members can operate it. This feature is not only a measure of convenience but also an added layer of security, preventing unauthorized access or use of the switch 100”.

[0074] Further to the above, it should be understood that some clusters, such as any of the clusters 402, 404, 406 and 408 potentially could be consolidated to form one cluster in a situation where further fingerprint data is provided. As an example, further fingerprint data could be provided that forms a direct connection between cluster 402 and 404, such that these to clusters unite to one single cluster. Accordingly, in such a situation the different clusters 402 and 404 could potentially have previously been related to different portions of a single finger, and once the further fingerprint data is provided the processing circuitry decides that these two clusters should be joined together.

[0075] The control functionality of the present disclosure may be implemented using existing computer processors, or by a special purpose computer processor for an appropriate system, incorporated for this or another purpose, or by a hardwire system. Embodiments within the scope of the present disclosure include program products comprising machine- readable medium for carrying or having machine-executable instructions or data structures stored thereon. Such machine-readable media can be any available media that can be accessed by a general purpose or special purpose computer or other machine with a processor. By way of example, such machine-readable media can comprise RAM, ROM, EPROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code in the form of machine-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer or other machine with a processor. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a machine, the machine properly views the connection as a machine-readable medium. Thus, any such connection is properly termed a machine-readable medium. Combinations of the above are also included within the scope of machine-readable media. Machine-executable instructions include, for example, instructions and data which cause a general-purpose computer, special purpose computer, or special purpose processing machines to perform a certain function or group of functions.

[0076] Although the figures may show a sequence the order of the steps may differ from what is depicted. Also, two or more steps may be performed concurrently or with partial concurrence. Such variation will depend on the software and hardware systems chosen and on designer choice. All such variations are within the scope of the disclosure. Likewise, software implementations could be accomplished with standard programming techniques with rule-based logic and other logic to accomplish the various connection steps, processing steps, comparison steps and decision steps. Additionally, even though the present disclosure has been described with reference to specific exemplifying embodiments thereof, many different alterations, modifications and the like will become apparent for those skilled in the art.

[0077] In addition, variations to the disclosed embodiments can be understood and effected by the skilled addressee in practicing the claimed present disclosure, from a study of the drawings, the disclosure, and the appended claims. Furthermore, in the claims, the word ’’comprising” does not exclude other elements or steps, and the indefinite article ”a” or ”an” does not exclude a plurality.

Claims

CLAIMS1. A method for managing fingerprint data at an electronic device, the electronic device comprising:- a fingerprint sensor configured for capturing a fingerprint representation of a finger of a user, and- processing circuitry connected to and configured to control the operation of the fingerprint sensor, wherein the method comprising the steps of:- acquiring, using the fingerprint sensor, multiple fingerprint representations from different fingers of one or multiple users,- extracting, using the processing circuitry, fingerprint features from each fingerprint representation, forming multiple sets of fingerprint features,- consolidating, using the processing circuitry, the multiple sets of fingerprint features into a single composite fingerprint template, and- providing, by the processing circuitry, a separation mechanism within the composite fingerprint template adapted to distinguish between fingerprint features of different fingers, wherein the separation mechanism includes forming separated clusters corresponding to each finger’s fingerprint features within the composite fingerprint template.

2. The method according to claim 1, wherein the method further comprising the steps of:- determining, using the processing circuitry, a similarity level between each set of extracted fingerprint features and corresponding information within the composite fingerprint template, and- selectively updating, using the processing circuitry, the composite fingerprint template with new fingerprint features based on the determined similarity levels.

3. The method according to any one of claims 1 and 2, wherein the method further comprises the step of:- dynamically managing, using the processing circuitry, a storage space for the composite fingerprint template by selectively retaining or discarding fingerprint features based on usage frequency and available storage capacity.

4. The method according to claim 3, wherein dynamically managing the storage comprises the step of:- protecting, using the processing circuitry, core clusters within the composite template to ensure the integrity of each enrolled cluster.

5. The method according to any one of the preceding claims, wherein the forming the clusters within the composite template includes the creation of distinct subtemplates during the enrollment phase, and each sub-template being arranged to uniquely correspond to different fingers of the one or multiple users.

6. The method according to any one of the preceding claims, wherein the method further comprises the step of:- assessing, using the processing circuitry, the similarity level between newly acquired fingerprint representations and the existing clusters in the composite template to determine the need for updating the template.

7. The method according to any one of the preceding claims, wherein the separation mechanism includes analyzing geometric and spatial characteristics of the extracted fingerprint features to form the distinct clusters.

8. The method according to any one of the preceding claims, wherein the separation mechanism further comprises an algorithm for dynamically updating the distinct clusters based on subsequent fingerprint acquisitions, wherein the updates include adding new fingerprint features to the respective clusters or modifying existing features within the clusters.

9. The method according to any one of the preceding claims, wherein the separation mechanism employs a pattern recognition process to distinguish between overlapping and non-overlapping fingerprint features across different clusters.

10. The method according to any one of the preceding claims, wherein the separation mechanism utilizes a prioritization protocol within the composite fingerprint template, which assigns higher priority to frequently used fingerprint features and clusters.

11. An electronic device adapted to manage fingerprint data, the electronic device comprising:- a fingerprint sensor configured for capturing a fingerprint representation of a finger of a user, and- processing circuitry connected to and configured to control the operation of the fingerprint sensor, wherein the processing circuitry is adapted to:- acquire, using the fingerprint sensor, multiple fingerprint representations from different fingers of one or multiple users,- extract fingerprint features from each fingerprint representation, forming multiple sets of fingerprint features,- consolidate the multiple sets of fingerprint features into a single composite fingerprint template, and- provide a separation mechanism within the composite fingerprint template adapted to distinguish between fingerprint features of different fingers, wherein the separation mechanism includes forming separated clusters corresponding to each finger’s fingerprint features within the composite fingerprint template.

12. The electronic device according to claim 11, wherein the processing circuitry is further adapted to:- determine a similarity level between each set of extracted fingerprint features and corresponding information within the composite fingerprint template, and- selectively update the composite fingerprint template with new fingerprint features based on the similarity levels and usage frequency of the respective fingers.

13. The electronic device according to any one of claims 11 and 12, wherein the processing circuitry is further adapted to:- dynamically manage a storage space for the composite fingerprint template by selectively retaining or discarding fingerprint features based on usage frequency and available storage capacity.

14. The electronic device according to any one of claims 11 - 13, wherein the electronic device is at least one of a smart card, a mobile phone, and a fingerprint module.

15. A computer program product comprising a non-transitory computer readable medium having stored thereon computer program means for operating electronic device adapted to manage fingerprint data, the electronic device comprising:- a fingerprint sensor configured for capturing a fingerprint representation of a finger of a user, and- processing circuitry connected to and configured to control the operation of the fingerprint sensor, wherein the computer program product comprises:- code for acquiring, using the fingerprint sensor, multiple fingerprint representations from different fingers of one or multiple users,- code for extracting, using the processing circuitry, fingerprint features from each fingerprint representation, forming multiple sets of fingerprint features,- code for consolidating, using the processing circuitry, the multiple sets of fingerprint features into a single composite fingerprint template, and - code for providing, by the processing circuitry, a separation mechanism within the composite fingerprint template adapted to distinguish between fingerprint features of different fingers, wherein the separation mechanism includes forming separated clusters corresponding to each finger’s fingerprint features within the composite fingerprint template.

Images