A method of monitoring an optically readable security element

Abstract

An image capturing device 10 reads an optically readable security element 20, extracts an identity from the optically readable security element, determines context information related to the reading using a context determining unit, and transmits a signal based on the identity and the context information. A data store stores the context information for the optically readable security element in association with the identity. The image capturing device may be controlled in response to the signal, which may comprise controlling a display of the device. The context information may be a time, a location of the security element, an environmental condition of the security element, a specification of the image capturing device, and / or a specification of the security element. The context information may be compared to expected context information and a confidence measure may be calculated. If the context information does not match the expected context information, the security element and / or the image capturing device may be disabled. The security element may comprise one or more emitters arranged to be read via emission radiation. The optical emitters may be excited by excitation radiation emitted from the image capturing device.

Description

TECHNICAL FIELD The present disclosure relates to a method of monitoring an optically readable security 5 element using an image capturing device, an image capturing device for monitoring an optically readable security element and a related system. BACKGROUND Security elements or tags are used to provide security in relation to an object to which they are attached. These security elements provide security in relation to the object by 10 labelling the object. For example, a security element may be encoded with a unique identity that can be extracted from the security element, thereby enabling authentication of the object. However, extracting the identity from the security element typically fails to consider any other factors that may influence the reliability of the identity extracted. Further, simply 15 extracting the identity leaves users without any indication of how to interpret the result of reading the security element or how even to best use the security element in the first place. Hence, there is a desire to provide a method of monitoring an optically readable security element that facilitates improved use of the optically readable security element. 20 SUMMARY It is one aim of the present disclosure, amongst others, to provide a method of monitoring an optically readable security element which at least partially obviates or mitigates at least some of the disadvantages of the prior art, whether identified herein or elsewhere, or to provide an alternative approach. For instance, it is an aim of 25 embodiments of the invention to provide a method of monitoring an optically readable security element that facilitates improved use of the optically readable security element. According to the present invention there is provided to a method of monitoring an optically readable security element using an image capturing device, an image capturing device for monitoring an optically readable security element and a related 30 system, as set forth in the appended claims. Other features of the invention will be apparent from the dependent claims and the description that follows. 24 06 25 According to a first aspect, there is provided a method of monitoring an optically readable security element using an image capturing device. The method comprises reading the optically readable security element, extracting an identity from the optically readable security element, determining context information related to the reading of the 5 optically readable security element and transmitting a signal based on the identity and the context information. The method may further comprise controlling the image capturing device in response to the signal. Controlling the image capturing device may comprise controlling a display of the image 10 capturing device. The method may further comprise comparing the context information to expected context information and determining whether the context information matches the expected context information. Determining whether the context information matches the expected context information 15 may comprise calculating a confidence measure. If the context information does not match the expected context information, the method may further comprise disabling at least one of the optically readable security element and the image capturing device. The method comprises retrieving historical context information from a data store and 20 modifying the context information based on the historical context information. The method may further comprise predicting future context information based on the context information and modifying the context information based on the predicted context information. The determining may be performed as part of the reading. 25 The context information may be at least one of: a time, a location of the optically readable security element, an environmental condition of the optically readable security element, a specification of the image capturing device and a specification of the optically readable security element. The method may further comprise combining the identity and the context information 30 and / or associating the identity and the context information. The optically readable security element may comprise one or more optical emitters arranged to be read via emission radiation emitted from the one or more optical 24 06 25 emitters. The optically readable security element may comprise one or more optical emitters arranged to be excited by excitation radiation. The optically readable security element may comprise one or more optical emitters arranged to be excited by excitation radiation emitted from the image capturing device. 5 According to a second aspect, there is provided an image capturing device for monitoring an optically readable security element. The image capturing comprises a reader configured to read the optically readable security element, a context determination unit configured to determine a context of the optically readable security element and a processor. The processor is configured to extract an identity from the 10 optically readable security element using the reader,determine context information related to the reading of the optically readable security element using the context determination unit, retrieve historical context information from a data store, and modify the context information based on the historical context information, and transmit a signal based on the identity and the context information. 15 According to a third aspect, there is provided a system comprising an optically readable security element having an extractable identity, a data store configured to store context information for the optically readable security element in association with the identity and, an image capturing device according to the second aspect. BRIEF DESCRIPTION OF DRAWINGS 20 For a better understanding of the invention, and to show how embodiments of the same may be brought into effect, reference will be made, by way of example only, to the accompanying Figures, in which: Figure 1 shows a flowchart for a method of monitoring an optically readable security element; 25 Figure 2 shows an optically readable security element being read by an image capturing device; Figure 3 shows an image capturing device; and Figure 4 shows a system comprising an image capturing device, an optically readable security element and a data store. 30 DETAILED DESCRIPTION Figure 1 shows a flowchart for a method of monitoring an optically readable security element. The method of Figure 1 is best understood in conjunction with Figure 2, which 24 06 25 shows an image capturing device 10 reading an optically readable security element 20 in a field of view 30 (e.g., in a same image frame) of the image capturing device 10. The method comprises reading S1 (e.g., scanning) the optically readable security element 20, extracting S2 an identity from the optically readable security element 20, 5 determining S3 context information related to the reading S1 of the optically readable security element 20 and transmitting S4 a signal based on the identity and the context information. By transmitting a signal based on identity and context information, advantageously, authentication of the optically readable security element 20 is enabled in combination 10 with provision of further information, for example, relating to the accuracy of the reading S1 and / or the extracting S2, thereby facilitating effective use of the optically readable security element 20 and / or the image capturing device 10, as detailed below. Such a method that utilises the identity and the context information is generally richer and provides enhanced functionality. 15 The context information may be information that is external to both the optically readable security element 20 and the image capturing device 10 (e.g., environmental information), information that is specific to the optically readable security element 20, information that is specific to the image capturing device 10 or some combination thereof. Each type of context information has different, generally complementary, uses, 20 as explained below. The context information may comprise a time (e.g., a date of production or distribution of the optically readable security element 20). Advantageously, the time may be used to cause transmission of an installation, usage, care / maintenance or disposal recommendation. For example, if the determined time is indicative of pre-deployment 25 of the optically readable security element 20, the recommendation may comprise installation instructions. In a second example, if the determined time is indicative of normal use of the optically readable security element 20, the recommendation may comprise maintenance instructions. In a third example, if the time is indicative of the optically readable security element 20 being past its normal lifespan, the 30 recommendation may comprise return and / or recycling information. The time may, additionally, be useful in terms of determining usage patterns. The time information may be used to manage use of the device and / or the identity (e.g., allowing, limiting or preventing use at certain times), which may be useful for time-sensitive applications. 24 06 25 The context information may comprise a location of the optically readable security element 20 and / or the image capturing device 10, such as GPS coordinates. Advantageously, the location of the optically readable security element 20 and / or the image capturing device 10 may be used to cause transmission of location specific 5 information (e.g., post use of the optically readable security element 20 and / or image capturing device, such location information may be used to cause transmission of return and / or recycling information, such as the nearest return and / or recycling centre). The location information may, additionally, be useful in terms of determining usage patterns, as described for the time. 10 The context information may comprise an environmental condition of the optically readable security element 20, such as one or more of temperature, lighting conditions, humidity, pressure and acceleration. Advantageously, the environmental condition including light conditions may cause transmission of information relating to the reliability of the reading S1 and / or the extracting S2. For example, poor (e.g., dark) lighting 15 conditions or extreme temperatures may be indicative of unreliable reading S1 and / or extracting S2. In another example, a level of acceleration above a threshold acceleration may be indicative of unreliable reading S1 and / or extracting S2, because the level of acceleration may imply that the movement (e.g., scanning motion) of the image capturing device 10 is too quick for reliable reading S1 and / or extracting S2. 20 The context information may comprise a specification of the optically readable security element 20 and / or a specification of the image capturing device 10. For example, advantageously, the context information may comprise information relating to a condition of the optically readable security element 20 (e.g., an age of the optically readable security element 20), which may be indicative of the reliability of the reading 25 S1 and / or the extracting S2 (i.e., an older optically readable security element 20 may have deteriorated in condition). In another example, the context information may comprise one or more of delivery, customs, compliance, installation or customer support information, thereby, advantageously, facilitating effective and safe deployment and use of the optically readable security element 20 and / or the image capturing device 10. 30 The determining S3 may be performed as part of the reading S1 or as a separate step. The determining S3 is typically performed by a context determination unit of the image capturing device 10. The context determination unit may comprise any components or software that is able to determine (e.g., sense, obtain or retrieve) the context. For example, a sensor may be any combination of a clock, a GPS tracker, a thermometer, 35 a photodetector, a gyroscope or similar. The context determination unit may determine 24 06 25 context information by retrieving data from outside of (external to) the image capturing device 10, for example, via a server. The method may comprise controlling the image capturing device 10 in response to the signal. For example, the signal may be sent to display of the image capturing device 10 5 to control the display to display the context information. The signal may be sent to the display via a server in electronic communication with the image capturing device 10. Alternatively, the method may comprise controlling an external device (e.g., a smart phone) in response to the signal. Advantageously, because the signal is based on the identity, the display may only controlled if the optically readable security element is 10 authentic. In other words, controlling the image capturing device 10 in response to the signal, preferably, comprises verifying the authenticity of the optically readable security element 20 based on the identity. If the optically readable security element 20 is not authentic, the verifying may comprise transmitting an alert signal. The method may comprise comparing the context information to expected context 15 information and determining whether the context information matches the expected context information. For instance, the method may comprise retrieving from a data store expected context information and comparing the context information with the expected context information. Typically, the expected context information is stored in the data store in association with the identity to enable retrieval of expected context information 20 specific to a given optically readable security element(s) 20. The data store may be part of the image capturing device 10, part of the optically readable security element 20 (e.g., included in an engineered component - see below description of the structure of the optically readable security element 20) or an external data store. Advantageously, use of an external data store engenders a compact image capturing device 10. 25 Determining whether the context information matches the expected context information may comprise calculating a confidence measure. For example, the context information may only be determined to match the expected context information if the degree of similarity between the two is above a threshold percentage (e.g., 90%). Advantageously, in this way a disruptive number of false negatives are avoided while 30 ensuring a high degree of accuracy. If the context information does not match the expected context information, the method may further comprise disabling at least one of the optically readable security element 20 and the image capturing device 10. For example, in the case of the context information being a location, if it is determined by the context determination unit that the 24 06 25 location of the optically readable security element 20 is Spain, but the expected location of the optically readable security element 20 is the United Kingdom, the optically readable security element 20 and / or the image capturing device 10 may be disabled. Advantageously, in this way, nefarious activity is mitigated against, because the 5 optically readable security element 20 most be verified as authentic and the context information must be as expected. The method comprises retrieving historical context information from the data store and modifying the context information based on the historical context information. The historical context information is data of previously determined context information. For 10 instance, in the case of the context information comprising temperature, the historical context information may comprise one or more of determined temperatures experienced by the optically readable security element 20. Consequently, and advantageously, the (current) context information may be modified to reflect the historical temperatures experienced by the optically readable security element, thereby 15 meaning that the information in the signal transmitted more accurately reflects the reliability of the reading S1 and / or the extracting S2. Relatedly, the method may comprise predicting future context information based on the context information and modifying the context information based on the predicted context information. For instance, in the case of the context information comprising a 20 location, a future location of the optically readable security element 20 may be predicted based on the current determined location of the optically readable security element 20. Predicting the future location, preferably, includes considering data points for current and historical context information (e.g., by computing Hamming distances between measurements) and applying a fit to the data points. Advantageously, in this way, the 25 optically readable security element 20 may be tracked. In the above examples of the method comprising retrieving historical context information and predicting future context information, as is implicit from the explanation above, the context information (current, historical or predicted) typically comprises time information. In the same above examples, the context information, may also comprise 30 the specification of the optically readable security element 20 and / or a specification of the image capturing device 10, and the modifying step may comprise modifying the specification of the optically readable security element 20 and / or a specification of the image capturing device 10. For example, delivery, customs, compliance, installation or customer support information may be modified based on the predicted location. 24 06 25 The method may further comprise combining the identity and the context information, which, advantageously, engenders computational efficiency. The method may comprise forming an association (e.g., mapping or linking) between the identity and the context information for contemporaneous or future use as described 5 above, for example, in relation to retrieving expected context information. A previously formed association may be updated. The optically readable security element 20 may comprise a hologram, bar code, QR code (RTM) or similar, encoding an identity labelling an object to which the optically readable security element is attached. In the case of the optically readable security 10 element 20 comprising a hologram, bar code, QR code (RTM) or similar, such engineered components may be programmable, encoded with, or generally comprise information. For example, the engineered components may, in some examples, comprise the (e.g., expected) context information. Preferably, the optically readable security element 20 comprises a unique (e.g., 15 randomised) component (e.g., a random deterministic feature), encoding the identity. The randomised component encoding the identity, compared with the engineered component encoding the identity, advantageously engenders a more robust barrier to fraudulent reading of the optically readable security element 20. Indeed, the unique nature of the identity gives even more power and utility to the identity-context 20 information combination, because the specific optically readable security element 20 (and any object to which that is attached) can be monitored in a variety of different ways, depending on the context information. More preferably, the optically readable security element 20 comprises at least one optical emitter arranged to be read via emission radiation emitted therefrom. Relatedly, 25 the at least one optical emitter may be arranged to be excited by excitation radiation. The one or more emitters may serve as the component that provides or serves as the unique identity. Advantageously, the optically readable security element 20 being read via emission emitted therefrom provides a more robust barrier to fraudulent reading, more readily preventing spoofing or copying by, for instance, simply replicating (e.g., by 30 printing) a bar code, QR code (RTM) or similar. This advantage is particularly true when one or more (e.g., hundreds, thousands or millions or more) of emitters are distributed randomly. For instance, this effect may be achieved using quantum dots, flakes of 2D materials, (e.g., small) molecules, atomic defects or vacancies, plasmonic structures or similar. 24 06 25 The image capturing device 10 may be a terminal device, such as a smartphone. The image capturing device 10 may be configured to emit excitation radiation to excite the at least one optical emitter (e.g., from an electromagnetic radiation source, such as a flash or LED). By being configured to emit excitation radiation, the image capturing 5 device 10, advantageously, facilitates the aforementioned robust security. Further, emitting the excitation radiation from the image capturing device 10, advantageously, allows convenient control of excitation of the at least one optical emitter. Figure 3 shows the image capturing device 10 of Figure 2 in more detail. The reading S1 of the optically readable security element 20 is performed by a reader 11. The reader 10 11 and / or processor 12 may include or serve as the context determination unit, as discussed above. In another example, a dedicated context determination unit (e.g., sensor) may be provided. The extracting S2, determining S3 and transmitting S4 are performed by a processor 12. The processor 12 may be configured to extract the identity, determine the context information and transmit the signal locally (i.e., at the 15 image capturing device 10) or externally (e.g., at a server). The processor 12 may be dedicated hardware or existing hardware specifically configured to extract the identity, determine the context information and transmit the signal. The image capturing device 10 may include a communication unit (not shown) to communicate with, for example, a server. As mentioned, the image capturing device may comprise a display (not shown). 20 Figure 4 shows a system comprising the image capturing device 10, the optically readable security element 20 and the data store 40, as respectively described above. In Figure 4, the data store 40 is shown as an external device. However, as mentioned, alternatively, the data store 40 may be part of the image capturing device 10. In summary, the present disclosure has described a method of monitoring an optically 25 readable security element that facilitates improved (e.g., more effective and safer) use of the optically readable security element. Although preferred embodiments have been shown and described, it will be appreciated by those skilled in the art that various changes and modifications might be made without departing from the scope of the invention, as defined in the appended claims and as 30 described above. The optional features set out herein may be used either individually or in combination with each other where appropriate and particularly in the combinations as set out in the accompanying claims. The optional features for each aspect or exemplary embodiment of the invention, as set out herein are also applicable to all other aspects or exemplary embodiments of the invention, where appropriate. In other words, the skilled person reading this specification should consider the optional features for each aspect or exemplary embodiment of the invention as interchangeable and combinable between different aspects and exemplary embodiments. 24 06 25 24 06 25

Claims

1. A method of monitoring an optically readable security element using an image capturing device, the method comprising, by the image capturing device:5 reading the optically readable security element;extracting an identity from the optically readable security element;determining context information related to the reading of the optically readable security element;retrieving historical context information from a data store;10 modifying the context information based on the historical context information;andtransmitting a signal based on the identity and the modified context information.

2. The method of claim 1, further comprising:15 controlling the image capturing device in response to the signal.

3. The method of claim 2, wherein controlling the image capturing device comprises controlling a display of the image capturing device.20 4. The method of any preceding claim, further comprising:comparing the context information to expected context information; anddetermining whether the context information matches the expected context information.25 5. The method of claim 4, wherein determining whether the context information matchesthe expected context information comprises calculating a confidence measure.

6. The method of any preceding claim, further comprising:predicting future context information based on the context information; and24 06 25modifying the context information based on the predicted context information.

7. The method of any preceding claim, wherein the determining is performed as part of the reading.

58. The method of any preceding claim, wherein the context information is at least one of: a time, a location of the optically readable security element, an environmental condition of the optically readable security element, a specification of the image capturing device and a specification of the optically readable security element.

109. The method of any preceding claim, further comprising:combining the identity and the context information; and / orassociating the identity and the context information.15 10. The method of any preceding claim, wherein the optically readable security elementcomprises one or more optical emitters arranged to be read via emission radiation emitted from the one or more optical emitters, optionally wherein the optically readable security element comprises one or more optical emitters arranged to be excited by excitation radiation.2011. The method of any preceding claim, wherein the optically readable security element comprises one or more optical emitters arranged to be excited by excitation radiation emitted from the image capturing device.25 12. An image capturing device for monitoring an optically readable security element,the image capturing comprising:a reader configured to read the optically readable security element;a context determination unit configured to determine a context of the optically readable security element; and30 a processor configured to:24 06 25extract an identity from the optically readable security element using the reader;determine context information related to the reading of the optically readable security element using the context determination unit, retrieve historical 5 context information from a data store, and modify the context information based on the historical context information;andtransmit a signal based on the identity and the modified context information.10 13. A system comprising:an optically readable security element having an extractable identity;a data store configured to store context information for the optically readable security element in association with the identity; andthe image capturing device of claim 12.

Images