A method of monitoring an optically readable security element

Abstract

There is described a method of monitoring an optically readable security element (20) using an image capturing device (10). The method comprises reading S1 the optically readable security element (20), extracting S2 an identity from the optically readable security element (20), determining S3 context information related to the reading S1 of the optically readable security element (20) and transmitting S4 a signal based on the identity and the context information.

Description

[0001] A METHOD OF MONITORING AN OPTICALLY READABLE SECURITY ELEMENT

[0002] TECHNICAL FIELD

[0003] The present disclosure relates to a method of monitoring an optically readable security element using an image capturing device, an image capturing device for monitoring an optically readable security element and a related system.

[0004] BACKGROUND

[0005] Security elements or tags are used to provide security in relation to an object to which they are attached. These security elements provide security in relation to the object by labelling the object. For example, a security element may be encoded with a unique identity that can be extracted from the security element, thereby enabling authentication of the object.

[0006] However, extracting the identity from the security element typically fails to consider any other factors that may influence the reliability of the identity extracted. Further, simply extracting the identity leaves users without any indication of how to interpret the result of reading the security element or how even to best use the security element in the first place.

[0007] Hence, there is a desire to provide a method of monitoring an optically readable security element that facilitates improved use of the optically readable security element.

[0008] SUMMARY

[0009] It is one aim of the present disclosure, amongst others, to provide a method of monitoring an optically readable security element which at least partially obviates or mitigates at least some of the disadvantages of the prior art, whether identified herein or elsewhere, or to provide an alternative approach. For instance, it is an aim of embodiments of the invention to provide a method of monitoring an optically readable security element that facilitates improved use of the optically readable security element.

[0010] According to the present invention there is provided to a method of monitoring an optically readable security element using an image capturing device, an image capturing device for monitoring an optically readable security element and a related system, as set forth in the appended claims. Other features of the invention will be apparent from the dependent claims and the description that follows. According to a first aspect, there is provided a method of monitoring an optically readable security element using an image capturing device. The method comprises reading the optically readable security element, extracting an identity from the optically readable security element, determining context information related to the reading of the optically readable security element and transmitting a signal based on the identity and the context information.

[0011] The method may further comprise controlling the image capturing device in response to the signal.

[0012] Controlling the image capturing device may comprise controlling a display of the image capturing device.

[0013] The method may further comprise comparing the context information to expected context information and determining whether the context information matches the expected context information.

[0014] Determining whether the context information matches the expected context information may comprise calculating a confidence measure.

[0015] If the context information does not match the expected context information, the method may further comprise disabling at least one of the optically readable security element and the image capturing device.

[0016] The method may further comprise retrieving historical context information from a data store and modifying the context information based on the historical context information.

[0017] The method may further comprise predicting future context information based on the context information and modifying the context information based on the predicted context information.

[0018] The determining may be performed as part of the reading.

[0019] The context information may be at least one of: a time, a location of the optically readable security element, an environmental condition of the optically readable security element, a specification of the image capturing device and a specification of the optically readable security element.

[0020] The method may further comprise combining the identity and the context information and / or associating the identity and the context information.

[0021] The optically readable security element may comprise one or more optical emitters arranged to be read via emission radiation emitted from the one or more optical emitters. The optically readable security element may comprise one or more optical emitters arranged to be excited by excitation radiation.

[0022] The optically readable security element may comprise one or more optical emitters arranged to be excited by excitation radiation emitted from the image capturing device.

[0023] According to a second aspect, there is provided an image capturing device for monitoring an optically readable security element. The image capturing comprises a reader configured to read the optically readable security element, a context determination unit configured to determine a context of the optically readable security element and a processor. The processor is configured to extract an identity from the optically readable security element using the reader, determine context information related to the reading of the optically readable security element using the context determination unit and transmit a signal based on the identity and the context information.

[0024] According to a third aspect, there is provided a system comprising an optically readable security element having an extractable identity, a data store configured to store context information for the optically readable security element in association with the identity and, optionally, an image capturing device for reading the optically readable security element.

[0025] BRIEF DESCRIPTION OF DRAWINGS

[0026] For a better understanding of the invention, and to show how embodiments of the same may be brought into effect, reference will be made, by way of example only, to the accompanying Figures, in which:

[0027] Figure 1 shows a flowchart for a method of monitoring an optically readable security element;

[0028] Figure 2 shows an optically readable security element being read by an image capturing device;

[0029] Figure 3 shows an image capturing device; and

[0030] Figure 4 shows a system comprising an image capturing device, an optically readable security element and a data store.

[0031] DETAILED DESCRIPTION

[0032] Figure 1 shows a flowchart for a method of monitoring an optically readable security element. The method of Figure 1 is best understood in conjunction with Figure 2, which shows an image capturing device 10 reading an optically readable security element 20 in a field of view 30 (e.g., in a same image frame) of the image capturing device 10.

[0033] The method comprises reading S1 (e.g., scanning) the optically readable security element 20, extracting S2 an identity from the optically readable security element 20, determining S3 context information related to the reading S1 of the optically readable security element 20 and transmitting S4 a signal based on the identity and the context information.

[0034] By transmitting a signal based on identity and context information, advantageously, authentication of the optically readable security element 20 is enabled in combination with provision of further information, for example, relating to the accuracy of the reading S1 and / or the extracting S2, thereby facilitating effective use of the optically readable security element 20 and / or the image capturing device 10, as detailed below. Such a method that utilises the identity and the context information is generally richer and provides enhanced functionality.

[0035] The context information may be information that is external to both the optically readable security element 20 and the image capturing device 10 (e.g., environmental information), information that is specific to the optically readable security element 20, information that is specific to the image capturing device 10 or some combination thereof. Each type of context information has different, generally complementary, uses, as explained below.

[0036] The context information may comprise a time (e.g., a date of production or distribution of the optically readable security element 20). Advantageously, the time may be used to cause transmission of an installation, usage, care / maintenance or disposal recommendation. For example, if the determined time is indicative of pre-deployment of the optically readable security element 20, the recommendation may comprise installation instructions. In a second example, if the determined time is indicative of normal use of the optically readable security element 20, the recommendation may comprise maintenance instructions. In a third example, if the time is indicative of the optically readable security element 20 being past its normal lifespan, the recommendation may comprise return and / or recycling information. The time may, additionally, be useful in terms of determining usage patterns. The time information may be used to manage use of the device and / or the identity (e.g., allowing, limiting or preventing use at certain times), which may be useful for time-sensitive applications. The context information may comprise a location of the optically readable security element 20 and / or the image capturing device 10, such as GPS coordinates. Advantageously, the location of the optically readable security element 20 and / or the image capturing device 10 may be used to cause transmission of location specific information (e.g., post use of the optically readable security element 20 and / or image capturing device, such location information may be used to cause transmission of return and / or recycling information, such as the nearest return and / or recycling centre). The location information may, additionally, be useful in terms of determining usage patterns, as described for the time.

[0037] The context information may comprise an environmental condition of the optically readable security element 20, such as one or more of temperature, lighting conditions, humidity, pressure and acceleration. Advantageously, the environmental condition including light conditions may cause transmission of information relating to the reliability of the reading S1 and / or the extracting S2. For example, poor (e.g., dark) lighting conditions or extreme temperatures may be indicative of unreliable reading S1 and / or extracting S2. In another example, a level of acceleration above a threshold acceleration may be indicative of unreliable reading S1 and / or extracting S2, because the level of acceleration may imply that the movement (e.g., scanning motion) of the image capturing device 10 is too quick for reliable reading S1 and / or extracting S2.

[0038] The context information may comprise a specification of the optically readable security element 20 and / or a specification of the image capturing device 10. For example, advantageously, the context information may comprise information relating to a condition of the optically readable security element 20 (e.g., an age of the optically readable security element 20), which may be indicative of the reliability of the reading S1 and / or the extracting S2 (i.e., an older optically readable security element 20 may have deteriorated in condition). In another example, the context information may comprise one or more of delivery, customs, compliance, installation or customer support information, thereby, advantageously, facilitating effective and safe deployment and use of the optically readable security element 20 and / or the image capturing device 10.

[0039] The determining S3 may be performed as part of the reading S1 or as a separate step. The determining S3 is typically performed by a context determination unit of the image capturing device 10. The context determination unit may comprise any components or software that is able to determine (e.g., sense, obtain or retrieve) the context. For example, a sensor may be any combination of a clock, a GPS tracker, a thermometer, a photodetector, a gyroscope or similar. The context determination unit may determine context information by retrieving data from outside of (external to) the image capturing device 10, for example, via a server.

[0040] The method may comprise controlling the image capturing device 10 in response to the signal. For example, the signal may be sent to display of the image capturing device 10 to control the display to display the context information. The signal may be sent to the display via a server in electronic communication with the image capturing device 10. Alternatively, the method may comprise controlling an external device (e.g., a smart phone) in response to the signal. Advantageously, because the signal is based on the identity, the display may only controlled if the optically readable security element is authentic. In other words, controlling the image capturing device 10 in response to the signal, preferably, comprises verifying the authenticity of the optically readable security element 20 based on the identity. If the optically readable security element 20 is not authentic, the verifying may comprise transmitting an alert signal.

[0041] The method may comprise comparing the context information to expected context information and determining whether the context information matches the expected context information. For instance, the method may comprise retrieving from a data store expected context information and comparing the context information with the expected context information. Typically, the expected context information is stored in the data store in association with the identity to enable retrieval of expected context information specific to a given optically readable security element(s) 20. The data store may be part of the image capturing device 10, part of the optically readable security element 20 (e.g., included in an engineered component - see below description of the structure of the optically readable security element 20) or an external data store. Advantageously, use of an external data store engenders a compact image capturing device 10.

[0042] Determining whether the context information matches the expected context information may comprise calculating a confidence measure. For example, the context information may only be determined to match the expected context information if the degree of similarity between the two is above a threshold percentage (e.g., 90%). Advantageously, in this way a disruptive number of false negatives are avoided while ensuring a high degree of accuracy.

[0043] If the context information does not match the expected context information, the method may further comprise disabling at least one of the optically readable security element 20 and the image capturing device 10. For example, in the case of the context information being a location, if it is determined by the context determination unit that the location of the optically readable security element 20 is Spain, but the expected location of the optically readable security element 20 is the United Kingdom, the optically readable security element 20 and / or the image capturing device 10 may be disabled. Advantageously, in this way, nefarious activity is mitigated against, because the optically readable security element 20 most be verified as authentic and the context information must be as expected.

[0044] Disabling of an element or device might involve anything that prevents the element being used or read, or the device being used or used to read the element. For example, this might involve changing a flag or other indicator in a data store or the device, to indicate this change or limitation in functionality. In other words, the device or element cannot be used in the usual way, i.e. the device is unable to read an element (e.g. as an authentic element), or that element is not able to be read (e.g. as an authentic element) by the device.

[0045] The method may comprise retrieving historical context information from the data store and modifying the context information based on the historical context information. The historical context information is data of previously determined context information. For instance, in the case of the context information comprising temperature, the historical context information may comprise one or more of determined temperatures experienced by the optically readable security element 20. Consequently, and advantageously, the (current) context information may be modified to reflect the historical temperatures experienced by the optically readable security element, thereby meaning that the information in the signal transmitted more accurately reflects the reliability of the reading S1 and / or the extracting S2.

[0046] Relatedly, the method may comprise predicting future context information based on the context information and modifying the context information based on the predicted context information. For instance, in the case of the context information comprising a location, a future location of the optically readable security element 20 may be predicted based on the current determined location of the optically readable security element 20. Predicting the future location, preferably, includes considering data points for current and historical context information (e.g., by computing Hamming distances between measurements) and applying a fit to the data points. Advantageously, in this way, the optically readable security element 20 may be tracked.

[0047] More generally, use of historical context information means that the method is not simply taking into account or using inputs that are available or provided at the time the method is implemented. Use of historical context information might allow for trends to be observed or used as part of the reading, for example to see if a current reading is as expected based on that historical context - i.e. is the current reading matching that trend. Alternatively or additionally, use of historical context information might allow for trends or other extrapolations to be predicted, for example for use in future readings. Alternatively or additionally, use of historical context information might allow for corrections or updates to be used as part of the reading, for example to improve a reading based on historical context.

[0048] Generally, “modifying” the context information means that it now in some way takes into account or reflects the historical or predicted context. In other words, the (current) context information is augmented. This means that the context information that results (e.g. modified context information) is richer and more useful, because it takes into account or reflects prior or later context - i.e. it is not just taking into account or using inputs that are available or provided at the time the method is implemented. The modification could be quantitative or qualitative, depending on the implementation of the method. This might range from the modification showing that the immediate / current context is or is not as expected, through to numerical inputs and changes that help with identification, establishing or checking of prior, possible, or predicted trends, or to correct or improve a reading.

[0049] In the above examples of the method comprising retrieving historical context information and predicting future context information, as is implicit from the explanation above, the context information (current, historical or predicted) typically comprises time information. In the same above examples, the context information, may also comprise the specification of the optically readable security element 20 and / or a specification of the image capturing device 10, and the modifying step may comprise modifying the specification of the optically readable security element 20 and / or a specification of the image capturing device 10. For example, delivery, customs, compliance, installation or customer support information may be modified based on the predicted location.

[0050] It will be appreciated that historical and current context can be used in a number of different ways, in terms of applications and functionality. The following examples explain this, in and amongst other features:

[0051] Medication:

[0052] Times for prescription to be taken may be stored on a server. A reading of an optically readable security element on related medication registers when the reading was taken (i.e. current context), and the reading starts a timer for use in taking of a next dose. At the next dose, the previous reading will serve as historical context, and could be used to make sure the dose timings are accurate, or within ranges.

[0053] - Reading optically readable security elements on several medicines (i.e. which may serve as current context) may result in advice regarding compatibility (between medicines, or with or for a user) being accessible or provided. Prior readings may serve as historical context, for compatibility over time.

[0054] Regulation information displayed or accessible after a reading may be territory specific (based on GPS, IP address, which serves as current context, etc.)

[0055] - Side effect information displayed or accessible after a reading may depend on specifics of the patient (e.g. the specifics of the patient may serve as current context, whereas historical specifics may serve as historical context).

[0056] - Usage information (e.g. relating to number or timings of a reading, or reading of different medications) may be electronically sent to a medical professional for analysis of usage patterns, or efficacy (when combined with outcomes). The usage information (e.g. with related numbers of timings of readings, may serve as current and historical context). The usage information may be supplemented, e.g. possibly in combination with other health tracking data (heart rate, temperature etc). The other health tracking data may be, or input to, current or historical context information (e.g. in relation to the time of reading of the optically readable security element).

[0057] Consumables:

[0058] - A reading of an optically readable security element associated with a (e.g. food / drink) consumable may result in different recipes being shown or accessible. Historical context could be an established or pre-set manufacture date, or a use-by or best-before date. Current context could be a time, so that a freshness or safety of ingredient (eggs, fish, meat etc) can be established, for use in suitable recipes. Relatedly, a read may result in a guide based on a use-by or best-before date, for example relating to the date being shown or accessible, or a warning being provided if the date is imminent, or is in the past.

[0059] - A temperature reading (e.g. current context) from a reader of the optically readable security element, at or close to the time of reading the optically readable security element, may result in an expected or predicted lifetime of the consumable being shown or accessible, e.g. again based on historical context of the date of creation (or similar) of the consumable, and expected o predicted deterioration in different temperature environments. The expected lifetime may be updated, based on that temperature reading. A warning may be issued, if the temperature and lifetime indicates that the consumable is being stored in an unsuitable environment (e.g. temperature is too high or low). A warning may be issued if close to or past an expected lifetime.

[0060] Asset management:

[0061] - A read of the optically readable security element on equipment (i.e. a hardware or software asset) at a time of installation (e.g. current context), optionally triggered / requested based on IP / GPS site location (e.g. additional current context) may trigger a request for warranty information, which is sent to a supplier / distributor.

[0062] - A read of the optically readable security element on equipment (i.e. a hardware or software asset) at a time of installation (e.g. current context), optionally triggered / requested based on IP / GPS site location (e.g. additional current context), may allow installation instructions to be shown or accessible. The instructions may be specific to the region / territory (based on the location)

[0063] Relatedly, a read after installation may provided information relating to hardware performance (e.g. current or historical context), or last service of the hardware (historical context). An augmented reality overlay may be provided to aid maintenance of the hardware.

[0064] - Relatedly, a read after installation may provide information regarding replacement parts, or a link to spare part purchase options - Related to the consumable applications or scenarios, above, a read after installation may at that time (current context) provide information regarding whether a service is required, or a lifetime is imminent or expired, based on prior readings or information (historical context) related to use or lifetime of the asset. If a service is required, or a lifetime is imminent or expired, a read at the time may lead to information being shown or accessible that relates to service options, replacement options, disposal options, and so on.

[0065] Artwork:

[0066] - A read of the optically readable security element on or adjacent to artwork may display a warning if the optically readable security element location relative to a marker has moved (current context) more than a threshold amount (historical context).

[0067] - Environmental conditions (e.g. current context, such as light intensity, temperature, humidity) at the time of reading the optically readable security element may prompt a warning if beyond certain thresholds or expectations (historical context), or prompt a display of prior readings (historical context) for view and comparison by a user

[0068] Gaming / voucher / ticketing / stamp (tax, postal, etc):

[0069] - Any of these may be or include an optically readable security element

[0070] Depending on the nature and application, a read of a related optically readable security element may display or facilitate / prevent certain functionality, for example based on a number of times they have previously been read (historical context). For example, this might facilitate single use, multiple-use (for particular numbers of uses), or simply allow for a count to be tracked or shown.

[0071] Location (current) context may restrict access for tickets or vouchers, at the time of reading, based on previously (historical) set limitations. A current read may result in a display indicating valid / not valid, depending on if access has been granted (e.g. entry to a station or stadium may be blocked if a ticket has been used before).

[0072] Stamps may be single-use and voided once read (a combination of current and historical context). Or, relatedly, a later or subsequent read (current context) may result in a display showing that the stamp has previously been used or is ‘spent’ (historical context). The same may be true for any first reading after the stamp being sold. Prior to any actual sale (based on time context information), a reading of the stamp may result in tracking and product information for a tax inspector.

[0073] As discussed throughout, the use of context information, in combination with the identifier, allows for many different applications and use cases to be realised or improved.

[0074] The method may further comprise combining the identity and the context information, which, advantageously, engenders computational efficiency.

[0075] The method may comprise forming an association (e.g., mapping or linking) between the identity and the context information for contemporaneous or future use as described above, for example, in relation to retrieving expected context information. A previously formed association may be updated.

[0076] The optically readable security element 20 may comprise a hologram, bar code, QR code or similar, encoding an identity labelling an object to which the optically readable security element is attached. In the case of the optically readable security element 20 comprising a hologram, bar code, QR code or similar, such engineered components may be programmable, encoded with, or generally comprise information. For example, the engineered components may, in some examples, comprise the (e.g., expected) context information.

[0077] Preferably, the optically readable security element 20 comprises a unique (e.g., randomised) component (e.g., a random deterministic feature), encoding the identity. The randomised component encoding the identity, compared with the engineered component encoding the identity, advantageously engenders a more robust barrier to fraudulent reading of the optically readable security element 20. Indeed, the unique nature of the identity gives even more power and utility to the identity-context information combination, because the specific optically readable security element 20 (and any object to which that is attached) can be monitored in a variety of different ways, depending on the context information.

[0078] More preferably, the optically readable security element 20 comprises at least one optical emitter arranged to be read via emission radiation emitted therefrom. Relatedly, the at least one optical emitter may be arranged to be excited by excitation radiation. The one or more emitters may serve as the component that provides or serves as the unique identity. Advantageously, the optically readable security element 20 being read via emission emitted therefrom provides a more robust barrier to fraudulent reading, more readily preventing spoofing or copying by, for instance, simply replicating (e.g., by printing) a bar code, QR code or similar. This advantage is particularly true when one or more (e.g., hundreds, thousands or millions or more) of emitters are distributed randomly. For instance, this effect may be achieved using quantum dots, flakes of 2D materials, (e.g., small) molecules, atomic defects or vacancies, plasmonic structures or similar.

[0079] The image capturing device 10 may be a terminal device, such as a smartphone. The image capturing device 10 may be configured to emit excitation radiation to excite the at least one optical emitter (e.g., from an electromagnetic radiation source, such as a flash or LED). By being configured to emit excitation radiation, the image capturing device 10, advantageously, facilitates the aforementioned robust security. Further, emitting the excitation radiation from the image capturing device 10, advantageously, allows convenient control of excitation of the at least one optical emitter.

[0080] Figure 3 shows the image capturing device 10 of Figure 2 in more detail. The reading S1 of the optically readable security element 20 is performed by a reader 11 . The reader 11 and / or processor 12 may include or serve as the context determination unit, as discussed above. In another example, a dedicated context determination unit (e.g., sensor) may be provided. The extracting S2, determining S3 and transmitting S4 are performed by a processor 12. The processor 12 may be configured to extract the identity, determine the context information and transmit the signal locally (i.e., at the image capturing device 10) or externally (e.g., at a server). The processor 12 may be dedicated hardware or existing hardware specifically configured to extract the identity, determine the context information and transmit the signal. The image capturing device 10 may include a communication unit (not shown) to communicate with, for example, a server. As mentioned, the image capturing device may comprise a display (not shown). Figure 4 shows a system comprising the image capturing device 10, the optically readable security element 20 and the data store 40, as respectively described above. In Figure 4, the data store 40 is shown as an external device. However, as mentioned, alternatively, the data store 40 may be part of the image capturing device 10.

[0081] In summary, the present disclosure has described a method of monitoring an optically readable security element that facilitates improved (e.g., more effective and safer) use of the optically readable security element.

[0082] Although preferred embodiments have been shown and described, it will be appreciated by those skilled in the art that various changes and modifications might be made without departing from the scope of the invention, as defined in the appended claims and as described above.

[0083] The optional features set out herein may be used either individually or in combination with each other where appropriate and particularly in the combinations as set out in the accompanying claims. The optional features for each aspect or exemplary embodiment of the invention, as set out herein are also applicable to all other aspects or exemplary embodiments of the invention, where appropriate. In other words, the skilled person reading this specification should consider the optional features for each aspect or exemplary embodiment of the invention as interchangeable and combinable between different aspects and exemplary embodiments.

Claims

CLAIMS1. A method of monitoring an optically readable security element using an image capturing device, the method comprising, by the image capturing device: reading the optically readable security element; extracting an identity from the optically readable security element; determining context information related to the reading of the optically readable security element; and transmitting a signal based on the identity and the context information.

2. The method of claim 1 , further comprising: controlling the image capturing device in response to the signal.

3. The method of claim 2, wherein controlling the image capturing device comprises controlling a display of the image capturing device.

4. The method of any preceding claim, further comprising: comparing the context information to expected context information; and determining whether the context information matches the expected context information.

5. The method of claim 4, wherein determining whether the context information matches the expected context information comprises calculating a confidence measure.

6. The method of claim 4 or 5, wherein, if the context information does not match the expected context information, the method further comprises: disabling at least one of the optically readable security element and the image capturing device.

7. The method of any preceding claim, further comprising: retrieving historical context information from a data store; and modifying the context information based on the historical context information.

8. The method of any preceding claim, further comprising: predicting future context information based on the context information; and modifying the context information based on the predicted context information.

9. The method of any preceding claim, wherein the determining is performed as part of the reading.

10. The method of any preceding claim, wherein the context information is at least one of: a time, a location of the optically readable security element, an environmental condition of the optically readable security element, a specification of the image capturing device and a specification of the optically readable security element.11 . The method of any preceding claim, further comprising: combining the identity and the context information; and / or associating the identity and the context information.

12. The method of any preceding claim, wherein the optically readable security element comprises one or more optical emitters arranged to be read via emission radiation emitted from the one or more optical emitters, optionally wherein the optically readable security element comprises one or more optical emitters arranged to be excited by excitation radiation.

13. The method of any preceding claim, wherein the optically readable security element comprises one or more optical emitters arranged to be excited by excitation radiation emitted from the image capturing device.

14. An image capturing device for monitoring an optically readable security element, the image capturing comprising: a reader configured to read the optically readable security element; a context determination unit configured to determine a context of the optically readable security element; and a processor configured to: extract an identity from the optically readable security element using the reader; determine context information related to the reading of the optically readable security element using the context determination unit; and transmit a signal based on the identity and the context information.

15. A system comprising: an optically readable security element having an extractable identity; a data store configured to store context information for the optically readable security element in association with the identity; and optionally, an image capturing device for reading the optically readable security element.

Images