Method of reading an optically readable security element

Abstract

There is provided a method of reading an optically readable security element (20) that is proximal to an object (30) using an image capturing device (10). The optically readable security element 20 provides security in relation to the object (30). The method comprises, by the image capturing device (10): reading S1 the optically readable security element (20) and the object (30); extracting S2 an identity from the optically readable security element (20); optically determining S3 an attribute of the object (30); and calculating S4 a correspondence between the identity and the attribute.

Description

[0001] METHOD OF READING AN OPTICALLY READABLE SECURITY ELEMENT

[0002] TECHNICAL FIELD

[0003] The present disclosure relates to a method of reading an optically readable security element that is proximal to an object using an image capturing device, and an image capturing device for reading an optically readable security element that is proximal to an object. A related system is also disclosed.

[0004] BACKGROUND

[0005] Uniquely labelling an object, such as an item of designer clothing or an expensive piece of artwork or jewellery, is typically used to provide or enhance security. For example, uniquely labelling an object may deter attempts to tamper with the object and / or may hinder illicit reproduction of the object (e.g., counterfeiting).

[0006] Directly labelling valuable objects is typically difficult or undesirable. For instance, directly applying a label to a valuable painting may cause irreversible damage to the painting (e.g., to a canvas or a frame of the painting). Even if irreversible damage is not caused, the presence of a visible label may detract from the aesthetic qualities of the painting (e.g., if the painting is on display in a gallery) or decrease the value of the painting.

[0007] Hence, there is a desire for improved unique labelling (e.g., identifying) of an object, thereby providing security in relation to the object, preferably, without compromising the physical integrity or aesthetic qualities of the object.

[0008] SUMMARY

[0009] It is one aim of the present disclosure, amongst others, to provide a method of reading an optically readable security element which at least partially obviates or mitigates at least some of the disadvantages of the prior art, whether identified herein or elsewhere, or to provide an alternative approach. For instance, it is an aim of embodiments of the invention to provide a method of reading an optically readable security element that facilitates security in relation to an object without comprising the physical integrity or aesthetic qualities of the object.

[0010] According to the present invention there is provided a method of reading an optically readable security element and an image capturing device for reading an optically readable security element, as set forth in the appended claims. Other features of the invention will be apparent from the dependent claims and the description that follows.

[0011] According to a first aspect, there is provided a method of reading an optically readable security element that is proximal to an object using an image capturing device. The optically readable security element provides security in relation to the object. The method comprises, by the image capturing device: reading the optically readable security element and the object; extracting an identity from the optically readable security element; optically determining an attribute of the object; and calculating a correspondence between the identity and the attribute.

[0012] Determining the attribute may comprise determining at least one of a position and an orientation of the object relative to the optically readable security element.

[0013] Determining the attribute may comprise determining a physical characteristic of the object.

[0014] Calculating the correspondence may comprise comparing the determined attribute to an expected attribute and verifying the correspondence only if the determined attribute is within a preset range of the expected attribute.

[0015] The method may further comprise retrieving, from a data store, data relating the determined attribute to the expected attribute.

[0016] The method may further comprise when the determined attribute is not within the preset range of the expected attribute, transmitting an output signal.

[0017] The attribute may be determined using fingerprint region of interest, ROI, segmentation.

[0018] The method may further comprise receiving information about the object from the optically readable security element.

[0019] The method may further comprise combining the identity and the determined attribute to produce a joint identity.

[0020] The identity and the attribute may be combined using an exclusive disjunction operation.

[0021] The method may further comprise optically determining a second attribute of the object and calculating a correspondence between the identity and the second attribute.

[0022] The optically readable security element and the object may be read by the image capturing device in a same field of view. The optically readable security element may comprise one or more optical emitters arranged to be read via emission radiation emitted from the one or more optical emitters. The optically readable security element may comprise one or more optical emitters arranged to be excited by excitation radiation, optionally emitted from the image capturing device.

[0023] According to a second aspect, there is provided an image capturing device for reading an optically readable security element that is proximal to an object. The optically readable security element provides security in relation to the object. The image capturing comprises a reader configured to read the optically readable security element and the object and a processor. The processor is configured (e.g., programmed) to extract an identity from the optically readable security element, optically determine an attribute of the object and calculate a correspondence between the identity and the attribute.

[0024] According to a third aspect, there is provided a system comprising an optically readable security element, an object and a data store. The optically readable security element is proximal to the object. The optically readable security element provides security in relation to the object and has an extractable identity. The object to which the optically readable security element is proximal has an optically determinable attribute. The data store is configured to store a calculated correspondence between the identity and the attribute.

[0025] BRIEF DESCRIPTION OF DRAWINGS

[0026] For a better understanding of the invention, and to show how the invention may be brought into effect, reference will be made to the accompanying Figures, in which:

[0027] Figure 1 shows a method of reading an optically readable security element that is proximal to an object using an image capturing device;

[0028] Figure 2 shows an image capturing device reading an optically readable security element that is proximal to an object;

[0029] Figure 3 shows the image capturing device of Figure 2; and

[0030] Figure 4 shows a system comprising the optically readable security element and the object of Figure 1 and a data store. DETAILED DESCRIPTION

[0031] Figure 1 shows a method of reading an optically readable security element that is proximal to an object using an image capturing device. Figure 2 shows the image capturing device 10 reading the optically readable security element 20 that is proximal to the object 30.

[0032] The optically readable security element 20 provides security in relation to the object 30 (i.e., provides an identifier for the object 30). As shown in Figure 2, the optically readable security element 20 is proximal to the object 30 (i.e., in this case, next to the object 30 such that the optically readable security element 20 and the object 30 can be read in a same field of view 40 of the image capturing device 10). Reading in the same field of view is advantageous for simple and reliable reading. The optically readable security element 20 being proximal to the object 30 could mean that the optically readable security element 20 is on the object 30. However, advantageously, by being next to the object 30, the presence of the optically readable security element 20 does not impact the physical integrity or the aesthetic qualities of the object 30.

[0033] The optically readable security element 20 may comprise a hologram, bar code, QR code or similar, encoding an identity labelling the object 30. In the case of the optically readable security element 20 comprising a hologram, bar code, QR code or similar, such engineered components may be programmable, encoded with, or generally comprise information. For example, the engineered components may comprise information about the object 30, information relating to the identity or a joint identity (see later description).

[0034] Preferably, the optically readable security element 20 comprises a unique (e.g., randomised) component (e.g., a random deterministic feature), encoding the identity. For example, the optically readable security element 20 may comprise an engineered component and a randomised component, wherein the engineered component is programmed or otherwise encoded with information about the object 30 and the randomised component encodes the identity. The randomised component encoding the identity, compared with the engineered component encoding the identity, advantageously engenders a more robust barrier to fraudulent reading of the optically readable security element 20.

[0035] More preferably, the optically readable security element 20 comprises at least one optical emitter arranged to be read via emission radiation emitted therefrom. Relatedly, the at least one optical emitter may be arranged to be excited by excitation radiation. The one or more emitters may serve as the component that provides or serves as the unique identity. Advantageously, the optically readable security element 20 being read via emission emitted therefrom provides a more robust barrier to fraudulent reading, more readily preventing spoofing or copying by, for instance, simply replicating (e.g., by printing) a bar code, QR code or similar. This advantage is particularly true when one or more (e.g., hundreds, thousands or millions or more) of emitters are distributed randomly. For instance, this effect may be achieved using quantum dots, flakes of 2D materials, (e.g., small) molecules, atomic defects or vacancies, plasmonic structures or similar.

[0036] In one example, an engineered component comprising encoded information may be located proximal to (e.g., adjacent to) a component that encodes the identity. This location may conveniently allow for easy reading of both components in sequence or in parallel. For example, both components may be in, and so readable by, the same field of view 40 of the (e.g., sensor of the) image capturing device.

[0037] The image capturing device 10 may be a terminal device, such as a smartphone. The image capturing device 10 may be configured to emit excitation radiation to excite the at least one optical emitter (e.g., from an electromagnetic radiation source, such as a flash or LED). By being configured to emit excitation radiation, the image capturing device 10, advantageously, facilitates the aforementioned robust security. Further, emitting the excitation radiation from the image capturing device 10, advantageously, allows convenient control of excitation of the at least one optical emitter

[0038] As shown in Figure 1 , the method comprises, by the image capturing device 10, reading S1 the optically readable security element 20 and the object 30. Reading S1 may be performed using sensors (not shown), such as image or video sensors (e.g., those typically included in image capturing devices, such as a camera). Reading S1 the optically readable security element 20 and the object 30 typically means, as mentioned, reading the optically readable security element 20 and the object 30 by the image capturing device 10 in the same field of view 40 of the (e.g., sensor of the) image capturing device 10. For instance, the optically readable security element 20 and the object 30 may be read in a same image frame.

[0039] The method also comprises, by the image capturing device 10, extracting S2 the identity from the optically readable security element 20. In other words, the image capturing device 10 extracts the identity from the optically readable security element 20 that labels the object 30. The method also comprises, by the image capturing device 10, optically determining S3 an attribute of the object 30. Reading S1 the optically readable security element 20 and optically determining S3 the attribute may be simultaneous steps or sequential steps. The attribute may be determined using fingerprint region of interest, ROI, segmentation. ROI segmentation involves, for example, identifying a region in the object 30 relative to the optically readable security element 20 and, for instance, binarising an intensity map of the region to produce a key. Alternatively, the attribute may be determined by identifying characteristic points in the object 30 (e.g., brightest pixels), producing a constellation map and using this map for determining the attribute.

[0040] The attribute may be one or both of a position (i.e., location) and orientation (i.e., angle) of the object 30 relative to the optically readable security element 20. For instance, determining the attribute may mean determining a relative arrangement or configuration of the optically readable security element 20 and the object 30. The attribute may include a physical characteristic of the object 30. For example, the physical characteristic may be one of more of a colouration (e.g., hue, shading, emission / absorption profile), a reflectivity, dimensions (e.g., aspect ratio, absolute size) and a texture (e.g., roughness, smoothness) of the object 30. The attribute may include both the position and / or orientation and the physical characteristic, which, as discussed in more detail in below examples, advantageously, facilitates more reliable verification of the object 30 compared with the attribute including only one of the position and / or orientation and the physical characteristic.

[0041] In other words, the determining of the attribute of the object may involve checking that the at least one of a position and an orientation of the object (including its physical characteristic, in certain examples) relative to the optically readable security element is as expected, and / or guiding a reading or check of the physical characteristic using that position and an orientation of the object relative to the optically readable security element. These are effectively the same concepts, from different perspectives. The reading of the optically readable security element may therefore be used to guide or cross-check for the expected positional / orientational relationship of the object and / or its physical characteristic. As discussed or suggested elsewhere herein, this could be achieved by the optically readable security element including information that provides data giving this guide or cross-check information, or perhaps more simply the overall positional / orientational relationship between the optically readable security element and the object (or its physical characteristic) being known, set or stored in advance, and the optically readable security element (including the reading of it) being used as a baseline for that guide / cross-check.

[0042] The method also comprises, by the image capturing device 10, calculating S4 a correspondence (i.e., a relation or mapping) between the identity and the attribute. Calculating may mean initial setting of the correspondence or verifying an established correspondence (i.e., checking that the identity is associated with the attribute). Advantageously, calculating a correspondence between the identity and the attribute facilitates verification of the object 30, even if the optically readable security element 20 is not directly attached to the object 30. In other words, authentication of the object 30 is enabled without any risk of damage to the object 30 by necessarily physically attaching a label or identifier.

[0043] Calculating the correspondence may comprise comparing the determined attribute to an expected attribute and verifying the correspondence only if the determined attribute is within a preset range (e.g., a particular percentage or confidence level) of the expected attribute. For example, if the attribute is a position, the correspondence may be verified only if the determined position of the object is within a preset range (e.g., 1 %, 1 mm, etc) of the expected position. Advantageously, allowing some degree of tolerance avoids false positives or, in other words, provides a significant degree of security, while still allowing the overall implementation to be applicable in real-world setting.

[0044] When the determined attribute is not within the preset range of the expected attribute, an output signal may be transmitted (e.g., internally within or external to) the image capturing device 10. The output signal is typically an alert signal of some kind. For example, the output signal may be an alert signal to alert a member of a security team that the object 30 (or, indeed, the optically readable security element 20) has moved, as such movement may be associated with attempted theft of the object 30 or general tampering with the object 30 and / or optically readable security element 20. In another example, the output signal may be an alert signal to alert a curator of the object 30 of photodegradation of the object 30 (e.g., if the object 30 is a painting). The output signal may cause the optically readable security element 20 to be disabled, thereby precluding verification. For example, this process may involve flagging that the optically readable security element 20 or object 30 as having been targeted in an attempted theft, tampering, or counterfeiting attempt in a local or remote (e.g., online) database. A result may be that future readings or scans are directed to a warning message, rather than allowing repeat attempts at such reading. Repeat attempts could allow for the security to be overcome, for example, by the correspondence somehow being brought back to acceptable levels, by luck or otherwise.

[0045] Disabling of an element (or image capturing device) might involve anything that prevents the element being used or read, or the device being used or used to read the element. For example, this might involve changing a flag or other indicator in a data store or the device, to indicate this change or limitation in functionality. In other words, the device or element cannot be used in the usual way, i.e. the device is unable to read an element (e.g. as an authentic element), or that element is not able to be read (e.g. as an authentic element) by the device.

[0046] Alternatively, the output signal may be a score. For example, the output may be a score associated with how much the object 30 has moved from an expected position. In other words, deviation of the determined attribute from the expected attribute may be quantified. For example, if the object 30 is stored on a shelf, a higher score may be associated with greater deviation of the position of the object 30 from the expected position and, hence, greater risk of the object 30 falling from the shelf. In the context of objects on display in a museum, the output signal alerts a curator of the museum as to which objects are most at risk of damage (e.g., by falling from a shelf, hook or other means of attachment) following a seismic event, for instance.

[0047] For a mass-produced objects 30 or objects 30 produced in large numbers (e.g., clothing, packaging, etc.), the objects 30 will be relatively similar, if not almost identical, and so not unique. Here, then, determining S3 at least one of a position and an orientation of the object 30 relative to the optically readable security element 20 may be a very practical, and relatively simple yet impactful, approach.

[0048] In an alternative example, an object 30 may be intrinsically unique (and even valuable), for instance, where the object is a ‘one-off’, such as an artwork. Here, determining a physical characteristic of the object 30 as part of the correspondence implementation might be more impactful and offer perhaps even better security.

[0049] Indeed, this shows an important (and more general) feature of the invention. The physical characteristic of the object itself serves as an identifier for the object. So, there are two identifiers used in at least some embodiments: one, from the optically readable security element, and another, from, being, or based on, the physical characteristic of the object. Distinct identifiers are useful, because they provide additional security, for example if one of the identifiers is compromised. If one identifier simply coded or in some way included the other identifier, security could be reduced. Consider an example where the object 30 is an item of designer clothing including a logo. The optically readable security element 20 may be on, incorporated in or next to the logo. For a genuine example of the item, the logo is at a specific position (i.e., an expected position) on the clothing (or packaging). Therefore, for any example of the item, by determining S3 the position of the logo as an attribute of the clothing and by comparing the determined position of the logo to the expected position it can be assessed whether the item is genuine. In other words, the determined position of the logo deviating from the expected position may be indicative of a counterfeit item. For instance, deviation of the logo from the expected position may indicate that the logo has been tampered with, such as by applying the logo to a counterfeit item.

[0050] Consider an example where the object 30 is an allegedly famous oil painting consisting of a frame and canvas. In this example, the optically readable security element 20 would be next to the painting, as maintaining the physical integrity of the painting and the aesthetic qualities of the painting would likely be paramount. By determining S3 the colouration of oil on the canvas and comparing the determined colouration with expected colouration, it can be assessed whether the object is indeed the famous painting or a forgery thereof. In combination with the physical characteristic, the attribute may include a position. For instance, the attribute may include both the colouration of the painting and the position of the frame relative to the canvas. Consequently, by determining S3 both the colouration of the oil of the canvas and the position of the frame relative to the canvas and comparing them, respectively, with the expected colouration and the expected position of the frame relative to the canvas, it can be assessed with greater surety whether the object 30 is indeed the famous painting or a forgery thereof.

[0051] In another application, by determining both the colouration of the oil of the canvas and the position of the frame relative to the canvas and comparing them, respectively, with the expected colouration and the expected position of the frame relative to the canvas, it can be assessed whether maintenance, cleaning or restorative work is required. In this way, damage (e.g., due to wear and tear, accumulation of air borne particles or photodegradation) to the painting can be avoided.

[0052] The method may further comprise retrieving, from a data store, data relating the determined attribute to the expected attribute. The data store typically relates the determined attribute to the expected attribute based on the extracted identity. For example, having optically determined the attribute, the extracted identity may be used to look up the expected attribute in the data store. The data store may be part of the image capturing device 10 or the optically readable security element 20. Alternatively, the data store may be part of an external device in communication (e.g., wirelessly) with the image capturing device 10 (see Figure 4). Advantageously, the data store being part of an external device means that a size of the image capturing device 10 does not have to be increased to accommodate, for example, additional memory for relating the determined attribute to the expected attribute.

[0053] The method may further comprise receiving information about the object 30 from the optically readable security element 20. In an example of the object 30 being a painting, visitors to a gallery in which the painting is hung, each of whom may be in possession of an or the image capturing device 10, may receive information about the painting (e.g., information about the artist, the subject of the painting, material used to produce the painting) from the optically readable security element 20. This information may be received directly from the optically readable security element 20 or may be mediated by a server. Further, each visitor who reads the optically readable security element 20 in order to receive information about the object 30 may unknowingly contribute to protecting the object 30. Specifically, the correspondence may be calculated by each image capturing device 10 held by a user. In this way, advantageously, continuous checking of the attribute (e.g., position) is facilitated.

[0054] The method may further comprise combining the identity and the determined attribute to produce a joint identity. The identity and the attribute may be combined using an exclusive disjunction operation. The joint identity may be used to generate private and public keys for use in encryption. Advantageously, combining the identity and the determined attribute results in greater computational efficiency. Alternatively, if both the identity and the determined attribute are encapsulated in binary form, assigned colour channels may be used to form a colour map. Advantageously, forming a colour map maintains independence of the identity and the determined attribute, and the colour map is easily machine readable.

[0055] The method may further comprise optically determining a second attribute of the object 30 and calculating a correspondence between the identity and the second attribute. Returning to the example where the object is an allegedly famous oil painting, in addition to optically determining S3 the colouration of oil on the canvas, the texture of the oil may be determined. Consequently, the colouration and / or the texture can be used for calculating S4 the correspondence. Advantageously, calculating S4 the correspondence for more than one attribute facilitates reliable verification. In one example, whichever of the more than one attribute is closest to the expected value for that attribute is used to verify the object 30, thereby, advantageously, providing reliable verification while minimising computational expenditure.

[0056] The method described above in relation to Figure 1 may be performed by the image capturing device 10. Alternatively, these steps may be facilitated by the image capturing device 10 in communication with, for example, a server. For example, calculating S4 the correspondence may take place at the server based on a signal received from the image capturing device 10, the server subsequently transmitting the calculated correspondence to the image capturing device 10.

[0057] Figure 3 shows the image capturing device 10 of Figure 2 in more detail. The reading S1 of the optically readable security element 20 is performed by a reader 11 , which could include or be a sensor as discussed above. The extracting S2, optically determining S3 and calculating S4 is performed by a processor 12. The processor 12 may be configured to extract the identity, optically determine the attribute and calculate the correspondence locally (i.e., at the image capturing device 10) or externally (e.g., at a server). The processor 12 may be dedicated hardware or existing hardware specifically configured to extract the identity, optically determine the attribute and calculate the correspondence.

[0058] Figure 4 shows a system comprising the optically readable security element 20, the object 30 and the data store 50, as respectively described above. In Figure 4, the data store 50 is shown as an external device. However, as mentioned, alternatively, the data store 50 may be part of the image capturing device 10.

[0059] In summary then, the present disclosure has described a method and a device that facilitate security in relation to an object, potentially without comprising the physical integrity or aesthetic qualities of the object. Further, and perhaps more generally, the present disclosure has described a method and a device that engender robust, reliable and computationally efficient security of an object. As will be appreciated, the present disclosure allows for the security to be applied retrospectively, after the object has been made.

[0060] Although preferred embodiments have been shown and described, it will be appreciated by those skilled in the art that various changes and modifications might be made without departing from the scope of the invention, as defined in the appended claims and as described above.

[0061] The optional features set out herein may be used either individually or in combination with each other where appropriate and particularly in the combinations as set out in the accompanying claims. The optional features for each aspect or embodiment of the invention, as set out herein are also applicable to all other aspects or embodiments of the invention, where appropriate. In other words, the skilled person reading this specification should consider the optional features for each aspect or exemplary embodiment of the invention as interchangeable and combinable between different aspects and embodiments.

Claims

CLAIMS1. A method of reading an optically readable security element that is proximal to an object, using an image capturing device, the optically readable security element providing security in relation to the object, the method comprising, by the image capturing device: reading the optically readable security element and the object; extracting an identity from the optically readable security element; optically determining an attribute of the object; and calculating a correspondence between the identity and the attribute.

2. The method of claim 1 , wherein determining the attribute comprises: determining at least one of a position and an orientation of the object relative to the optically readable security element.

3. The method of claim 1 or 2, wherein determining the attribute comprises: determining a physical characteristic of the object.

4. The method of any one of claims 1 to 3, wherein calculating the correspondence comprises: comparing the determined attribute to an expected attribute; and verifying the correspondence only if the determined attribute is within a preset range of the expected attribute.

5. The method of claim 4, further comprising: retrieving, from a data store, data relating the determined attribute to the expected attribute.

6. The method of claim 4 or 5, further comprising: when the determined attribute is not within the preset range of the expected attribute, transmitting an output signal.

7. The method of any preceding claim, wherein the attribute is determined using fingerprint region of interest, ROI, segmentation.

8. The method of any preceding claim, further comprising: receiving information about the object from the optically readable security element.

9. The method of any preceding claim, further comprising: combining the identity and the determined attribute to produce a joint identity.

10. The method of claim 9, wherein the identity and the attribute are combined using an exclusive disjunction operation.11 . The method of any preceding claim, further comprising: optically determining a second attribute of the object; and calculating a correspondence between the identity and the second attribute.

12. The method of any preceding claim, wherein the optically readable security element and the object are read by the image capturing device in a same field of view.

13. The method of any preceding claim, wherein the optically readable security element comprises one or more optical emitters arranged to be read via emission radiation emitted from the one or more optical emitters, optionally wherein the optically readablesecurity element comprises one or more optical emitters arranged to be excited by excitation radiation, optionally emitted from the image capturing device.

14. An image capturing device for reading an optically readable security element that is proximal to an object, the optically readable security element providing security in relation to the object, the image capturing comprising: a reader configured to read the optically readable security element and the object; and a processor configured to: extract an identity from the optically readable security element; optically determine an attribute of the object; and calculate a correspondence between the identity and the attribute.

15. A system comprising: an optically readable security element that is proximal to an object, the optically readable security element providing security in relation to the object and having an extractable identity; the object to which the optically readable security element is proximal, the object having an optically determinable attribute; and a data store configured to store a calculated correspondence between the identity and the attribute.

Images