Method of determining coupling of objects using an image capturing device

Abstract

The invention relates to a method of determining coupling of objects using an image capturing device (e.g. smartphone) 10. The method comprises, by the image capturing device: reading (S1) a first opt

Description

TECHNICAL FIELD 5 The present disclosure relates to a method of determining coupling of objects using an image capturing device and an image capturing device for determining coupling of objects. A related system is also disclosed. BACKGROUND Products may be sold comprising multiple components or with documentation included 10 (e.g., a certificate of authenticity). While conventional security measures (e.g., tagging the product with a security ID) may provide a barrier to, for instance, counterfeit production of a single component of a product, such measures fail to ensure the security of all the parts of the product (i.e., all components or accompanying documentation). For example, if a product tagged with a security ID is sold and that product comprises 15 multiple components, one or more of the components to which the security tag is not attached may be exchanged for counterfeit components that may be made, for instance, using inferior materials. Similar or associated problems arise in relation to objects that are generally coupled (i.e., physically or virtually linked or related) together. While conventional security 20 measures (e.g., tagging an object with a security ID) may provide a barrier to, for instance, counterfeit production of that object, such measures fail to ensure the security of the coupled objects. Hence, there is a desire to provide a method of improving security of all parts of a product and, more generally, coupled objects. 25 SUMMARY It is one aim of the present disclosure, amongst others, to provide a method of determining coupling of objects which at least partially obviates or mitigates at least some of the disadvantages of the prior art, whether identified herein or elsewhere, or to provide an alternative approach. For instance, it is an aim of embodiments of the 30 invention to provide a method that ensures security of a number of (e.g., all of) parts of a product. 20 06 24 According to the present invention there is provided a method of determining coupling of objects using an image capturing device and an image capturing device for determining coupling of objects, as set forth in the appended claims. Other features of the invention will be apparent from the dependent claims and the description that 5 follows. According to a first aspect, there is provided a method of determining coupling of objects using an image capturing device. The method comprises, by the image capturing device: reading a first optically readable security element proximal to a first object, and extracting a first identity from the first optically readable security element; reading a 10 second optically readable security element proximal to a second object, and extracting a second identity from the second optically readable security element; calculating a correspondence between the first identity and the second identity that is indicative of coupling of the first object and the second object. Calculating the correspondence may comprise verifying that the first object is coupled 15 to the second object. Calculating the correspondence comprises combining the first identity and the second identity to produce a joint identity. Calculating the correspondence may comprise comparing the joint identity to a stored joint identity; and verifying that the first object is coupled to the second object if the joint 20 identity matches the stored joint identity. Calculating the correspondence comprise may comprise retrieving, from a data store, the stored joint identity. The method may further comprise transmitting an output signal if the first object is not verified as coupled to the second object. 25 The reading of the first optically readable security element and the reading of the second optically readable security element may be simultaneous in a same field of view. The first optically readable security element may be attached to the first object, and the second optically readable security element may be attached to the second object. The first identity and the second identity may be combined using an exclusive 30 disjunction operation. 20 06 24 The method may further comprise authenticating at least one of the first optically readable security element and the second optically readable security element based on an optical characteristic thereof. The method may further comprise extracting the identity of the at least one of the first 5 optically readable security element and the second optically readable security element only if a level of the optical characteristic is within a predetermined range. At least one of the first optically readable security element and the second optically readable security the optically readable security element may comprise one or more optical emitters arranged to be read via emission radiation emitted from the one or more 10 optical emitters. At least one of the first optically readable security element and the second optically readable security optically readable security element may comprise one or more optical emitters arranged to be excited by excitation radiation, optionally emitted from the image capturing device. 15 According to a second aspect, there is provided an image capturing device for determining coupling of objects. The image capturing device comprises a reader and a processor. The reader is configured to read a first optically readable security element proximal to a first object and a second optically readable security element proximal to a second object. The processor is configured to extract a first identity from the first 20 optically readable security element and a second identity from the second optically readable security element; and calculate a correspondence between the first identity and the second identity that is indicative of coupling of the first object and the second object. According to a third aspect, there is provided a system comprising a first optically 25 readable security element, a second optically readable security element, a first object, a second object and a data store. The first optically readable security element is proximal to the first object. The second optically readable security element is proximal to the second object. The data store is configured to store a calculated correspondence between the first identity and the second identity that is indicative of coupling of the first 30 object and the second object. BRIEF DESCRIPTION OF DRAWINGS For a better understanding of the invention reference will be made to the accompanying Figures, in which: 20 06 24 Figure 1 shows a method of determining coupling of objects using an image capturing device Figure 2 shows a first optically readable security element proximal to a first object and a second optically readable security element proximal to a second object; 5 Figure 3 shows an image capturing device for determining the coupling of objects; and Figure 4 shows a system comprising a first optically readable security element, a second optically readable security element, a first object, a second object and a data store. DETAILED DESCRIPTION 10 Figure 1 shows a method of determining coupling of objects using an image capturing device or, equivalently, the coupling of identities thereof. A coupling may be a relationship between objects. Being coupled may mean that objects are or were physically or functionally connected (e.g., to be used with one another). For instance, the coupling may link components of a product. The method is performed by an image 15 capturing device 10 (e.g., smart phone), as shown in Figure 2. The method comprises reading S1 a first optically readable security element proximal to a first object (i.e., next to or on the first object such that the first optically readable security element and the first object can be read in a same field of view 40 of the image capturing device) and extracting a first identity from the first optically readable security 20 element. The method comprises S2 reading a second optically readable security element proximal to a second object (i.e., next to or on the second object such that the second optically readable security element and the second object can be read in a same field of view 40 of the image capturing device) and extracting a second identity from the second optically readable security element. Advantageously, by extracting the first 25 identity and the second identity the respective authenticity of the first object and the second object can be individually checked. As per Figure 2, which shows the first optically readable security element 21 proximal to the first object 31 and the second optically readable security element 22 proximal to the second object 32, being proximal may mean that the optically readable security 30 element 21, 22 is attached to the object 31 32. Being proximal may also mean that the optically readable security element 21, 22 is not attached to object 31, 32 itself. For example, the optically readable security element 21, 22 may be attached to surrounding packing, advantageously, to avoid damaging the object. 20 06 24 An optically readable security element may be a hologram, bar code, QR code or similar, encoding an identity. In the case of the optically readable security element 21, 22 comprising a hologram, bar code, QR code or similar, such engineered components may be programmable, encoded with, or generally comprise information. For example, 5 the engineered components may comprise information about the first object 31 or the second object 32 information relating to the first identity or the second identity or a joint identity (see later description). Preferably, the optically readable security element 21, 22 comprises a unique (e.g., randomised) component (e.g., a random deterministic feature), encoding the identity. 10 For example, the optically readable security element 21, 22 may comprise an engineered component and a randomised component such as an optical physical unclonable function, wherein the engineered component is programmed or otherwise encoded with information about the object 31, 32 and the randomised component encodes the corresponding first or second identity. The randomised component 15 encoding the identity, compared with the engineered component encoding the identity, advantageously engenders a more robust barrier to fraudulent reading of the optically readable security element 21, 22. More preferably, one or both of the first optically readable security element 21 and the second optically readable security element 22 comprise one or more optical emitters. 20 The one or more emitters may serve as the component that provides or serves as the unique identity. The optical emitters may be arranged to be read via emission radiation emitted therefrom. Consequently, and advantageously, more robust security is provided compared with a hologram, bar code, QR code or similar. This advantage is particularly true when one or more (e.g., hundreds, thousands or millions or more) of emitters are 25 distributed randomly. For instance, this effect may be achieved using quantum dots, flakes of 2D materials, (e.g., small) molecules, atomic defects or vacancies, plasmonic structures or similar. In one example, an engineered component comprising encoded information may be located proximal to (e.g., adjacent to) a component that encodes the identity. This 30 location may conveniently allow for easy reading of both components in sequence or parallel. For example, both components may be in, and so readable by, the same field of view 40 of the (e.g., sensor of the) image capturing device. The optical emitters may be arranged to be excited by excitation radiation. For example, the image capturing device 10 may be configured to emit excitation radiation to excite 20 06 24 the one or more optical emitters (e.g., from an electromagnetic radiation source, such as a flash or LED). The method comprises calculating S3 a correspondence between the first identity and the second identity that is indicative of coupling of the first object 31 and the second 5 object 32. Calculating S4 the correspondence may mean setting the correspondence for subsequent reference. For example, by initially (e.g., previously) associating the optically readable security elements 21, 22 with the respective objects 31, 32, the correspondence of the first object 31 and the second object 32 can be set for subsequent checking. 10 Typically, calculating the correspondence comprises verifying that the first object 31 is coupled (i.e., linked or related) to the second object 32. Consequently, not only is the authenticity of the first object 31 and the second object 32 individually checked, but the objects 31, 32 are checked as belonging to the same group or set (e.g., corresponding components of a product). Again, this could be a physical or virtual grouping. 15 For example, in the case of a pair of shoes being sold as a product, the left shoe may be considered the first object 31 and the right shoe may be considered the second object 32. In another example, in the case of sports memorabilia with an attached certificate / label of authenticity being sold as the product, the memorabilia may be considered the first object 31 and the certificate of authenticity may be considered the 20 second object 32. Ina further example, the product may be a sheet of bank notes, and first object 31 and the second object 31 may be individual notes produced from that sheet. Thus, by calculating a correspondence between the first identity and the second identity that is indicative of coupling between the first object 31 and the second object 32, the authenticity of the product as a whole is able to be checked. 25 Calculating S4 the correspondence comprises combining the first identity and the second identity to produce a joint identity. The joint identity may be used to generate private and public keys for use in encryption. Advantageously, combining the first identity and the second identity results in greater computational efficiency - e.g., only a single (joint) identity needs to be processed. Further, combining the identities reduces 30 the likelihood of an individual identity being compromised. The joint identity, or a signature / key derived from it, may be recorded to allow verification. The first identity and the second identity may be combined using an exclusive disjunction operation. Alternatively, if both the first identity and the second identity are encapsulated in binary form, assigned colour channels may be used to form a colour 20 06 24 map. Advantageously, forming a colour map maintains independence of the first identity and the second identity, and the colour map is easily machine readable. Calculating S4 the correspondence may comprise comparing the joint identity to a (previously) stored joint identity and verifying that the first object 31 is coupled to the 5 second object 32 if the joint identity matches the stored joint identity. The joint identity may be determined as a match with the stored joint identity if a value of the joint identity is within a predetermined range (e.g., confidence level or interval) of the stored joint identity. Advantageously, determining the joint identity as match with the stored identity if a value of the joint identity is within a predetermined range avoid false negatives, 10 providing a significant degree of security, while still allowing the overall implementation to be applicable in real-world setting. In order to compare the joint identity with the stored joint identity, the method may comprise retrieving, from a data store, the stored joint identity. To this end, the image capturing device 10 may be in wireless communication with the data store. In this way, 15 advantageously, the image capturing device 10 is not required to store the stored joint identity, which may engender a lighter and more compact image capturing device 10. Alternatively, the data store may be part of the image capturing device 10 and / or one of or each of the optically readable security elements 21, 22. For instance, the one or each of the optical readable security elements 21, 22 may store the stored joint ID or 20 may be associated with data indicative of the stored joint ID, advantageously, allowing an at least partial implementation of the invention in an offline manner. To avoid combining the first identity and the second identity, and to avoid use of a data store, public key cryptography may be used in calculating S4 the correspondence. For example, a unique string may be generated for each of the first and second identity and 25 a fuzzy extraction algorithm used so that the same string is generated 22 despite differences in measuring conditions, resulting in a first private key per identity. A corresponding second private key may be generated using a random number generator. Public key cryptography algorithms (RSA, Diffie Hellman, elliptic curve, lattice, etc.) are used to combine the two private keys to produce a public key that is 30 encoded in the engineered component. The image capturing device 10 may then extract the private keys from randomised component and the public key from the engineered component. Verification that the first object 31 is coupled to the second object 32 may then be performed using private keys stored in the image reading device 10. 20 06 24 The reading S1 of the first optically readable security element 21 and the S2 reading of the second optically readable security element 22 may be simultaneous in a same field of view 40 of a (e.g., sensor of the) image capturing device 10. A sensor may be an image or video sensor (e.g., those typically included in image capturing devices, such 5 as smartphones and so on). The sensor could be a camera. For instance, the first and second optically readable security element may be read in a same image frame. In other words, only a single one of the first optically readable security element 21 and the second optically readable security element 21 being read means that coupling of the objects 31, 32 is not verified. Advantageously, in this way, fraudulent verification of the 10 coupling is prevented by separately (e.g., temporally and / or spatially) reading S1, S2 the optically readable security elements 21, 22 when they are in disparate locations, for example. The method may further comprise transmitting an output signal if the first object 31 is not verified as coupled to the second object 32. The output signal may be an alert signal. 15 The output signal may be transmitted to or within the image capturing device 10 or to an external device. Consequently, advantageously, a user of the image capturing device 10 is alerted to a product comprising counterfeit parts, for example. A manufacturer or retailer of the objects 31, 32 may be alerted in a similar way. The output signal may cause one or more optically readable security elements 21, 22 20 to be disabled, thereby precluding verification. For example, this might involve flagging that one or more optically readable security elements 21, 22 or objects 31, 32 have in some way been compromised or are simply not as expected, which could indicate them being targeted in an attempted tampering, or counterfeiting. The flag or other indicator could be located in a local or remote (e.g., online) database. A result might be that future 25 readings or scans are directed to a warning message, rather than allowing repeat attempts at such reading. Repeat attempts could allow for the security to be overcome, for example, by the correspondence somehow being brought back to acceptable levels by luck or otherwise. The method may further comprise authenticating at least one of the first optically 30 readable security element 21 and the second optically readable security element 22 based on an optical characteristic thereof. Advantageously, this authentication adds an extra layer of security over verifying the coupling of the first object 31 and the second object 32. 20 06 24 In more detail, the first optically readable security element 21 may have physical properties (e.g., reflectivity, absorbance) resulting in a first optical characteristic, and the second optically readable security element 22 may have physical properties (e.g., reflectivity, absorbance) resulting in a second optical characteristic. In other words, 5 each of the first and second optically readable security elements 21, 22 may be associated with respective first and second optical characteristics. The first and second optical characteristics may be measured by a sensor of the image capturing device, which may authenticate the corresponding optically readable security element 21, 22 based on the measurement. 10 For example, the image capturing device 10 may authenticate each optically readable security element 21, 22 if the specular reflection therefrom is above a predetermined threshold or within a predetermined range. Use of a predetermined threshold or a predetermined range reduces the occurrence of false negatives. The first optical characteristic and the second optical characteristic are distinct from the 15 first optically readable security element 21 and the second optically readable security element 22, respectively. Specifically, the first and second optical characteristics are, respectively, distinct from first and second readable portions of the first and second optically readable security elements 21, 22 (i.e., the optical characteristic and the readable portion of the optically readable security element 21, 22 are defined by 20 different frequencies of electromagnetic radiation). Figure 3 shows an image capturing device 10 for determining coupling of objects. The image capturing device 10 comprises a reader 11 and a processor 12. The reader 11 could include or be a sensor as discussed above. The reader 11 is configured to read a first optically readable security element 21 proximal to a first object 31 and a second 25 optically readable security element 22 proximal to a second object 32, as described above in in relation to Figure 1. The processor 12 is configured to extract a first identity from the first optically readable security element 21 and a second identity from the second optically readable security element 22 and to calculate a correspondence between the first identity and the second identity that is indicative of coupling of the first 30 object 31 and the second object 32, as described above in in relation to Figure 1. The processor may be in communication with a server, whereby the extraction and the calculation may take place via the server. As alluded to above, the image capturing device may also include a sensor. 20 06 24 As shown in Figure 4, the first and second optically readable security elements 21, 22, the first and second objects 31, 32 and the data store 50 may form a system. As mentioned, the data store 50 is configured to store a calculated correspondence between the first identity and the second identity that is indicative of coupling of the first 5 object 31 and the second object 32. In summary, the present disclosure has described a method and an image capturing device that ensure security and facilitate authentication of all parts a product, as well as generally increasing security of the product. More generally, the security of coupled objects can be improved or determined. As will be appreciated, the present disclosure 10 allows for the security to be applied retrospectively, after the or each object has been made. Although preferred embodiments have been shown and described, it will be appreciated by those skilled in the art that various changes and modifications might be made without departing from the scope of the invention, as defined in the appended claims and as 15 described above. The optional features set out herein may be used either individually or in combination with each otherwhere appropriate and particularly in the combinations as set out in the accompanying claims. The optional features for each aspect or exemplary embodiment of the invention, as set out herein are also applicable to all other aspects or exemplary 20 embodiments of the invention, where appropriate. In other words, the skilled person reading this specification should consider the optional features for each aspect or exemplary embodiment of the invention as interchangeable and combinable between different aspects and exemplary embodiments.

Claims

1. A method of determining coupling of objects using an image capturing device, the method comprising, by the image capturing device:5 reading a first optically readable security element proximal to a first object, and extracting a first identity from the first optically readable security element;reading a second optically readable security element proximal to a second object, and extracting a second identity from the second optically readable security element;calculating a correspondence between the first identity and the second identity 10 that is indicative of coupling of the first object and the second object, wherein calculating the correspondence comprises combining the first identity and the second identity to produce a joint identity.

2. The method of claim 1, wherein the method further comprises:15 verifying that the first object is coupled to the second object.

3. The method of claim 2, wherein calculating the correspondence comprises: comparing the joint identity to a stored joint identity; andverifying that the first object is coupled to the second object if the joint identity20 matches the stored joint identity.

4. The method of claim 3, wherein calculating the correspondence comprises: retrieving, from a data storage, the stored joint identity.25 5. The method of any one of claims 2 to 4, further comprising:transmitting an output signal if the first object is not verified as coupled to the second object.

6. The method of any preceding claim, wherein the reading of the first optically readable security element and the reading of the second optically readable security element is simultaneous in a same field of view.5 7. The method of any preceding claim, wherein the first optically readable securityelement is attached to the first object, and the second optically readable security element is attached to the second object.

8. The method of any preceding claim, wherein the first identity and the second identity10 are combined using an exclusive disjunction operation.

9. The method of any preceding claim, further comprising:authenticating at least one of the first optically readable security element and the second optically readable security element based on an optical characteristic thereof.1510. The method of claim 9, further comprising:extracting the identity of the at least one of the first optically readable security element and the second optically readable security element only if a level of the opticalcharacteristic is within a predetermined range.2011. The method of any preceding claim, wherein at least one of the first optically readable security element and the second optically readable security the optically readable security element comprise one or more optical emitters arranged to be read via emission radiation emitted from the one or more optical emitters.

12. The method according to any preceding claim, wherein at least one of the first optically readable security element and the second optically readable security element comprise one or more optical emitters arranged to be excited by excitation radiation, optionally emitted from the image capturing device.3013. An image capturing device for determining coupling of objects, the image capturing device comprising:a reader configured to read a first optically readable security element proximal to a first object and a second optically readable security element proximal to a second 5 object; anda processor configured to:extract a first identity from the first optically readable security element and a second identity from the second optically readable security element; andcalculate a correspondence between the first identity and the second10 identity that is indicative of coupling of the first object and the second object, wherein calculating the correspondence comprises combining the first identity and the second identity to produce a joint identity.

14. A system comprising:15 a first optically readable security element proximal to a first object, a first identity being extractable from the first optically readable security element;a second optically readable security element proximal to a second object, a second identity being extractable from the second optically readable security element;the first object to which the first optically readable security element is proximal;20 the second object to which the second optically readable security element is proximal; anda data store configured to store a calculated correspondence between the first identity and the second identity that is indicative of coupling of the first object and the second object, the correspondence comprises a combination of the first identity and the 25 second identity in the form of a joint identity.

Images