Anti-theft systems before the item reaches the point-of-sale information management system

Abstract

This disclosure provides a system for preventative theft prevention before users reach the store's checkout area. [Solution] A system and method for preventing theft includes means for receiving image data of a person selecting an item from a camera and tag data associated with the item from a reader; means for determining, using both the tag data and image data, that an abnormal handling has occurred to the item and tag while the item is in the store's sales area but before the item approaches the store's checkout area; and means for selectively performing actions to ensure the security of the facility in response to the determination that an abnormal handling has occurred to the item and tag.

Description

Background Art

[0001]

[0001] Theft in retail stores is a problem that retail stores desire to prevent. An Electronic Article Surveillance (EAS) system can use security tags to protect retail items from theft. These security tags can be passive and thus may only allow limited one-way transfer of information. Some security tags have a self-reporting feature. In this case, an alarm from the security tag is issued in response to the deactivation of the security tag or when the security tag is moved into the detection area of the EAS system. However, there are various ways to disable this alarm and other ways to steal store items.

[0002]

[0002] The objectives and features of the present disclosure can be better understood by referring to the drawings and the claims described below. The drawings are not necessarily to scale and, rather, generally place emphasis on illustrating the principles of the embodiments of the present disclosure. In the drawings, like numbers are used to indicate like parts throughout the various figures.

Brief Description of the Drawings

[0003] [Figure 1]

[0003] FIG. 1 illustrates a diagram of components within a store having a sales area and a checkout area, where the store uses a theft prevention system according to some embodiments. [Figure 2A]

[0004] FIG. 2A illustrates a block diagram of an exemplary architecture of the reader shown in FIG. 1 according to some embodiments. [Figure 2B]

[0005] FIG. 2B illustrates a block diagram of an exemplary architecture of the camera shown in FIG. 1 according to some embodiments. [Figure 3]

[0006] FIG. 3 illustrates a block diagram of an exemplary architecture of the theft prevention system shown in FIG. 1 according to some embodiments. [Figure 4]

[0007] Figure 4 illustrates a flowchart of an exemplary method for providing store intelligence for an anti-theft system according to several embodiments. [Modes for carrying out the invention]

[0004]

[0008] In general, this disclosure provides a system for proactive theft prevention before users reach the store's checkout area. This can be done using both security camera feeds and RFID tracking. Furthermore, a model can be used that learns criminal behavior that occurs before a theft, and this disclosure intends to use that learning to predict when a theft is about to occur, and in such cases, store employees can be alerted through various means, such as via a mobile device.

[0005]

[0009] This disclosure relates to the implementation of a system and method for providing facility intelligence to detect, deter, and / or prevent theft before it actually occurs, in particular, before a potential thief reaches the checkout area or store exit. The method comprises using tags and cameras within the sales area of ​​a store where items can be selected. The data relating to the tags and the data relating to the cameras are described separately below, in general terms.

[0006]

[0010] To begin with, regarding the data generated from the tag, this method includes receiving tag data, which includes the movement of a security tag on a product or object. Sensor data may also be received from the tag, which may relate to changes in the tag's geographical location, changes in the ambient light conditions, changes in ambient temperature, changes in the amount of fluid in the ambient environment, or changes in the magnetic field strength generated by the security tag.

[0007]

[0011] Tag data and / or sensor data are then analyzed by an electronic device located remotely from the security tag. This analysis is performed to determine whether the security tag is currently being moved. If so, a decision may also be made as to whether the movement of the security tag is normal or abnormal. If it is determined that the security tag is currently being moved in an abnormal manner, the electronic device takes a first action to ensure the security of the facility. For example, an alarm may be triggered for the security tag, an image of the person carrying the security tag may be captured, the abnormal movement of the security tag may be notified to store staff, or store staff may be dispatched to the location within the facility where the security tag is located.

[0008]

[0012] Furthermore, this tag data / sensor data can be combined with the user's camera image data mentioned above. In this regard, as will be described in more detail later in this specification, the camera supplements the intelligence received by the tag data to verify whether the user is engaging in potentially criminal activity within the store.

[0009]

[0013] If it is determined that the security tag has not been moved in an abnormal manner, the user's movements may continue to be monitored by cameras located throughout the store. Alternatively, cameras may be activated in response to tag data indicating that an item has been selected / moved.

[0010]

[0014] Furthermore, tag data is analyzed to determine whether the security tag is hidden, shielded, or placed in a metal-plated bag, whether the security tag is located in or heading towards a high-risk location within the facility, and / or whether an attempt has been made to disable the security tag. If it is determined that the security tag is hidden, shielded, or placed in a metal-plated bag, the electronic device performs a predetermined action to ensure the facility's security. This action includes issuing an alarm for the security tag and / or notifying staff of the concealment, shielding, or detuning of the security tag. If it is determined that the security tag is located in or heading towards a high-risk location within the facility, the electronic device selectively performs an action to ensure the facility's security. If it is determined that an attempt has been made to disable the security tag, the electronic device selectively performs an action to ensure the facility's security.

[0011]

[0015] Next, various examples and further details of this disclosure are described below. The following descriptions provide specific details for a complete understanding and implementation of these examples. However, those skilled in the art will understand that this disclosure can be implemented without using many of these details. Furthermore, to avoid unnecessarily obscuring the relevant descriptions, some well-known structures or functions may not be illustrated or described in detail.

[0012]

[0016] The technical terms used in the following descriptions, even when used in conjunction with the detailed descriptions of certain examples in this disclosure, are intended to be interpreted in the broadest sense. Any technical terms that are intended to be interpreted in any restricted sense, although some terms may be emphasized below, are expressly and specifically defined as such in the sections on modes for carrying out this invention.

[0013]

[0017] Referring next to the diagram, this disclosure provides a novel intelligence system for various applications, such as retail use. The intelligence system utilizes a camera network, a security tag system, and a computing system, all of which communicate over the network.

[0014]

[0018] In this disclosure, tag and camera outputs are received and aggregated to determine whether the goods are in a predictive theft situation. For example, tag and camera outputs are used to detect when a security tag and / or goods are being handled by a person likely to steal them, thereby indicating that the goods may be stolen in the near future; when a customer's movements indicate that a customer is likely to be attempting to steal the goods; and / or when a security tag is being tampered with, thereby indicating that the security tag may be disabled in the near future.

[0015]

[0019] The following describes in more detail how such detections are carried out. If one or more of the above detections occur, certain actions may be taken. For example, if it is determined that a person likely to steal is in possession of a retail item, a security tag alarm may be triggered, and / or necessary store staff may be notified and / or dispatched to intercept the theft. In particular, this disclosure provides a novel, predictive, and preventive type of loss prevention technique to enterprise organizations that sell, rent, or lease goods to the public (e.g., retail stores or libraries).

[0016]

[0020] Referring next to Figure 1, a schematic diagram of an exemplary system 100 is provided. System 100 is generally configured to enable improved retail store intelligence for theft prevention before theft reaches the checkout area 109 or store exit 130, using technologies that utilize imaging and tag data. Tag data can be acquired using communication technologies such as radio frequency ("RF") communication technology.

[0017]

[0021] As shown in Figure 1, the system 100 comprises one or more databases 140, retail store facilities ("retail stores," "stores," or "RSFs") 160, and / or anti-theft systems 170, which are connected to each other via a network (e.g., the Internet) 150 so as to be able to communicate with one another.

[0018]

[0022] The retail store 160 includes a sales area 105, a checkout area 109, and an entrance / exit 130, as well as an anti-theft system 170 and optionally a local area network 110 for the store.

[0019]

[0023] The sales area 105 is the area of ​​the store where goods or objects (e.g., food, electronics, clothing, etc.) 118 are displayed for sale. For example, the goods or objects may be placed on shelves or racks in the aisles of the sales area 105. As shown in Figure 1, the sales area 105 is separated from the checkout area 109 and is not a place where a person 114 can check out or somehow buy goods. In this regard, Figure 1 shows the physical layout of a store where the sales area 105 is separated from the checkout area 109 by a predetermined distance (e.g., 10 feet, 50 feet, 100 feet, etc.).

[0020]

[0024] The checkout area 109 of store 160 includes one or more point-of-sale ("POS") devices 102 configured to allow a user to purchase any of the objects 118 available for sale in the store. This checkout area 109 is typically, but does not have to be, located next to the store entrance / exit 130. As mentioned above, the checkout area 109 is separate from the sales area 105 within store 160 and may be located at a distance from it. The checkout area 109 begins at least a predetermined distance from the end of the sales area, for example, 20 feet, 30 feet, or 40 feet.

[0021]

[0025] Database 140 includes various data items, such as item IDs 146 and item prices 148 for use in checkouts using POS device 102, which can be queried by the POS devices within checkout area 109. Database 140 may also include theft data 147, such as movement and / or tag data indicating theft, for use with theft prevention system 170 as described herein. Database 140 may include additional items including the unique ID of tag 122, or any other data for use by system 170 and POS 102. These items 146, 147, 148 in database 140 may be created and updated periodically via a central computer system (not shown).

[0022]

[0026] Theft prevention system 170 is a system that collects data (both tag data and image data), analyzes the data, and determines whether an event with a potential for theft is occurring. Theft prevention system 170 includes a computer / server 128 configured to perform the operations disclosed herein. The computer / server 128 will be described in more detail in relation to FIG. 3.

[0023]

[0027] FIG. 1 shows a retail store facility 160 having a theft prevention system 170 both inside and outside the retail store facility 160, but the present disclosure is not limited in this regard. For example, the theft prevention system 170 can be located in a building or geographical area different from store 160 and thus does not need to be on the same network 110 as the store. Alternatively, the theft prevention system 170 can be in the same part of the retail store facility and / or on the same network as the store's network 110. In some embodiments, the theft prevention system 170 can be in the same part of the retail store facility 160 and also remote from the retail store facility 160 via network 150.

[0024]

[0028] Store 160 is generally configured to provide enhanced store security, store intelligence, and customer service. In this regard, store 160 comprises a network 110 defined by a plurality of proximity systems ("PS") 123 disposed at various strategic locations therein. For example, a first proximity system 123 is coupled to aisles, shelves, floor space, etc. of a sales area 105 where merchandise or objects for sale are located. A second proximity system 123 is disposed on or within another area remote from the checkout area 109. In one embodiment, a third proximity system 123 may be disposed on at least one pedestal located at an entrance / exit point 130 of the RSF 160. A fourth proximity system 123 is disposed in a fitting room (not shown). In another embodiment, a fifth proximity system 123 is disposed in the checkout area. Additional proximity systems 123 may be disposed in any high-risk location within store 160 (e.g., dressing rooms), and any other area not within the effective range of any other PS 123. In this regard, all areas of the RSF 160 may be included within the effective range by the PS system 123.

[0025]

[0029] Each proximity system 123 comprises a reader 138 and / or a camera 136. The reader 138 generally operates to communicate information to and / or from a security tag 122 coupled to an object / product 118 (e.g., a product) via a short-range technology (e.g., Bluetooth®, RF technology, etc.), and / or to and / or from other communication devices. Other communication devices can include, but are not limited to, one or more computer / server devices 128 within the anti-theft system 170 of store 160. The computing device / server 128 can serve as an anti-theft system (also referred to herein as a store intelligence system ("SIS")).

[0026]

[0030] In some scenarios, reader 138 may be an RFID reader that emits a constant beacon within a predetermined area around the reader. It should be understood that reader 138 may be used as a transmitting and / or receiving device using RF technology.

[0027]

[0031] Camera 136 is used to monitor in real time the actions of people entering, being present in, and / or leaving the store 160 in order to help determine the movement of people within the RSF 160. This disclosure is not limited to cameras as devices for acquiring information about the movement of people inside or around the store.

[0028]

[0032] Information communicated from the reader 138 to the anti-theft system 170 may include, but is not limited to, the unique identifier of the tag 122 and the unique identifier of the reader 138. The unique identifier of the reader 138 provides a means for determining the location of the person 114 and / or the security tag 122 within the store 160. Tag-related information may be used to track the movement of the security tag 122 within the store 160, track the number of customers who are interested in and / or have actually purchased retail items, determine whether the security tag has been deactivated and / or removed from the merchandise 118, determine whether security measures should be taken with respect to a particular customer, and inform store staff of the results of various analytics-based actions. Store staff may be informed in real time or at a user-specified time via a communication device (e.g., a mobile phone or handheld device) on the network 110.

[0029]

[0033] For example, suppose a person 114 is carrying an item 118 to which a security tag 122 is attached. In some embodiments, there may be a sensor 126 associated with or attached to the tag 122. The sensor 126 of the security tag 122 may acquire sensor data regarding the movement of the security tag, changes in the light state of the environment surrounding the security tag, changes in the temperature of the ambient environment, changes in the amount of fluid / liquid in the ambient environment, and / or changes in the magnetic field generated by the security tag. The sensor data is then sent to the anti-theft system 170 via a communication component. In the anti-theft system 170, the sensor data is used for analysis-based operation. Analysis-based operation is performed according to a default user profile, user preferences, and / or corporate rules stored in the anti-theft system 170. The user profile, user preferences, and corporate rules are customizable.

[0030]

[0034] The analysis-based operation involves performing at least one of the following actions: determining when the security tag 122 has been deactivated or removed from the object 118 to which it is attached; determining when the security tag 122 is being moved; tracking the movement of the security tag 122; determining whether the movement is a normal movement indicating that an interested customer is in possession of the product 118, or an unusual movement indicating that a person likely to steal the product 118 is in possession of it; tracking the location of the security tag 122 within the store 160; determining whether the security tag 122 is currently in a high-risk location within the store 160 (e.g., an exit or fitting room); capturing an image of the person in possession of the security tag 122; and / or providing the necessary staff with an indication of the security tag's movement, the type of security tag's movement, the current location of the security tag 122 within the store 160, and / or recently captured images of the person in possession of the security tag 122.

[0031]

[0035] Abnormal movement can be detected based on the current orientation of the security tag, the speed and direction of the security tag's movement (e.g., relatively fast downward movement of the security tag may indicate an attempt to disable it, such as slamming it against a hard surface), the pattern of the security tag's movement over a given time period (e.g., a rapid change in the height of an item may indicate that a person running or walking relatively fast is holding the item), and / or the relative heights of different parts of the security tag (e.g., a difference in height between the two ends of a security tag relative to its center may indicate that an attempt to disable it, such as bending or deforming the security tag, has occurred). Pre-stored thresholds and / or sensor data patterns (e.g., accelerometer data patterns) may be used in comparison operations to distinguish between normal and abnormal movement.

[0032]

[0036] Additionally or alternatively, analysis-based operation may be performed to determine whether the security tag 122 is hidden, shielded, or placed in a metal-plated bag (e.g., a booster bag), trigger an alarm on the security tag, and / or notify the store clerk of the results of the analysis-based operation before retrieving the product from the store 160. The decision may be based on sensor data from an optical sensor showing changes in ambient light in the surrounding environment over a given time period, and / or sensor data indicating that the security tag has become degraded.

[0033]

[0037] Analysis-based operation may also be performed to detect changes in the amount of fluid / liquid around the security tag, detect changes in ambient temperature of the surrounding environment over a given time period, trigger an alarm on the security tag, and / or notify the store clerk of the results of the analysis-based operation before removing the product from store 160. Changes in the amount of fluid / liquid in the surrounding environment may indicate the occurrence of an attempt to disable the security tag by presenting all or part of it in fluid / liquid. Changes in ambient temperature may indicate the occurrence of an attempt to disable the security tag by melting it using a lighter or other heating device.

[0034]

[0038] Although the anti-theft system 170 is shown in Figure 1 as both located within the store 160 and located remotely from the store 160 on the network 150, the anti-theft system 170 does not need to be remote from the store 160 in all situations. For example, if the store 160 is part of a relatively small store chain, the anti-theft system 170 may be located in one of the retail stores. The anti-theft system 170 may also be a cloud function. In this case, the anti-theft system 170 may reside on a server rented from a cloud provider.

[0035]

[0039] Considering the above, before person 114 reaches the checkout area 109 and the store entrance / exit 130, the anti-theft system 170 performs various actions using two datasets: real-time imaging data and tag data / sensor data. For example, the two datasets are used to (1) increase the security and safety of store 160 to prevent person 114 from even attempting to steal, (2) track the movement path of security tags across the retail store, (3) generate a map showing the location of one or more security tags within store 160, and / or (4) collect and analyze information about the behavioral patterns of thieves.

[0036]

[0040] During store hours, customer 114 may wish to purchase item 118. Customer 114 can purchase item 118 via a fixed POS station 102 (e.g., checkout counter) or a mobile POS station (e.g., the customer's mobile device). Once the purchase of item 118 is successful, the anti-theft system 170 will disable and / or remove the security tag 122 from item 118. In fact, no alarm is triggered when the customer passes through a security zone (not shown) that scans tags, etc.

[0037]

[0041] In some cases, a person may attempt to steal product 118 and thus leave store 160 with product 118 to which an activated security tag 122 is attached, or product 118 to which a maliciously deactivated security tag 122 is attached. An alarm may be triggered when a person walks through the security zone at store entrance / exit 130. However, if multiple other people (e.g., five people) pass through the alert zone at the same time or substantially at the same time, the person 114 cannot be stopped. However, each time a person passes through the security zone, a beacon in proximity system 123 may be triggered to communicate the unique identifier of tag 122 to the anti-theft system 170. Furthermore, a camera in proximity system 123 is triggered to capture a timestamp image of the person and transmit it to the anti-theft system 170 for storage and analysis.

[0038]

[0042] Referring next to Figure 2A, a schematic diagram of an exemplary architecture of the leader 138 of Figure 1 is provided. The leader 138 may include more or fewer components than those shown in Figure 2A. However, the illustrated components are sufficient to disclose exemplary embodiments that implement the present disclosure. Some or all of the components of the leader 138 may be implemented in hardware, software, and / or a combination of hardware and software. The hardware includes, but is not limited to, one or more electronic circuits. The electronic circuits may comprise passive components (e.g., capacitors and resistors) and active components (e.g., processors) arranged and / or programmed to implement the methods disclosed herein.

[0039]

[0043] The hardware architecture in Figure 2A represents one embodiment of a typical reader 138 configured to facilitate improvements in store intelligence, store security, and data analytics. In this regard, the reader 138 is configured to exchange data with an external device (e.g., security tag 122 in Figure 1) via short-range communication ("SRC") technology (e.g., Bluetooth, RF technology, etc.). The reader 138 may include, but may include, fewer or more components, the components 204, 206, 208, 260 and the battery 220 shown in Figure 2A.

[0040]

[0044] The reader 138 includes an antenna 202 to enable the exchange of data with an external device via short-range technology. The antenna 202 is configured to receive SRC signals from an external device and / or transmit SRC signals generated by the reader 138. The reader 138 includes an SRC transceiver 204. It should be understood that the SRC transceiver 204 transmits an SRC signal containing first information to an external device and processes the received SRC signal to extract second information therefrom. The first information includes a unique identifier 230 of the reader 138. The unique identifier 230 provides a means for the anti-theft system 170 to determine the location of a person or security tag located within a given facility (e.g., store 160 in Figure 1). The second information may include, but is not limited to, a unique identifier of an external device (e.g., security tag 122 in Figure 1) and / or sensor data received from the external device (e.g., security tag 122 in Figure 1). The transceiver 204 can pass the extracted second information to the controller 206.

[0041]

[0045] In the controller 206, information may be preprocessed to determine how signals should be handled by the reader 138. For example, a unique identifier for an external device and a unique identifier for the reader 138 may be transmitted to the anti-theft system 170 for security purposes.

[0042]

[0046] In particular, memory 208 may be volatile memory and / or non-volatile memory. For example, memory 208 may include, but is not limited to, random access memory ("RAM"), dynamic random access memory ("DRAM"), static random access memory ("SRAM"), read-only memory ("ROM"), and flash memory. Memory 208 may also comprise non-secure memory and / or secure memory. When used herein, the phrase "non-secure memory" refers to memory configured to store data in plain text format. When used herein, the phrase "secure memory" refers to memory configured to store data in encrypted format, and / or memory having or being housed in a secure or tamper-proof enclosure.

[0043]

[0047] The data collected by the reader can then be passed to the anti-theft system 170 via interface 260.

[0044]

[0048] Referring next to Figure 2B, a block diagram of an exemplary architecture of camera 136 is provided, which is useful for understanding this disclosure. Camera 136 may include more or fewer components than those shown in Figure 2B. However, the illustrated components are sufficient to disclose exemplary embodiments that implement this disclosure. Some or all of the components of camera 136 may be implemented in hardware, software, and / or a combination of hardware and software. Hardware includes, but is not limited to, one or more electronic circuits. Electronic circuits may include passive components (e.g., capacitors and resistors) and active components (e.g., processors) arranged and / or programmed to implement the methods disclosed herein.

[0045]

[0049] The hardware architecture in Figure 2B represents one embodiment of a typical camera 136 configured to facilitate improvements in store intelligence, store security, and data analytics. In this regard, the camera 136 is configured to capture images and / or video for processing by the anti-theft system 170. The camera 136 may include the components 304, 306, 308, 360 and the power supply 320 shown in Figure 2B, but may include fewer or more components.

[0046]

[0050] Camera 136 includes an image sensor 304 for capturing images / videos using imaging technology. Images / videos may be transmitted along with a unique identifier 330 of camera 136. The unique identifier 330 provides the anti-theft system 170 with a means for determining the location of a person located within a given facility (e.g., RSF160 in Figure 1), since the person's location is associated with the location of camera 136.

[0047]

[0051] In the controller 306, information may be preprocessed to determine how the signal should be handled by the camera 136. For example, in some embodiments, a certain movement may be detected by the camera 136 itself and alert the anti-theft system 170, and only such detected movements may be transmitted to the anti-theft system 170.

[0048]

[0052] Similar to Figure 2A, memory 308 may be volatile memory and / or non-volatile memory. For example, memory 308 may include, but is not limited to, RAM, DRAM, ROM, and flash memory. Memory 308 may also comprise non-secure memory and / or secure memory. The phrase “non-secure memory” as used herein refers to memory configured to store data in plain text format. The phrase “secure memory” as used herein refers to memory configured to store data in encrypted format, and / or memory having or being housed in a secure or tamper-proof enclosure.

[0049]

[0053] The data collected by camera 136 can then be passed to the anti-theft system 170 via interface 360, which transmits data to and from network 110.

[0050]

[0054] Referring next to Figure 3, an exemplary anti-theft system 170 is shown. The anti-theft system 170 includes a computer / server 128. The computer / server 128 may include an interface 312, a processor 314, memory 316, a module for determining the likelihood of theft ("theft determination module") 318, a communication module 321, a default theft action 322, and a default tag trigger 324.

[0051]

[0055] The processor 314 is configured to execute computer-readable instructions stored in memory 316 to perform one or more method steps as described in Figure 4. For example, the processor 314 is configured to read and execute instructions from memory 316 for the theft determination module 158. Each of the steps described herein can be programmed to cause the anti-theft system 170 to perform the specific steps described herein.

[0052]

[0056] The software programs for the communication module 321 and the theft determination module 318 may be stored in the memory of the computer / server 128, or on a computer / server on the network remotely from the store 160, or in the database 140.

[0053]

[0057] The communication module 321 is configured, as described herein, to communicate data between systems (e.g., the anti-theft system 170, the database 140, the POS device 102, etc.). For example, the communication module 321 is configured to connect the anti-theft system 170 to the PS system 102 via the network 110 using a network protocol to transmit data commanded by the processor 314.

[0054]

[0058] The theft determination module 318 is configured to perform the steps shown in Figure 4 to determine whether a theft is in progress or is highly likely to occur in the future. The theft determination module 318 processes the data received by the camera 136 and the reader 138 and compares such data with the default theft action 322 and / or default tag trigger 324 to determine whether a theft is likely.

[0055]

[0059] The theft determination module 318 may be invoked by the processor 314 to perform one or more functions as detailed in Figure 4.

[0056]

[0060] Default theft actions 322 are customer movements that are likely to be identified as theft. These default theft actions 322 may be known movements and may be updated using a learning model based on historical and ongoing data. Examples of such movements are described above herein.

[0057]

[0061] The default tag trigger 324 is also described herein as an example of an event that is likely to trigger the anti-theft system 170 to identify a theft action. For example, trigger 322 relates to tampering with the tag 122 in order to remove or deactivate it.

[0058]

[0062] In this regard, the theft determination module 318 uses the image and sensor data / tag data together with the default theft action 322 and / or default tag trigger 324 to determine whether theft is likely.

[0059]

[0063] The default theft actions 322 and / or default tag triggers 324 can be continuously updated and may be continuously done using AI technology and / or learning models.

[0060]

[0064] If the theft determination module 318 identifies a high probability of theft, it sends a notification to store employees and provides warnings through audible, visual, or other types of alerts. Furthermore, the theft determination module 318 can directly notify customer 114 so that the customer can make an immediate decision to return the item 118 or to pay for the item 118. In this regard, customer 114 does not experience embarrassment in front of others or store employees, and there is no damage to their belongings or loss to the store.

[0061]

[0065] The system identifies potential theft by customers well before they reach the checkout area, so it avoids causing a disturbance or dramatic situation in the store, resulting in a smoother and more satisfying customer experience.

[0062]

[0066] Referring now to Figure 4, a flowchart of an exemplary method 400 for providing store intelligence is provided. Method 400 may be implemented in System 100 and relates to preventing the theft of goods (e.g., goods 118 in Figure 1) placed in locations (e.g., shelves or other display equipment) within a facility (e.g., RSF 160 in Figure 1) that a person has access to. The goods are fitted with security tags (e.g., security tag 122 in Figure 1). The security tag 122 may be the same as described above and may be an RFID tag configured to be read by a reader (e.g., reader 138 in Figure 1).

[0063]

[0067] Method 400 begins in block 402, where data is received from one or more cameras indicating that a person has picked up an item in the store. In some embodiments, only cameras within the range of view of the item record image data.

[0064]

[0068] In block 404, data from security tag 122 is received from the reader. The data read may be the tag ID and the operational status of tag 122. However, it should be noted that in some embodiments, tag 122 should not be limited to transmitting only the tag ID and the operational status of the tag, but may include other data. In fact, the security tag may be a plurality of sensors disposed therein, and the sensors may include, but are not limited to, proximity sensors, temperature sensors, accelerometers, liquid sensors, light sensors, magnetic field sensors, and / or location sensors. This sensor data may relate to the movement of the security tag, changes in the light state of the environment around the security tag, changes in the temperature of the ambient environment, changes in the amount of fluid / liquid contained in the ambient environment, and / or changes in the magnetic field generated by the security tag. Thus, tag 122 may transmit a variety of other associated data.

[0065]

[0069] In any event, the tag data and image data are sent to the anti-theft system 170 for processing, as provided in block 406. Note that more than one reader may read the tags and send the tag data for processing. Similarly, note that more than one camera may capture images of a person's movement and send the image data for processing.

[0066]

[0070] In some embodiments, block 404 may occur first, triggering block 402. Specifically, once it is determined that the tag has been moved, data from the camera is received to determine whether the customer's movement is abnormal behavior.

[0067]

[0071] Next, in 406, the unique identifier of the security tag and / or the unique identifiers of the reader 138 and camera 136 are communicated to the anti-theft system 170, along with the tag data and image data associated with the movement of the tag and the person, respectively. The unique identifier of the reader and / or the unique identifier of the camera are sent to determine the current location of the security tag and / or the person associated with it. This disclosure is not limited to this technique for tracking the location of the security tag. In other scenarios, other location determination techniques (e.g., triangulation) may be used as an addition or alternative. The tag data / sensor data, image data, and / or unique identifiers may be sent to the anti-theft system 170 via a proximity system (e.g., proximity system 123 in Figure 1) or via an intermediary computing device.

[0068]

[0072] In the anti-theft system 170, tag data / sensor data, image data, and / or unique identifiers are processed in step 408 to determine whether the security tag 122 is in a theft situation of a predictable nature. Next, a decision block 410 is performed to determine whether there is any abnormal behavior in the movement of the security tag or a person.

[0069]

[0073] First, the system determines whether the security tag has been moved. If the security tag has not been moved, the system examines the image data to determine whether the person's movement is abnormal (as described later in this specification). If the security tag has been moved, the anti-theft system 170 determines whether the movement of the security tag is normal or abnormal. The decision may be based on the current orientation of the security tag, the speed and direction of the security tag's movement (e.g., relatively fast downward movement of the security tag may indicate an attempt to disable the security tag, such as slamming it against a hard surface), the pattern of the security tag's movement over a given time period (e.g., a rapid change in the height of the item may indicate that a person running or walking relatively fast is holding the item), and / or the relative heights of different parts of the security tag (e.g., a difference in height between the two ends of the security tag relative to the central part of the security tag may indicate that an attempt to disable the security tag, such as bending or deforming it, has occurred). Pre-stored thresholds and / or sensor data patterns (e.g., accelerometer data patterns) may be used in comparison operations to distinguish between normal and abnormal movement.

[0070]

[0074] If the movement of the security tag is determined to be abnormal, the method, following block 412, issues an alarm for the security tag and takes other actions to warn the store and / or the person 114 performing such abnormal action. Further actions may also be taken, including (1) capturing an image of the person holding the goods, (2) informing store staff of the abnormal movement by sending an electronic message, emitting a specific sound through a speaker system, and generating a visual warning, and / or (3) dispatching store staff to the area of ​​the facility where the person is located. After block 412, method 400 returns to block 402.

[0071]

[0075] In contrast, if the movement of the security tag is normal, method 400 uses camera and image data to determine whether the person's movements are normal. For example, as part of block 410, method 400 determines whether the security tag is hidden, shielded, or placed in a metal-plated bag. This determination may be based on (1) sensor data identifying changes in the light and / or temperature conditions of the environment surrounding the security tag, and / or (2) sensor data indicating a degradation in the security tag's performance.

[0072]

[0076] If the security tag is hidden / concealed / placed in a metal bag, block 412 is performed as described above to alert the store and / or person 114. If the security tag alarm is triggered, the alarm may be deactivated when the security tag is removed from the means of concealment / concealment or from the metal-covered bag.

[0073]

[0077] If the security tag is not hidden / shielded / placed in a metal bag, system 170 determines whether the security tag is located in or heading toward a high-risk location (e.g., exit 130, checkout area 109, restroom, or fitting room), which indicates a higher likelihood of theft than not having moved to the next step. If the security tag is located in or heading toward a high-risk location, such action is determined to be abnormal, and block 412 is performed.

[0074]

[0078] If security tag 122 is not located in or heading toward a high-risk location, the system determines whether an attempt has been made to disable the security tag. For example, to disable it, the security tag may be placed in a liquid (e.g., water) or exposed to high temperatures. Therefore, the determination may be made based on whether the tag has been removed, deactivated, damaged and thus stopped transmitting tag data, or based on sensor data indicating a change in the amount of liquid in the surrounding environment and / or an increase in the ambient temperature.

[0075]

[0079] The above relates to abnormal behavior using tag data / sensor data. If any of the above actions are detected, system 170 may use image data from the camera to supplement or be part of the decision process regarding whether the behavior is abnormal. In this regard, if the tag data indicates abnormal behavior of the tag, system 170 may review the movements of the person 114 carrying the tag to determine whether the person's movements or actions are abnormal. Thus, in some embodiments, the system determines that an overall abnormal behavior has occurred only if both the tag data and the image data indicate abnormal behavior, and method 400 proceeds to block 412.

[0076]

[0080] To determine if there is any abnormal behavior using camera data, system 170 uses image data to determine the movement of person 114 regarding whether such movement is abnormal. As described above, the range of abnormal behavior may include a person moving to a high-risk location. In some embodiments, the range of abnormal behavior may include observing the arm movements of a person holding product 118. For example, a person places the item in a handbag, jacket, or school bag, etc., in a concealed manner, rather than placing the item in a cart.

[0077]

[0081] As another example, a camera might monitor an item, and the image data might indicate that item 118 has been moved, but tag data identifying the tag associated with that item might show that tag 122 has not been moved. Therefore, the image data and tag data can then be combined to form a system where the data together indicates that the tag was removed from the item because it was moved without a tag before it was purchased, and that this is an anti-theft triggering event in the store's sales area 105 (i.e., before reaching the checkout area 109).

[0078]

[0082] The camera uses image data to capture this movement and processes the image to determine that the user is hiding an object.

[0079]

[0083] In some embodiments, a person's movements may be compared to a predetermined theft action that has been stored. If it is determined that an item has been stolen, the movements of the person who stole the item may be analyzed and stored as a predetermined theft action for future use, so that future movements of a person in the store that match such a predetermined theft action will trigger a theft alarm. For example, if a person stands by a shelf, grabs an item, looks around for 30 seconds to see if anyone is watching, and then steals the item, then any person who makes the same movements in the future will trigger such a theft alarm.

[0080]

[0084] Furthermore, the artificial intelligence (AI) model can learn predetermined theft behaviors, which are supplied and constantly updated. Therefore, as thieves change their behavior to try and outmaneuver the store's systems, the predetermined theft behaviors are constantly modified and understood based on changing and new behaviors. In this regard, the predetermined theft behaviors are updated using the AI ​​learning model. Similarly, the AI ​​learning model also updates default tag triggers based on previous actions that the model has determined to be theft activities and events.

[0081]

[0085] Furthermore, the AI ​​model can be updated using other data from other stores. The AI ​​model compares known theft data from both security camera footage and in-store activity identified through RFID tracking, updates the model and data accordingly, and immediately applies these new models to the current in-store algorithm to determine whether theft is likely to occur while within the store's sales area.

[0082]

[0086] It is important to understand that the AI ​​model will identify common behavioral patterns of thieves before they enter a store and while they are moving around the store. Once these behavioral patterns are identified in real time, the system will alert store security personnel via mobile devices.

[0083]

[0087] The goods may or may not be purchased, leased, or borrowed by the person. If the purchase, lease, or borrowing of the goods is unsuccessful, block 448 is performed, in which method 400 returns to step 402, and monitoring of the goods, person, and / or tag continues. If the purchase, lease, or borrowing of the goods is successful (as determined by block 411), some information indicating the success of the transaction is communicated from system 170 to the security tag. The security tag then performs actions to deactivate itself and / or remove itself from the goods, as shown in block 414.

[0084]

[0088] Therefore, the idea described herein involves observing patterns of movement within the store's sales area 105 before a person reaches checkout or attempts to leave the store. In fact, as stated above, the first step is to learn patterns comparing normal shoppers who intend to go to checkout to purchase products with shoppers who attempt to leave the store with their goods without approaching the checkout area. Once patterns(s) of movement that are likely to lead to theft are identified, these patterns can be flagged and alert responding security personnel even before they reach the front of the store or near checkout. The advantages are that 1) prevention can begin well earlier in the journey, and 2) it is not necessary to leave the handling of the situation to sales staff or cashiers.

[0085]

[0089] In this regard, the Disclosure includes a model in which reader 138 both tracks that a product has been moved (and associates before and after video with that particular one if it has ultimately been stolen) and tracks the RFID of an item that has been moved from the shelf, triggers a camera to review / view before / after / in-progress footage of that item, and signals security system 170 to begin scrutinizing the RFID pattern to determine whether the item has been stolen. This can be done for all selected items to be purchased and continues from the moment a person selects an item until the item reaches checkout area 109, rather than when the item enters checkout area 109.

[0086]

[0090] In some embodiments, instead of issuing a warning to stop theft, the system 170 may ask a person via an electronic device whether they want to buy the items now or put the items in a cart, thereby letting the person know that the store is aware that the person is attempting to steal the items, or whether they have at least accidentally performed an action that triggers an event, thereby allowing the person to correct such behavior before arriving at the checkout area 109.

[0087]

[0091] Unless the context clearly indicates otherwise, the words “comprise,” “comprising,” and similar terms throughout the specification and claims should be interpreted in a comprehensive sense, i.e., “including, but not limited to,” as opposed to an exclusive or exhaustive sense. As used herein, the terms “connected,” “combined,” or any variation thereof, mean any direct or indirect connection or combination between two or more elements, and such combination of connections between elements may be physical, logical, or a combination thereof. Furthermore, as used herein, the words “in this specification,” “above,” “below,” and similar terms should refer to the entire application, rather than any specific part thereof. Also, where the context permits, words using singular or plural numbers in modes for carrying out the above inventions may each include plural or singular numbers. The word “or,” when referring to a list of two or more items, encompasses all interpretations of that word, i.e., any item in the list, all items in the list, and any combination of items in the list.

[0088]

[0092] The embodiments for carrying out the above-described inventions in this disclosure are not intended to be exhaustive, nor is this disclosure intended to limit the disclosure to the embodiments disclosed above. Specific embodiments of this disclosure and examples relating to this disclosure are given above for illustrative purposes, but as those skilled in the art will recognize, various equivalent modifications are possible within the scope of this disclosure. For example, while processes or blocks are presented in a given order, alternative embodiments may perform routines having steps in a different order, or use systems having blocks, and some processes or blocks may be deleted, moved, added, subdivided, combined, and / or modified to provide alternative combinations or subcombinations. Each of these processes or blocks may be implemented in various different ways. Also, while processes or blocks are sometimes shown as being performed sequentially, these processes or blocks may instead be performed in parallel or at different times. Furthermore, any specific number described herein is merely an example, and alternative implementations may use different values ​​or ranges.

[0089]

[0093] The teachings of this disclosure provided herein may be applied to other systems and may not necessarily be applied to the systems described above. The elements and operations of the various embodiments described above may be combined to provide further embodiments.

[0090]

[0094] Any of the above-mentioned patents and applications, including any that may be cited in the attached application documents, and other references are incorporated herein by reference. Aspects of this disclosure may be modified, where necessary, to utilize the systems, functions, and concepts of the various references described above to provide further embodiments of this disclosure.

[0091]

[0095] These and other modifications may be made to the Disclosure in light of the modes for carrying out the above invention. While the above description describes certain embodiments of the Disclosure and the best intended mode, the Disclosure can be carried out in many ways, regardless of how much it is detailed above. Details of the system may vary considerably in the details of its implementation, but are still encompassed by the Disclosure disclosed herein. As stated above, any specific terminology used when describing certain features or aspects of the Disclosure should not be interpreted as implying that the terminology is redefined herein to be limited to any particular characteristic, feature, or aspect of the Disclosure to which the term relates. In general, the terms used in the following claims should not be interpreted as limiting the Disclosure to the specific embodiments disclosed herein unless such terms are explicitly defined in the section on modes for carrying out the above invention. Thus, the actual scope of the Disclosure includes not only the disclosed embodiments but also all equivalent ways of carrying out or implementing the Disclosure under the claims.

[0092]

[0096] While certain aspects of this disclosure are presented below in the form of certain claims, the inventors intend to express various aspects of this disclosure in any number of claim forms. For example, only one aspect of this disclosure may be described as a means-plus-function claim under § 112(f) of the U.S. Patent Act, but other aspects may similarly be expressed as means-plus-function claims or in other forms, such as being expressed in a computer-readable medium (any claim intended to be treated under § 112(f) of the U.S. Patent Act begins with the words “means for”. Accordingly, the inventors reserve the right to add additional claims after filing of this application in order to pursue such additional claim forms for other aspects of this disclosure.

Claims

1. The camera receives image data of a person selecting products in the store's sales area, The reader receives the tag data of the tag associated with the aforementioned product, An electronic device located at a distance from the aforementioned product uses the tag data and image data to determine whether any abnormal handling has occurred to the product and tag within the sales area. In response to the electronic device determining that the product and the tag have been handled abnormally, the facility may selectively perform actions to ensure security. A method for providing this.

2. The method according to claim 1, wherein the selective action is performed in response to the determination that the product has been moved using the image data, but the tag data indicates that the tag has been removed or deactivated and that the tag has not been moved.

3. The method according to claim 1, further comprising using the tag data to determine that the tag has moved to a new location, indicating that the product has been selected, activating the camera to monitor the product, and determining whether the behavior of the person in the vicinity of the product is abnormal.

4. The method according to claim 1, wherein the selective action includes, if it is determined that the tag is currently being moved in an abnormal manner, the electronic device selectively performs an action to ensure the security of the facility.

5. The method according to claim 1, wherein the selective action is performed by the electronic device when it is determined that the goods are currently being moved in an abnormal manner.

6. The method according to claim 1, further comprising providing pre-stored product-related information from the tag to a mobile communication device when it is determined that the tag has not been moved in an abnormal manner or in response to the receipt of a query.

7. The method according to claim 1, wherein the action to ensure the security of the facility includes one of the following actions: issuing an alarm for the tag, capturing an image of a person possessing the tag, notifying a store employee of the abnormal movement of the tag, or dispatching a store employee to a location within the facility where the tag is located.

8. To determine whether the tag is hidden or deactivated, the electronic device analyzes the tag data or the image data, If it is determined that the aforementioned tag is hidden or deactivated, the electronic device may selectively perform actions to ensure the security of the facility. The method according to claim 1, further comprising:

9. The electronic device analyzes the tag data or image data to determine whether the tag is located in a high-risk location of the facility or is moving toward a high-risk location. When it is determined that the tag is located in or heading toward a high-risk location within the facility, the electronic device selectively performs actions to ensure the security of the facility. The method according to claim 1, further comprising:

10. The method according to claim 1, further comprising using a learning model to continuously update a default tag trigger and a predetermined theft action.

11. The method according to claim 10, comprising comparing the tag data with a predetermined tag trigger and comparing the image data with a predetermined theft operation in order to determine the likelihood of a theft event.

12. Cameras within the store's sales area, Tags associated with the aforementioned products in the aforementioned sales area of ​​the store, Processor and The processor is equipped with, The camera receives image data of the person who has selected the aforementioned product, The reader receives the tag data of the tag associated with the aforementioned product, Using both the tag data and the image data, determine whether any abnormal handling has occurred to the products and tags within the sales area. In response to the determination that the aforementioned product and tag have been subjected to abnormal handling, selective actions will be taken to ensure the security of the facility. A system configured to perform the following actions.

13. The system according to claim 12, wherein the selective action includes, when it is determined that the security tag is currently being moved in an abnormal manner, an electronic device selectively performs an action to ensure the security of the facility.

14. The system according to claim 12, wherein the selective action includes, when it is determined that the image data is currently being moved in an abnormal manner, the electronic device selectively performs an action to ensure the security of the facility.

15. The system according to claim 12, wherein the processor is further configured to provide pre-stored product-related information from the security tag to a mobile communication device when it is determined that the security tag has not been moved in an abnormal manner or in response to the receipt of a query.

16. The system according to claim 12, wherein the operation for ensuring the security of the facility comprises issuing an alarm for the security tag, capturing an image of the person possessing the security tag, notifying a store employee of the abnormal movement of the security tag, or dispatching a store employee to the location within the facility where the security tag is located.

17. The aforementioned processor, To determine whether the security tag is hidden or deactivated, the electronic device analyzes the tag data or the image data, If it is determined that the security tag is hidden or deactivated, the electronic device will selectively perform actions to ensure the security of the facility. The system according to claim 12, further configured to perform the following:

18. The electronic device analyzes the tag data or image data to determine whether the security tag is located in a high-risk location of the facility or is moving toward a high-risk location. When it is determined that the security tag is located in or heading toward a high-risk location within the facility, the electronic device selectively performs actions to ensure the security of the facility. The system according to claim 12, further comprising the above.

19. The system according to claim 12, further comprising using a learning model to continuously update a default tag trigger and a predetermined theft action.

20. A non-temporary computer-readable medium that, when executed by a processor, The system receives image data of a person selecting a product from a camera and tag data associated with the product from a reader. Using both the tag data and the image data, it is determined that a theft event occurred when the item was within the store's sales area but before the item approached the store's checkout area. In response to the determination that the aforementioned product and tag are currently being operated in an abnormal manner, selective actions are taken to ensure the security of the facility. A non-temporary computer-readable medium that performs a method comprising [a certain characteristic].

Images