Surveillance system and method

Abstract

The product monitoring system includes at least one Near Field Communication (NFC) reader associated with the storage device; and a control system including a processor, a memory, and a communications interface, wherein the control system is in communication with the one or more NFC readers, the memory having executable instructions stored therein, and the processor is configured, without human intervention and through execution of the executable instructions, to control the one or more NFC readers to read one or more NFC labels associated with one or more products stored by the storage device; receive from the one or more NFC readers product identification data identifying one or more products stored by the storage device; compare the product identification data with inventory data stored in the memory to determine at least one product that has been retrieved from the storage device, the inventory data indicating a most recently determined inventory of the storage device; and forward order data via the communications interface to a server processing system to order at least one new product to replace the at least one product that has been retrieved from the storage device.

Description

[Technical field]

[0001] The present invention relates to a product monitoring system and method, and more particularly to monitoring products in enclosed environments.

[0002] The invention has been developed primarily for use in monitoring one or more products stored in a refrigerator and identifying one or more products removed from the refrigerator over time, and will be described below with reference thereto, although it will be appreciated that the invention is not limited to this particular application. [Background technology]

[0003] Some refrigerators have been developed that allow a user to scan a barcode when placing a new product therein for storage. Additionally, such refrigerators allow the user to scan the barcode of a product after the product has been completely consumed. The scanned information can then be used to place an order to replenish the consumed product.

[0004] While it is possible to manually track products in these types of refrigerators, there are several drawbacks. In particular, the user must remember to scan the barcode in each of these scenarios. If the user forgets to actively scan the product's barcode, the order cannot be placed. Such systems have not been widely adopted by consumers because it can be very cumbersome for the user to operate the refrigerator's scanning device when products are placed in or removed from the refrigerator. This process can be a time-consuming task, as the barcode must be aligned with the scanning device, leading to either the initial or subsequent scanning steps being skipped by the user.

[0005] Such problems also exist in other types of storage devices such as pantries, vending machines, and storage cabinets. This includes monitoring the location of products when removed, e.g., not only removing products from a refrigerator, but also monitoring where the products have been moved. Additionally, conventional systems having multiple antennas for RF tag detection are known to suffer from interference with other antennas and reduced tag reading performance within range.

[0006] It is an object of the present invention to substantially overcome, or at least ameliorate, one or more of the disadvantages of existing systems, or to provide a useful alternative. Summary of the Invention

[0007] According to one aspect of the present invention, there is provided a product surveillance system, comprising: at least one Near Field Communication (NFC) reader associated with the storage device; A control system including a processor, a memory, and a communications interface, the control system in communication with each NFC reader, the memory storing executable instructions, and the processor, without human intervention and through execution of the executable instructions, controlling each NFC reader to read one or more NFC labels associated with one or more products stored by the storage device; receiving, from each NFC reader, product identification data identifying one or more products stored by the storage device; comparing the product identification data to inventory data stored in the memory to determine at least one product that has been removed from the storage device, the inventory data indicating a most recently determined inventory of the storage device; and a control system configured to transmit, via the communication interface, the order data to the server processing system to order at least one new product to replace the at least one product retrieved from the storage device; a control system including a primary controller in communication with each NFC reader, an antenna switch, and at least one antenna array such that each antenna is selectively detunable; A product monitoring system is provided in which a plurality of product locations each have an associated product sensor, each antenna being associated with a plurality of product locations, and in response to a product sensor detecting the insertion or removal of a product from a product location, all antennas not associated with that product location are detuned or deactivated, and the associated antennas record product details from their associated tags, whereby the product identification data collectively represents the identification data which is compared by a processor to inventory data to determine at least one product that has been removed from the storage device.

[0008] In a preferred embodiment, each NFC reader includes multiple antennas, the multiple antennas of each NFC reader being spaced apart from one another and forming part of an antenna matrix.

[0009] In a preferred embodiment, the antenna matrix is ​​integrated with a rack or shelf that supports one or more products, the rack or shelf including a plurality of support members defining a plurality of storage locations, each storage location configured to store a single product, and the antenna matrix is ​​integrated with the plurality of support members.

[0010] In a preferred embodiment, the plurality of support members includes a plurality of substantially vertical support members and a plurality of substantially horizontal support members.

[0011] In a preferred embodiment, to control one or more NFC readers to read one or more NFC labels, the processor is configured to sequentially control different portions of the antenna matrix to read any products located within their respective locations on the storage device, where the control system memory stores location data indicating a location for each of the different portions of the antenna matrix; in response to the sequential control of the different portions of the antenna matrix, receive a plurality of product identification data portions, where the plurality of product identification data portions collectively represent identification data; and determine a location of each identified product stored within the storage device using the plurality of product identification data portions and the location data.

[0012] In a preferred embodiment, the processor is further configured to receive, via the communications interface, a product location request, and transmit, via the communications interface, a location of each identified product stored in the storage device.

[0013] In a preferred embodiment, the processor is further configured to update the inventory data based on the identified at least one identified product retrieved from the storage device.

[0014] In a preferred embodiment, the processor is further configured to identify one or more new products stored in the storage device based on a comparison of the product identification data and the inventory data, and to update the inventory data stored in the memory to indicate the one or more new products.

[0015] In a preferred embodiment, the processor is further configured to periodically control the one or more NFC readers to read one or more NFC labels associated with one or more products stored by the storage device.

[0016] In a preferred embodiment, in response to determining that the at least one product has been removed from the storage device, the processor is further configured to transmit, via the communications interface, a notification indicating that the at least one product has been removed from the storage device.

[0017] In a preferred aspect, there is provided a system including a product monitoring according to the first aspect and a storage device, the storage device being a refrigerator including a door having an electrically operable lock operable between a locked state in which the door is restricted from being opened and an unlocked state in which the door is not restricted from being opened, and a processor of a control system of the product monitoring system is further configured to receive user identification data of a user attempting to open the refrigerator door, use the user data stored in the memory to determine whether the user is authorized to open the lockable door, and in response to determining that the user is authorized, control the lock to transition from the locked state to an unlocked state such that the user can open the door and access one or more products stored in the refrigerator.

[0018] In a preferred embodiment, the one or more products are one or more wine bottles.Preferably, the refrigerator includes an input device for receiving user identification data from a user, and the control system receives the user identification data from the mobile communication device via the communication device.

[0019] In a preferred embodiment, the system includes a mobile communication device having a biometric sensor, the mobile communication device configured to capture biometric data of a user via the biometric sensor, and user identification data generated by the mobile communication device based on the biometric data.

[0020] In a preferred embodiment, the processor is further configured to: determine one or more product types of one or more products stored in the refrigerator based on the product identification data; query temperature storage data accessible to the control system using the product types of the one or more products stored in the refrigerator to determine one or more desired storage temperatures for the one or more products, where the product storage temperature data indicates a plurality of desired temperatures for the plurality of product types; and control an operating temperature of the refrigerator, or a portion of the refrigerator, in accordance with the one or more desired storage temperatures.

[0021] In a preferred embodiment, the processor is further configured to: determine one or more product types of one or more products stored in the refrigerator based on the product identification data; query temperature serving data accessible to the control system using the one or more product types of the one or more products stored in the refrigerator to determine one or more desired serving temperatures for the one or more products, where the product serving temperature data indicates multiple desired temperatures for the multiple product types; and control an operating temperature of the refrigerator, or a portion of the refrigerator, based on the one or more desired serving temperatures.

[0022] In a preferred embodiment, the system includes a server processing system, the server processing system including a data repository storing the profile data, and the server processing system configured to determine at least one new product based on the profile data and the order data.

[0023] In a preferred embodiment, the server processing system modifies the profile data based on the order data.

[0024] It can thus be seen that the present invention advantageously enables the determination of location by reading product RF tag data where the product RF tag does not have a predefined or precise alignment and can be placed at any desired point. Neither the product nor its RF tag need have any specific orientation or antenna alignment.

[0025] Preferred embodiments of the present invention will now be described, by way of example only, with reference to the accompanying drawings, in which: [Brief description of the drawings]

[0026] [Figure 1] FIG. 1 is a functional block diagram of an example system including a product monitoring system for monitoring products stored by a storage device. [Diagram 2] 2 is a flowchart illustrating an example product monitoring process performed by the product monitoring system of FIG. 1. [Diagram 3] 1 is a schematic of an example system, including a product monitoring system, for identifying products stored by a storage device. [Figure 4A] 1 is a schematic of an example of a storage device provided in the form of a refrigerator including an example of a product monitoring system; [Figure 4B] 4B is a schematic of an example of a first support member of the storage device of FIG. 4A. [Figure 4C] 4B is a schematic of an example of a second support member of the storage device of FIG. 4A. [Diagram 5] FIG. 1 is a schematic diagram of a system for monitoring stored products in accordance with a second preferred embodiment; [Figure 6] 6 is a flowchart of the operation of the system of FIG. 5. [Figure 7] FIG. 6 is a schematic diagram of an arrangement of products according to the embodiment of FIG. 5. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] In order to provide a more precise understanding of the subject matter of the preferred embodiment or embodiments, the following aspects, given by way of example only, are described: In the figures incorporated to illustrate features of the exemplary embodiments, like reference numerals are used to identify like parts throughout the figures.

[0028] Referring to FIG. 1, an exemplary system 100 is shown that includes a product monitoring system 105 that includes one or more Near Field Communication (NFC) readers 160, and a control system 107. The one or more NFC readers 160 are associated with a storage device 180 for storing one or more products 190. The control system 107 is in communication with the NFC reader 160. The control system 107 is a computerized control system 107 that includes at least one processor 110, at least one memory 120, and a communication interface 150 coupled together via a bus 140. The memory 120 stores executable instructions that are executed by the processor 110 to perform the product monitoring process. The system 100 also includes a server processing system 170 that communicates with the product monitoring system 105 via the communication interface 150. In one particular embodiment, the server processing system 170 and the communication interface 150 of the product monitoring system 105 communicate via one or more computer networks 360, such as a wide area network such as the Internet.

[0029] Each product 190 has an NFC label 195 associated with it. For example, the NFC label 195 may be adhered to an exterior surface of the product 190. In a particular embodiment, each product 190 is a bottle of wine, and the NFC label 195 is adhered to an exterior surface of the wine bottle 190. In one particular form, the storage device 180 is a refrigerator, such as a wine refrigerator. In a particular embodiment, the wine refrigerator 180 may be a multi-zone wine refrigerator 180, where different portions or zones of the wine refrigerator 180 have different operating temperatures.

[0030] Referring to Figure 2, a flow chart is shown depicting a product monitoring process 200 performed by the product monitoring system 105 of Figure 1. In particular, at step 210, the product monitoring process 200 includes the processor 110 controlling one or more NFC readers 160 to read one or more NFC labels 195 associated with one or more products 190 stored by the storage device 180.

[0031] At step 220 , the product monitoring process 200 includes the processor 110 receiving product identification data from the one or more NFC readers 160 that identifies one or more products 190 stored by the storage device 180 .

[0032] In step 230, the product monitoring process 200 includes the processor 110 comparing the product identification data to inventory data stored in memory 120 to determine at least one product that has been removed from the storage device 180, the inventory data indicating a most recently determined inventory of the storage device 180.

[0033] In step 240, the product monitoring process 200 includes transmitting order data via the communication interface 150 to the server processing system 170 to order at least one new product to replace the at least one product retrieved from the storage device 180. The server processing system 170 can dispatch the at least one product to a location of the storage device 180.

[0034] The product monitoring process 200 is executed by the processor 110 without human intervention. This is highly advantageous because the user does not need to align a scanning device to scan the barcode of a product removed from the storage device 180. Rather, the control system 107 automatically controls one or more NFC readers 160 located in one or more storage locations 182 of the storage device 180 to read the identification data of each product 190 located therein, without human intervention. Thus, the user can remove a product 190 from the storage device 180, and the control system 107 is configured to automatically scan any products 190 remaining in the storage device 180, without the user providing any input or instructions to the product monitoring system 105.

[0035] In a preferred embodiment, the product monitoring process 200 is executed repeatedly. For example, the processor 110 is configured to execute the product monitoring process 200 after a predetermined period of time (e.g., 30 seconds) has elapsed since the most recent execution of the product monitoring process 200.

[0036] The processor 110 is further configured to update the inventory data stored in the memory 120 based on the at least one identified product retrieved from the storage device 180. The processor 110 of the control system 107 may also maintain historical inventory data indicative of changes in inventory over time.

[0037] It will be appreciated that the above process 200 may similarly operate to identify one or more new products 190 located within the storage device 180. Advantageously, the product monitoring process 200 performed by the product monitoring system 105 operates without human intervention such that the one or more new products 190 are identified without human input immediately after the one or more new products 190 are located within the storage device 180. In particular, the processor 110 of the control system 107 is configured to identify the one or more new products 190 stored in the storage device 180 based on a comparison of the product identification data to the inventory data, and to update the inventory data stored in the memory 120 to indicate the one or more new products 190.

[0038] 3, a more specific functional block diagram of system 100 is shown, including product monitoring system 105. Product monitoring system 105 includes the components described with respect to FIGURE 1 and will not be described again for purposes of clarity. However, product monitoring system 105 includes additional components or sub-components, as described in more detail below.

[0039] The product monitoring system 105 includes a plurality of NFC readers 160, each of which includes a plurality of antennas 312, 322. Each of the NFC readers 160 includes an NFC chip 318, 328 coupled to a plurality of antennas 312, 322 spaced apart from one another. The plurality of antennas 312, 322 of the plurality of NFC readers 160 collectively form an antenna matrix 395. As shown in Figures 4A, 4B, and 4C, the antenna matrix 395 is integrated with a rack or shelf (see Figures 4A, 4B, and 4C) located within the storage device 180 that supports one or more products 190. The antenna matrix 395 effectively forms a three-dimensional antenna. As shown in Figures 4A, 4B and 4C, the rack or shelf includes a plurality of support members 310, 320 that define a plurality of storage locations 182, each storage location 182 structured and sized to store a single product 190. The support members may have a board profile. An antenna matrix 395 is integrated with the plurality of support members of the rack or shelf. The plurality of support members includes a plurality of substantially vertical support members 320 and a plurality of substantially horizontal support members 310.

[0040] Returning to FIG. 3 , the control system 107 includes a primary controller 305 in communication with a plurality of first microcontrollers 319 and a plurality of second microcontrollers 329. In one example, the primary controller 305 may be provided in the form of a Raspberry Pi controller. In one embodiment, the plurality of first microcontrollers 319 and the plurality of second microcontrollers 329 may be provided in the form of a plurality of Arduino microcontrollers. It will be understood that other controllers and microcontrollers may be used. Each first microcontroller 319 is in communication with a respective first multiplexer 318, which in turn is in communication with a row of antennas 314a-314d of the antenna matrix 395. Each second microcontroller 329 is in communication with a respective second multiplexer 328, which in turn is in communication with a column of antennas 324a-324f of the antenna matrix 395.

[0041] The primary controller 305 is configured to forward a read command to each of the first and second microcontrollers 319, 329, which control the respective rows of antennas 314a-314d and columns of antennas 324a-324d via respective first and second multiplexers 318, 328 to read one or more NFC labels 195 of one or more products 190. Each of the first and second microcontrollers 319, 329 forwards row product identification data and column product identification data to the primary controller 305, which collectively represent identification data that is compared by the processor 110 of the primary controller 305 to inventory data stored in the memory 120 of the primary controller 305 or accessible by the primary controller 305 to determine at least one product 190 that has been retrieved from the storage device 180.

[0042] Each NFC reader 160 including multiple antennas allows a significantly larger coverage area to be covered with a smaller number of NFC chips 318, 328. In particular, the product monitoring system 105 includes many more storage locations that can be read individually compared to the number of NFC chips 318, 328. For example, in FIG. 4A, the refrigerator includes 24 storage locations that can be read by 10 NFC chips.

[0043] Further, each NFC reader 160 including multiple antennas 314, 324 allows selective reading of specific product storage locations of the storage device 180. In particular, to selectively read the multiple one or more NFC labels 195, the processor 110 of the control system 107 is configured to sequentially control different portions of the antenna matrix 395 to read any products located within the respective locations of the storage device 180, and the memory 120 of the control system 107 stores location data indicative of the location of each different portion of the antenna matrix 395. The processor 110 is then configured to receive a plurality of product identification data portions in response to sequentially controlling the different portions of the antenna matrix 395, the plurality of product identification data portions collectively representing identification data.

[0044] The processor 110 is then configured to determine a location of each identified product stored in the storage device 180 using the multiple product identification data portions and the location data. In one embodiment, the processor 110 is further configured to receive a product location request via the communication interface 150 and to transfer the location of one or more products stored in the storage device 180 via the communication interface 150. In one embodiment, a user operating a mobile communication device 370 having a computer program 375 (i.e., an "app") stored in the memory 120 may be presented with a user interface presenting a list of products stored in the refrigerator 180. The user may select one of the products from the user interface, and in response, the mobile communication device 370 generates a product location request that is transferred to the control system 107 of the product monitoring device 105 via the communication interface 150. As described above, after determining the location of the selected product, the processor 110 of the control system 107 transfers the location of the selected product to the mobile communication device 370 via the communication device 150. In response, the user interface of the mobile communication device 370 may present a graphic indicating the location of the selected product 190 within the refrigerator 180 .

[0045] The product monitoring system 105 may also be configured to provide security features related to the removal of a product 190 from the storage device 180. This may be particularly advantageous in the case of a bottle of wine 190 being removed from the refrigerator 180 by a person who is not of legal age to drink alcohol. In particular, in response to determining that at least one product has been removed from the storage device 180, the processor 110 of the control system 107 may be further configured to forward a notification via the communication interface 150 indicating that at least one product has been removed from the storage device 180. The memory 120 of the control system 107 may store one or more registered mobile communication devices 370 in the memory 120, and the notification may be forwarded to one or more of the registered mobile communication devices 370 stored in the memory 120. The notification may indicate identifying data of the product removed.

[0046] As shown in FIG. 3, the control system 107 can communicate with an electrically operable lock 340 of the storage device 180 via an input / output (i / o) interface of the control system 107. The refrigerator 180 includes a door having an electrically operable lock 340 operable in a locked state in which the door is restricted from being opened and an unlocked state in which the door is not restricted from being opened. The processor 110 of the control system 107 of the product monitoring system 105 is configured to receive input data from a user attempting to open the door of the refrigerator 180. The processor 110 is then configured to determine whether the user is authorized to open the lockable door using authentication data stored in the memory 120 and the received input data. In response to determining that the user is authorized, the processor 110 is configured to control the lock 340 to transition from the locked state to an unlocked state such that the user can open the door and access one or more products 190 stored within the refrigerator 180.

[0047] In one embodiment, the refrigerator 180 includes an input device 350 for receiving input data from a user. For example, the refrigerator 180 may include a keypad 350 that allows the user to enter a secret code to open the door. In another system, the input device may be an additional NFC reader, and an NFC device (e.g., a card) may be read by the additional NFC reader to allow the user to access one or more products 190. In another embodiment, the control system 107 receives the input data from a mobile communication device 370 via the communication interface 150. In particular, the mobile communication device 370 includes a biometric sensor, the mobile communication device 370 is configured to capture biometric data of the user via the biometric sensor, and the input data is generated by the mobile communication device 370 based on the biometric data.

[0048] 3, the control system 107 may be in electrical communication with the refrigerator's temperature control system 390 via the i / o interface 130. The control system 107 may be configured to electrically communicate with the temperature control system 390 to control the operating temperature of the refrigerator 180 based on preferred storage temperatures of the one or more products 190 identified as stored within the refrigerator 180. In particular, the processor 110 of the control system 107 is configured to determine one or more product types of the one or more products 190 stored within the refrigerator 180 based on the product identification data.

[0049] The processor 110 is then configured to query temperature storage data accessible to the control system 107 using product types of the one or more products 190 stored in the refrigerator 180 to determine one or more desired storage temperatures for the one or more products 190, the product storage temperature data indicating a plurality of desired temperatures for the plurality of product types. The processor 110 is then configured to control an operating temperature of the refrigerator 180, or a portion of the refrigerator 180, in accordance with the one or more desired storage temperatures. It will be appreciated that the temperature storage data may be stored in the memory 120 of the control system 107 or may be accessible from a remote storage device via the communications interface 150.

[0050] In some examples, one or more products 190 stored within the refrigerator may be stored at a first desired temperature, but ideally be served at a different second desired temperature. In this example, a user may configure or request that the refrigerator 180 operate at a second desired temperature determined based on the stored one or more products in anticipation of removal of the one or more products from the refrigerator. To accomplish this change in operating temperature, the processor 110 is configured to determine one or more product types of the one or more products 190 stored within the refrigerator 180 based on the product identification data. The processor 110 is then configured to query temperature serving data accessible to the control system 107 using the one or more product types of the one or more products stored within the refrigerator to determine one or more desired serving temperatures for the one or more products, the product serving temperature data indicating multiple desired serving temperatures for the multiple product types.

[0051] The processor 110 is then configured to control an operating temperature of the refrigerator, or a portion of the refrigerator, based on the one or more desired serving temperatures. In some examples, the processor 110 can be configured to receive a serving temperature command via the communication interface 150 indicating that the refrigerator 180 should transition from operating in a storage temperature mode to a serving temperature mode for a period of time. This periodic operation also causes the refrigerator to operate in an energy efficient manner. The serving temperature command can be received from the user's mobile communication device 370. In another form, the memory 120 of the control system 107 can store preference data including scheduled temperature control data indicating operating temperatures at various times.

[0052] For example, a user may use a computer program 375 running on the mobile communication device 370 to set preference data to indicate a period of time (e.g., 5:00 PM - 9:00 PM) during which the refrigerator should maintain an operating temperature for one or more products stored in the refrigerator at a desired serving temperature and for other times, the refrigerator should maintain an operating temperature equal to the desired storage temperature. The preference data is stored in memory 120 of the control system 107. In this configuration, once the user sets the preference data, the user need not provide any subsequent human intervention for the refrigerator to operate in this manner.

[0053] As shown in FIG. 3 , server processing system 170 may include or have access to a data repository 175 that stores profile data. The profile data may be a profile of one or more users of storage device 180 indicating one or more preferences for products stored in storage device 180. Server processing system 170 is configured to determine at least one new product to replace the retrieved product based on the profile data and the order data. For example, in a wine refrigerator example, the profile data may indicate one or more wine preferences. In a more specific example, the order data may indicate that a bottle of Shiraz 190 has been retrieved, and the one or more preferences may indicate a preferred wine producer. Using this information, server processing system 170 may search product repository 175 to identify a bottle of Shiraz 190 available from the preferred wine producer. Server processing system 170 is then arranged to dispatch the new product to the refrigerator user. In some examples, server processing system 170 may modify the profile data based on the order data. For example, over time, trends in consumption habits may indicate changes in the preferences of the refrigerator user. The server processing system 170 may include one or more heuristic or machine learning programs stored in the server processing system's memory to analyze the received order data and modify the profile data so that more preferred replacement products are delivered to the refrigerator user.

[0054] Although a specific embodiment of a custom refrigerator with an integrated product monitoring system 105 has been described above, a portable rack or shelf set integrated with the product monitoring system 105 can be placed within a regular refrigerator, thereby converting the regular refrigerator into a product monitoring system 105.

[0055] Although an embodiment has been described above with respect to a refrigerator for storing bottles of wine 190, it will be understood that the above embodiment is equally applicable to other types of storage devices 180, such as pantries, vending machines, and storage cabinets.

[0056] 5-7, another preferred embodiment of the system 100 of the present invention is shown, and it should be noted that like reference numerals are used as above to refer to like components unless expressly indicated otherwise. In this embodiment, advantageously, the number of NFC readers is minimized and interference between NFC readers is reduced or eliminated.

[0057] As best seen in FIG. 5, this embodiment includes a primary controller 305 in communication with seven one or more secondary controllers 329. The primary controller 305 and secondary controller 329 each communicate with an array of bottle detectors 520 (labeled bottle sensor array in FIG. 5) to detect the insertion and removal of bottles from the refrigerator. Each bottle location is provided with a detector 520 for determining the presence or absence of a bottle. Preferably, a reflective optical element such as an infrared sensor and emitter forms each bottle detector 520, although it will be understood that a mechanical switch could be used or any suitable conventional arrangement would be employed. FIG. 5 also shows an LED indicator 540 at or as an adjunct to each bottle sensor 520 to provide a visual indication to a user.

[0058] Each primary controller 305 and secondary controller 329 communicates with each NFC tag reader 505, an antenna selection switch 500 associated with each antenna 324 to select one antenna from the array of antennas 329. As shown, each antenna 324 or its array may be associated with a primary controller 305 and one or more secondary controllers 329, although the secondary controllers may be discarded and the primary controller 305 employed to control each antenna 324 is preferred (not shown). Each secondary controller 329 and its associated array of bottle detectors 520, together with the NFC reader 505 and associated antennas 324, form a module 550 capable of detecting the insertion and removal of bottles (not shown in FIG. 5) and reading bottle tag 195 information associated with an array of “N×M” bottles within a section of the refrigerator. That is, a bottle refrigerator may include one or more modules 550, with some modules configured with a primary controller 305 and others using secondary controllers 329.

[0059] 7 shows a schematic example of a modular array 550 that may be 15 bottles 190 in size. In this way, refrigerators of various sizes may be built by connecting several modules together. For example, three modules are required to create a refrigerator with a capacity of 45 bottles.

[0060] In use, each controller 305 or 329 constantly scans its associated array of bottle detectors 520 to detect the insertion and removal of bottles 190. When a bottle 190 is inserted, the controller 329 determines the location of the new bottle 190 in the refrigerator from the active detectors 520 and communicates with its associated antenna tuning / detuning switch 510 and connection switch 500 to connect one antenna 329 from its antenna array in the module 550 to the NFC reader 505, which is the antenna that is best positioned to read the tag 195 of the new bottle 190. All other antennas 324 in the array are configured to be detuned and unconnected so as not to interfere with the operation of the single active antenna. The controller 305 or 329 then communicates with the NFC reader 505 to read the tag of the new bottle 190.

[0061] When a bottle 190 is removed from the array of bottles, the controller 305 or 329 associated with the array detects the removal during its bottle scanning process and determines the location of the removed bottle. Each secondary controller 329 communicates its bottle input and removal information to the primary controller 305. The primary controller 305 collects / stores all bottle information (both its own and the secondary controllers) and manages communication with the network / cloud 360.

[0062] If necessary, as shown in FIG. 7, preferred embodiments can include magnetic field suppressors disposed intermediate adjacent antenna arrays to limit the volume of space in which individual antennas in the array can detect and read tags, for example by mu-metal sheets 560 or other very high magnetic permeability material.

[0063] It will be appreciated that in this preferred embodiment, detuning all but one antenna in the array of antennas 324 using detuning control 510 can allow a single desired antenna to perform optimally without being affected by the nearby proximity of other antennas in the array. Thus, a single optimally performing antenna can be used to read tags from several bottles in the storage array, thereby minimizing the number of antennas and associated support hardware required to achieve complete coverage of the refrigerator. In FIG. 7, for example, each antenna 324 has three bottles located adjacent to each side of it, allowing in combination with detector 520 to ensure that the correct tag 195 is read. By constantly probing or scanning the state of detector 520, the removal or addition of bottles can be detected very many times per second.

[0064] It can thus be seen that the present invention advantageously solves the technical problem of having to determine the location of a product in a refrigerator and reading data from an RF tag fixed to the product when the tag does not have a predefined or precise alignment. The tag can be attached to any side of the product and the refrigerator user does not need to store the product in any particular orientation or otherwise align the tag with the antenna. As a result, an antenna array is needed, where each antenna in the array has sufficient RF range to be able to read tags from nearby products regardless of their orientation (long tag read range). The antenna array is arranged such that all of the interior space of the refrigerator that may be occupied by tags is within the RF signal range of at least one antenna.

[0065] In addition, preferred embodiments of the present invention may be used in situations where products may be tightly packed in a refrigerator, and it will be appreciated that it is not possible to have a 1:1 relationship between tags and antennas, and each antenna may potentially detect and read several nearby tags from several different products at any one time. Furthermore, because the antennas making up the array are in close proximity to each other, and each antenna must have an RF signal range that allows it to read tags at any orientation, there is a chance that the antennas will interfere with each other and degrade their tag reading range performance, which is overcome by preferred embodiments of the present invention.

[0066] Many modifications will be apparent to those of ordinary skill in the art without departing from the scope of the invention.

Claims

1. 1. A product monitoring system, comprising: at least one near field communication (NFC) reader associated with the storage device; and, A control system including a processor, a memory, and a communications interface, the control system in communication with each NFC reader, the memory having executable instructions stored therein, the processor, without human intervention and through execution of the executable instructions, controlling each NFC reader to read one or more NFC labels associated with one or more products stored by the storage device; receiving, from each NFC reader, product identification data identifying the one or more products stored by the storage device; comparing the product identification data to inventory data stored in the memory to determine at least one product that has been removed from the storage device, the inventory data indicating a most recently determined inventory of the storage device; and a control system configured to transmit order data via the communication interface to a server processing system to order at least one new product to replace the at least one product retrieved from the storage device; the control system includes a primary controller in communication with each NFC reader, an antenna switch, and at least one antenna array such that each antenna is selectively detunable; 1. A product monitoring system, wherein a plurality of product locations each have an associated product sensor, each antenna being associated with a plurality of product locations, and wherein in response to a product sensor detecting the insertion or removal of a product from a product location, all antennas not associated with that product location are detuned or deactivated, and the associated antennas record product details from their associated tags, whereby product identification data collectively represents identification data that is compared by the processor with the inventory data to determine the at least one product that has been removed from the storage device.

2. 10. The product surveillance system of claim 1, including at least one secondary controller in communication with and controlled by the primary controller, each secondary controller configured to control a plurality of antennas and a bottle detector associated with the plurality of antennas.

3. 3. A product monitoring system as described in claim 1 or 2, wherein an antenna matrix is formed from a plurality of associated antennas, the antenna matrix is integrated with a rack or shelf that supports the one or more products, the rack or shelf including a plurality of support members that define a plurality of storage locations, each storage location configured to store a single product, and the antenna matrix is integrated with the plurality of support members.

4. The product surveillance system of claim 3 , wherein the plurality of support members comprises a plurality of substantially vertical support members and a plurality of substantially horizontal support members.

5. to control the one or more NFC readers to read one or more NFC product labels, sequentially controlling different portions of the antenna matrix to read any product located within each location of the storage device, the memory of the control system having stored therein location data indicating the location of each different portion of the antenna matrix; receiving a plurality of product identification data portions in response to the sequential control of the different portions of the antenna matrix, the plurality of product identification data portions collectively representing the identification data; and determining a location of each identified product stored within the storage device using the plurality of product identification data portions and the location data.

6. the processor: receiving a product location request via the communication interface; 6. The product surveillance system of claim 5, further configured to: transmit via a communications interface the location of each identified product stored in the storage device.

7. The product monitoring system of claim 1 or 2, wherein the processor is further configured to update the inventory data based on the identified one or more products retrieved from the storage device.

8. the processor: identifying one or more new products stored in the storage device based on the comparison of the product identification data and the inventory data; 3. The product monitoring system of claim 1, further configured to: update the inventory data stored in the memory to indicate the one or more new products.

9. 3. The product monitoring system of claim 1, wherein the processor is further configured to periodically control the one or more NFC readers to read the one or more NFC labels associated with one or more products stored by the storage device.

10. 3. The product monitoring system of claim 1, wherein in response to determining that the at least one product has been removed from the storage device, the processor is further configured to: transmit, via the communications interface, a notification indicating that the at least one product has been removed from the storage device.

11. 1. A system comprising: A product monitoring system according to claim 1 or 2; the storage device being a refrigerator including a door having an electrically operable lock operable between a locked state in which the door is restricted from being opened and an unlocked state in which the door is not restricted from being opened; the processor of the control system of the product monitoring system receiving user identification data of a user attempting to open the door of the refrigerator; using user data stored in the memory to determine whether the user is authorized to open the lockable door; In response to determining that the user is authorized, the system is further configured to control the lock to transition from the locked state to the unlocked state so that the user can open the door and access the one or more products stored in the refrigerator.

12. The system of claim 11 , wherein the one or more products are one or more bottles of wine.

13. The system of claim 11 , wherein the refrigerator includes an input device for receiving the user identification data from the user.

14. The system of claim 11 , wherein the control system receives the user identification data from a mobile communication device via a communication device.

15. 15. The system of claim 14, wherein the system includes the mobile communication device having a biometric sensor, the mobile communication device configured to capture biometric data of the user via the biometric sensor, and the user identification data generated by the mobile communication device based on the biometric data.

16. the processor: determining one or more product types of the one or more products stored in the refrigerator based on the product identification data; querying temperature storage data accessible to the control system using the product types of the one or more products stored in the refrigerator to determine one or more desired storage temperatures for the one or more products, the temperature storage data indicating a plurality of desired temperatures for a plurality of product types; 12. The system of claim 11, further configured to: control an operating temperature of the refrigerator, or a portion of the refrigerator, in accordance with the one or more desired storage temperatures.

17. the processor: determining one or more product types of the one or more products stored in the refrigerator based on the product identification data; querying serving temperature data accessible to the control system using the one or more product types of the one or more products stored in the refrigerator to determine one or more desired serving temperatures of the one or more products, the serving temperature data indicating a plurality of desired temperatures for a plurality of product types; 12. The system of claim 11, further configured to: control an operating temperature of the refrigerator, or a portion of the refrigerator, based on the one or more desired serving temperatures.

18. 12. The system of claim 11, wherein the system includes the server processing system, the server processing system including a data repository having profile data stored therein, the server processing system configured to determine the at least one new product based on the profile data and the order data.

19. The system of claim 18 , wherein the server processing system modifies the profile data based on the order data.

Images