Spare parts information providing system and spare parts information providing method

Abstract

A wireless tag (2) is installed on equipment (1) used in a facility (200). A wireless tag reader (10) and a camera (20) are installed at the entrance (202) of the facility. The server (12, 22) associates an image of each equipment (1) with identification information and stores the image, and also stores image data captured by the camera (20). The server (12) obtains inventory information of the equipment (1) at the opening and closing times based on the reception history of the wireless tag reader (10), compares the inventory information, and thereby detects identification information of equipment (1) taken out of the facility (200) during business hours. The server (12) uses the detected identification information to estimate the time when the equipment (1) was taken out based on the reception history of the wireless tag reader (10). The server (22) analyzes the captured image data of the estimated time of taking out, thereby detecting a captured image containing an image of the equipment (1), and provides equipment information containing the detected captured image.

Description

Technical Field

[0001] The present invention relates to a system and method for providing equipment information for providing information on equipment used in a facility. Background Art

[0002] Japanese Patent Application Publication No. 2009-217364 (Patent Document 1) discloses a system for monitoring theft of shopping baskets used in stores. In the system described in Patent Document 1, an IC tag capable of transmitting a wireless signal containing an ID identifying the shopping basket is attached to the shopping basket. Multiple sensors capable of receiving the wireless signals transmitted from the IC tag are installed within the store.

[0003] In the above system, if the monitoring device has acquired the IDs corresponding to all shopping baskets, it determines that no shopping basket theft has occurred. On the other hand, if it has determined that no shopping basket ID has been acquired, the monitoring device issues a shopping basket theft alarm from a speaker located near the sensor that acquired the ID of the shopping basket determined to have been stolen.

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Laid-Open No. 2009-217364 Summary of the Invention

[0007] Problems to be solved by the invention

[0008] According to the system described in Patent Document 1, the operator can immediately know that a shopping basket has been stolen and the location where the theft occurred. In addition, the shoppers around the location where the shopping basket was stolen can be notified of the theft, thereby increasing the number of witnesses.

[0009] However, shoppers may temporarily remove shopping baskets from a store to carry their purchases to a parking lot or bicycle parking area. Even this temporary removal can cause the management device to detect theft and issue an alarm, potentially damaging the shopper's reputation. Therefore, a mechanism is needed to accurately detect shopping basket theft and prevent recurrence.

[0010] The present invention has been made to solve such a problem, and an object of the present invention is to provide a system and method for providing equipment information that can accurately detect equipment used in a facility being taken out and provide information on the person who took out the equipment.

[0011] Means for solving problems

[0012] A spare part information providing system according to one embodiment of the present invention provides spare part information related to spare parts used in a facility. The spare part information providing system comprises a plurality of wireless tags, at least one wireless tag reader, a camera, and at least one server. The plurality of wireless tags are respectively installed on a plurality of spare parts used in the facility, and store identification information of the corresponding spare parts. At least one wireless tag reader is set up in the facility and receives signals containing identification information from the plurality of wireless tags. The camera is set up at the entrance and exit of the facility and photographs people leaving the entrance and exit. At least one server is communicatively connected to the at least one wireless tag reader and the camera. The at least one wireless tag reader includes at least a first wireless tag reader set up at the entrance and exit. The at least one server comprises at least one processor, a memory storing a program executed by the at least one processor, and a storage device. The storage device associates and stores images of each of the plurality of spare parts with the corresponding identification information, and stores image data captured by the camera. At least one processor obtains, based on a history of signal reception from at least one wireless tag reader, inventory information of the equipment at a first moment and inventory information of the equipment at a second moment after a predetermined time has elapsed from the first moment. The at least one processor compares the inventory information at the first moment with the inventory information at the second moment to detect identification information of equipment removed from the facility during the predetermined time. Using the detected identification information, the at least one processor estimates the time at which the equipment was removed from the facility, i.e., the removal time, based on the history of signal reception from the first wireless tag. Using the detected identification information, the at least one processor obtains an image of the equipment removed from the facility from a storage device. Using the obtained image of the equipment, the at least one processor analyzes image data captured at the estimated removal time to detect an image containing an image of the equipment, and provides equipment information containing the detected image.

[0013] One embodiment of the present invention provides a method for providing equipment information related to equipment used within a facility. Multiple wireless tags are attached to each of the multiple equipment used within the facility. Each of the multiple tags is configured to store identification information for the corresponding equipment. The facility includes at least one wireless tag reader that receives signals containing identification information from the multiple wireless tags, and a camera that captures images of people exiting the facility's entrance or exit. The at least one wireless tag reader includes at least a first wireless tag reader located at the entrance or exit. The method for providing spare parts information comprises the following steps: associating images of a plurality of spare parts with corresponding identification information and storing them in a storage device; storing image data captured by a camera in the storage device; obtaining, by a computer, inventory information of the spare parts at a first moment and inventory information of the spare parts at a second moment after a specified time has passed from the first moment based on a signal reception history of at least one wireless tag reader; comparing the inventory information at the first moment with the inventory information at the second moment, thereby detecting, by a computer, identification information of spare parts taken out of a facility within a specified time; estimating, by a computer, the time at which the spare parts are taken out of the facility, i.e., the time of taking out, based on a signal reception history of at least one wireless tag reader within a specified time using the detected identification information; obtaining, by a computer, an image of the spare parts taken out of the facility from a storage device using the detected identification information; analyzing the captured image data of the estimated time of taking out using the acquired image of the spare parts, thereby detecting, by a computer, a captured image containing an image of the spare parts; and providing, by a computer, spare parts information containing the detected captured image.

[0014] Effects of the Invention

[0015] According to the present invention, it is possible to accurately detect that equipment used in a facility has been taken out, and provide information on the person who has taken out the equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is an overall configuration diagram of a spare parts information providing system according to an embodiment.

[0017] Figure 2 This is a picture of the shopping cart.

[0018] Figure 3 It shows Figure 1 The hardware configuration of the spare parts information providing system is shown in FIG.

[0019] Figure 4 This is a diagram showing an example of information managed in a server of the parts management system.

[0020] Figure 5 This is a diagram showing an example of basket image data.

[0021] Figure 6 This is a diagram showing an example of a store entrance and exit table.

[0022] Figure 7 This is a diagram showing an example of a camera system ID table.

[0023] Figure 8 This is a diagram showing an example of the basket status DB, inventory data before store opening, and inventory data after store closing.

[0024] Figure 9 This is a diagram showing an example of lost basket data.

[0025] Figure 10 This is a diagram showing an example of camera inquiry data and an image request signal.

[0026] Figure 11 This is a diagram illustrating the process of generating an image response signal in a server of a camera system.

[0027] Figure 12 FIG. 1 is a diagram showing an example of an analysis result image.

[0028] Figure 13 This is a diagram showing a display example of information related to a lost basket.

[0029] Figure 14 This is a flowchart showing an example of a procedure of a process executed by the parts management system.

[0030] Figure 15 This is a flowchart showing an example of a procedure of a process executed by the parts management system.

[0031] Figure 16 This is a flowchart showing an example of the steps of the process executed by the camera system. DETAILED DESCRIPTION

[0032] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same or corresponding parts in the drawings are denoted by the same reference numerals and their description will not be repeated.

[0033] <Application example of spare parts information provision system>

[0034] The equipment information provision system of this embodiment is used to provide facility managers with information related to equipment used within the facility. This equipment information includes information used to identify equipment removed from the facility due to theft or other reasons, as well as information used to identify the individuals who removed the equipment from the facility. The following description uses a commercial facility as an example of a facility to which this embodiment of the equipment information provision system can be applied.

[0035] Shopping baskets are used in commercial facilities to carry purchased goods. After purchasing goods, shoppers are required to return the baskets to a designated basket storage area within the facility. However, some shoppers fail to return the baskets and steal items.

[0036] As a countermeasure to prevent theft of shopping baskets, Patent Document 1 above describes a system that immediately issues an alarm when a shopping basket is stolen. However, shoppers sometimes temporarily remove their shopping baskets from a facility to transport their purchases to a parking lot or bicycle parking area. This temporary removal could be considered theft, potentially damaging the shopper's credibility.

[0037] The equipment information providing system of this embodiment is configured to accurately detect the theft of a shopping basket and acquire an image of a person who has stolen the shopping basket.

[0038] <Overall Structure of the Parts Information Providing System>

[0039] Figure 1 This is an overall configuration diagram of a spare parts information providing system according to an embodiment of the present invention.

[0040] like Figure 1 As shown, the equipment information providing system of this embodiment is implemented by the cooperation of the equipment management system 100 and the camera system 120. The equipment management system 100 is a system for managing equipment used in a commercial facility 200. The equipment includes a shopping basket 1. The camera system 120 is a system for monitoring the interior of the commercial facility 200.

[0041] Figure 2 This is the appearance of the shopping cart 1. Figure 2 As shown in FIG, the shopping basket 1 includes a basket body for storing commodities and a handle attached to the basket body. The shopping basket 1 is equipped with an RFID (Radio Frequency Identification) tag 2. Figure 2 In the example, the RFID tag 2 is attached to the basket body.

[0042] RFID tag 2 is configured to communicate wirelessly with an RFID reader (described later) using short-range wireless communication. RFID tag 2 corresponds to one embodiment of a "wireless tag." Wireless tags are not limited to RFID tags and may also be, for example, NFC (Near Field Communication) tags.

[0043] The RFID tag 2 includes an antenna, a processing circuit, and a memory. The memory stores identification information assigned to each shopping basket (hereinafter also referred to as an "RFID tag number"). The RFID tag number is read from the memory in response to an instruction from the processing circuit.

[0044] Generally speaking, wireless tags are categorized into passive tags and active tags based on whether or not they have a power source. Passive tags are wireless tags that lack a power source and instead operate using radio waves from a wireless tag reader as their energy source. Active tags are wireless tags with a built-in power source. In this embodiment, RFID tag 2 is a passive tag that operates using radio waves received from an RFID reader. This allows for the cost-effective construction of the parts management system 100.

[0045] return Figure 1 The stock management system 100 includes multiple RFID readers 10 and a server 12. Multiple RFID readers 10 are installed within a commercial facility 200. RFID readers 10 are installed, for example, at a location where shopping baskets 1 are gathered, such as a basket storage area within the commercial facility 200. RFID readers 10 may also be portable readers.

[0046] At least a portion of the plurality of RFID readers 10 is disposed at an entrance 202 for allowing shoppers to enter and exit the commercial facility 200. Figure 1 In the example shown in FIG2 , a commercial facility 200 is provided with three entrances and exits 202, and three RFID readers 10 are provided corresponding to each of the three entrances and exits 202. The plurality of RFID readers 10 are configured to be able to communicate with a server 12. The communication between the RFID readers 10 and the server 12 can be wired or wireless.

[0047] The RFID reader 10 is configured to operate by receiving power from a power source (not shown) and to communicate wirelessly with the RFID tag 2 mounted on the shopping basket 1 using short-range wireless communication. As mentioned above, the RFID tag 2 is a passive tag and therefore operates using radio waves from the RFID reader 10. The RFID reader 10 corresponds to one embodiment of a "wireless tag reader."

[0048] The RFID reader 10 includes an antenna and processing circuitry. Based on a near-field wireless communication standard, the RFID reader 10 transmits a request signal to the surrounding area at regular intervals via the antenna. The RFID tag 2 mounted on the shopping basket 1 receives the request signal from the RFID reader 10 and operates. The RFID tag 2 generates a response signal containing the RFID tag number stored in its memory, modulates it, and transmits it to the RFID reader 10.

[0049] When the RFID reader 10 receives the response signal transmitted from the RFID tag 2 in response to the request signal, it associates the reception time of the response signal with the RFID tag number included in the response signal and stores the received time.

[0050] The server 12 has a function of managing equipment used in the commercial facility 200. As an example, the server 12 is installed in an operating company that operates the commercial facility 200. The server 12 can be used by a person in charge of management of the commercial facility who is entrusted by the operating company.

[0051] The RFID reader 10 transmits the reception history of the response signal along with its identification information (hereinafter also referred to as "RFID reader ID") to the server 12 at a predetermined period (e.g., several minutes). At this time, by deleting a portion of the reception history already stored in the RFID reader 10, the memory capacity used for storing the reception history can be reduced.

[0052] The RFID reader 10 is not limited to the configuration of regularly transmitting the reception history to the server 12 in the predetermined cycle, and may be configured to transmit the reception history of the most recent predetermined time (eg, 3 minutes) in response to a transmission request from the server 12 .

[0053] Upon receiving the reception history from each RFID reader 10, the server 12 registers the reception history of each RFID reader 10 in the storage device. If a plurality of RFID readers 10 are installed in the commercial facility 200, the reception history of each RFID reader 10 is registered in the storage device.

[0054] The camera system 120 includes a plurality of cameras 20 and a server 22. The plurality of cameras 20 are installed in a commercial facility 200. Specifically, the plurality of cameras 20 are installed at the entrances and exits 202 of the commercial facility 200. The number of cameras 20 installed is the same as the number of the entrances and exits 202. Figure 1 In the example of FIG, three cameras 20 are provided corresponding to the three entrances and exits ENT, respectively.

[0055] The camera 20 is arranged so that the corresponding entrance and exit 202 is included in the field of view. The camera 20 is configured to capture images of people leaving the commercial facility 200. The camera 20 corresponds to one embodiment of a "camera".

[0056] The server 22 has a function of monitoring the interior of the commercial facility 200. As an example, the server 22 is installed in an operating company that operates the commercial facility 200, and can be used by a manager who is entrusted with the management of the commercial facility by the operating company.

[0057] The server 22 is configured to be able to communicate with the camera 20 and the server 12. The communication between the camera 20 and the server 22 may be wired or wireless. The communication between the server 12 and the server 22 is performed via a communication network NW (typically the Internet).

[0058] The camera 20 transmits captured image data consisting of a moving image to the server 22. The server 22 associates the captured image data from each camera 20 with the identification information of the camera 20 that transmitted the image (hereinafter also referred to as the "camera ID") and stores it in a storage device (database). Furthermore, as described later, the server 22 is configured to read the captured image stored in the database in response to an image request signal from the server 12 and transmit it to the server 12.

[0059] <Hardware Structure of Spare Parts Information Providing System>

[0060] Figure 3 It shows Figure 1 The hardware configuration of the spare parts information providing system is shown in FIG.

[0061] like Figure 3 As shown, in the spare parts management system 100, the server 12 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, a storage device 114, an input unit 115, a display unit 116, and a communication interface 117. These components exchange various data via a communication bus.

[0062] CPU 111 expands and executes the program stored in ROM 112 in RAM 113. The program stored in ROM 112 describes the processing to be executed by server 12.

[0063] The storage device 114 is a memory that stores various information and stores information about the commercial facility 200 and information about equipment (including the shopping basket 1) used in the commercial facility 200. The storage device 114 is, for example, a hard disk drive (HDD) or a solid state drive (SSD).

[0064] The input unit 115 is composed of a touch panel, a mouse, a keyboard, etc., and receives user operations. The display unit 116 is composed of a display, various indicators, etc., and outputs processing results from the CPU 111.

[0065] The communication IF 117 is an interface for exchanging signals and data with the RFID reader 10 and the server 22 of the camera system 120 .

[0066] exist Figure 3 , a structural example is shown in which the necessary processing is provided by executing a program by CPU 111, but part or all of the provided processing can also be implemented using a dedicated hardware circuit (such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array)).

[0067] In the camera system 120 , the server 22 is configured to include a web server 24 , an application server 26 , and a database server 28 .

[0068] The web server 24 includes a CPU 241, a ROM 242, a RAM 243, a storage device 244, and a communication IF 245. These components exchange various data via a communication bus.

[0069] The application server 26 includes a CPU 261, a ROM 262, a RAM 263, a storage device 264, and a communication IF 265. These components exchange various data via a communication bus.

[0070] In each of the web server 24 and the application server 26, the CPU expands the program stored in the ROM in the RAM and executes it. The program stored in the ROM describes the processing to be executed by each server.

[0071] The storage device is a memory that stores various types of information. The storage device 244 of the web server 24 stores information including the analysis result image 272 generated by the image analysis processing in the application server 26. The storage device 264 of the application server 26 stores information including image analysis data 282 used in the image analysis processing and extraction target image data 283.

[0072] The database server 28 stores a database 280 . The database 280 includes image data 281 captured by the camera 20 installed in the commercial facility 200 .

[0073] <Functional Structure of Spare Parts Management System>

[0074] Next, use Figures 4 to 10 The functional structure of the parts management system 100 will be described.

[0075] Figure 41 is a diagram showing an example of information managed in the server 12 of the equipment management system 100. Figure 4 The storage device 114 of the server 12 stores a facility information DB 130 that stores information related to the commercial facility 200 and a basket status DB 134 that stores information related to the status of the shopping basket 1 in the commercial facility 200 .

[0076] The facility information DB 130 includes basket image data 131 , a store entrance and exit table 132 , and a camera system ID table 133 . Figure 5 It is a diagram showing an example of the basket image data 131 .

[0077] Reference Figure 5 The basket image data 131 includes image files of all shopping baskets 1 managed by the stock management system 100. Each shopping basket 1 is equipped with an RFID tag 2 storing identification information (RFID tag number) of the shopping basket 1. The image file of each shopping basket 1 is registered in the basket image data 131 in correspondence with the RFID tag number. Figure 5 2 shows an example of basket image data 131 in a case where there is only one type of shopping basket 1 to be managed. In this case, an image file (file name: kago.png) of one type of shopping basket 1 is associated with the RFID tag number of each shopping basket 1.

[0078] Figure 6 132 is a diagram showing an example of the store entrance and exit table 132. Figure 6 The store entrance and exit table 132 includes the name of the commercial facility 200, namely the "store name", the name of the entrance and exit 202 of the commercial facility 200, namely the "entrance and exit name", the identification information of the entrance and exit 202, namely the "entrance and exit ID", the identification information of the camera 20 installed in the commercial facility 200, namely the "camera ID", and the identification information of the RFID reader 10 installed in the commercial facility 200, namely the "RFID reader ID".

[0079] exist Figure 6 In the store entrance and exit table 132, the store entrance and exit table 132 is set in the commercial facility 200 (refer to Figure 1 The store entrance and exit table 132 also includes the camera IDs of the three cameras 20 and the RFID reader IDs of the three RFID readers 10 respectively installed at the three entrances and exits 202.

[0080] Figure 7 133 is a diagram showing an example of the camera system ID table 133. Figure 7The camera system ID table 133 includes the "camera system ID" which is identification information of the camera system 120, and the "camera ID" data of the camera 20 included in each camera system 120. The camera system ID table 133 also includes the "destination address" data which is the address assigned for accessing the server 22 that manages each camera 20.

[0081] The basket image data 131 , the store entrance and exit table 132 , and the camera system ID table 133 are stored in the facility information DB 130 by the person in charge of management of the commercial facility 200 .

[0082] return Figure 4 The basket status DB 134 includes data on identification information (RFID tag numbers) of shopping baskets 1 present in the commercial facility 200. The server 12 uses the data related to the shopping baskets 1 stored in the basket status DB 134 to generate pre-store opening inventory data 136 and post-store closing inventory data 138, and stores the generated inventory data 136 and 138 in the storage device 114.

[0083] Figure 8 134, the inventory data before store opening 136, and the inventory data after store closing 138. Figure 8 The basket status DB 134 registers a history of response signal reception by the RFID reader 10 installed in the commercial facility 200. The reception history includes the time when the response signal was received from the RFID tag 2, identification information (RFID tag number) of the RFID tag 2 as the transmission source, and identification information (RFID reader ID) of the RFID reader 10.

[0084] When a plurality of RFID readers 10 are installed, the basket status DB 134 stores the reception history of each RFID reader 10. In the basket status DB 134, the reception history of each RFID reader 10 is stored in the order of reception time for each business day of the commercial facility 200.

[0085] The server 12 extracts the reception history of the RFID reader 10 immediately before the opening time of the commercial facility 200 on a certain business day from the basket status DB 134 and stores the extracted reception history in the storage device 114 as pre-opening inventory data 136. The pre-opening inventory data 136 corresponds to the inventory information of the shopping basket 1 at the opening time of the commercial facility 200 on a certain business day. The opening time corresponds to an embodiment of "the first moment," and the pre-opening inventory data 136 corresponds to an embodiment of "the inventory information at the first moment." In this embodiment, the opening time of the commercial facility 200 is 10:00 AM, the closing time is 10:00 PM, and the business hours are defined as the period from 10:00 AM to 10:00 PM.

[0086] The server 12 extracts the reception history of a predetermined length of time immediately before the store opening time (10:00 a.m.) from the basket status DB 134. Figure 8 In the example of , the 10-minute reception history from 9:50 am to 10:00 pm is extracted and stored in the storage device 114 as the pre-store opening inventory data 136.

[0087] The server 12 also extracts the reception history of the RFID reader 10 immediately after the store closes on that business day from the basket status DB 134, and saves the extracted reception history as the after-closing inventory data 138 in the storage device 114. The after-closing inventory data 138 is equivalent to the inventory information of the shopping basket 1 at the closing time of the commercial facility 200 on a certain business day. The closing time corresponds to an embodiment of the "second moment", and the after-closing inventory data 138 corresponds to an embodiment of the "inventory information at the second moment". Specifically, the server 12 extracts the reception history of a specified length of time immediately after the closing time (10 p.m.) from the basket status DB 134. Figure 8 In the example of , the 10-minute receiving history from 10:00 p.m. to 10:10 p.m. is extracted and stored in the storage device 114 as the after-store-closing inventory data 138 .

[0088] return Figure 4 The server 12 generates lost basket data 140 based on the pre-store opening inventory data 136 and the post-store closing inventory data 138 stored in the storage device 114. The lost basket data 140 is data indicating shopping baskets 1 (hereinafter also referred to as "lost baskets") taken out of the commercial facility 200 during the period from the store opening time to the store closing time, i.e., during the business hours of the commercial facility 200.

[0089] Figure 9 140 is a diagram showing an example of the lost basket data 140. Figure 9 The server 12 compares the pre-store opening inventory data 136 and the post-store closing inventory data 138 stored in the storage device 114. The server 12 detects the reception history included in the pre-store opening inventory data 136 that is not included in the post-store closing inventory data 138.

[0090] As described above, the pre-opening inventory data 136 represents the inventory information of the shopping basket 1 at the time the store opens, and the post-closing inventory data 138 represents the inventory information of the shopping basket 1 at the time the store closes. The reception history included in the pre-opening inventory data 136 but not included in the post-closing inventory data 138 corresponds to the reception history of response signals from a shopping basket 1 that was present within the commercial facility 200 at the time of opening but not at the time of closing. The server 12 determines that this shopping basket 1 was taken out of the commercial facility 200 during business hours (a lost basket) and processes the reception history from this shopping basket 1 as lost basket data 140.

[0091] exist Figure 9 In the example, the pre-opening inventory data 136 includes a history of receiving shopping baskets 1 from RFID tag numbers "tag1," "tag2," "tag3," "tag4," and "tag5." Therefore, at the time of opening, the commercial facility 200 determines that it has these five shopping baskets 1. The post-closing inventory data 138 includes a history of receiving shopping baskets 1 from RFID tag numbers "tag1," "tag2," "tag3," and "tag5." Therefore, at the time of closing, the commercial facility 200 determines that it has these four shopping baskets 1.

[0092] When comparing pre-store opening inventory data 136 with post-store closing inventory data 138, post-store closing inventory data 138 does not include a receipt history for shopping basket 1 with RFID tag number "tag4." Therefore, the receipt history for shopping basket 1 with RFID tag number "tag4" is extracted as lost basket data 140.

[0093] Next, the server 12 refers to the reception history during the business hours of the commercial facility 200 stored in the basket status DB 134. The server 12 retrieves the reception history including the RFID tag number included in the lost basket data 140 from the reception history during business hours. Then, the server 12 detects the reception history with the latest (i.e., the most recent) reception time from the retrieval results of the reception history including the RFID tag number of the lost basket. The server 12 rewrites the lost basket data 140 using the detected reception history. At this time, the server 12 rewrites the "reception time" and "RFID reader ID" included in the lost basket data 140 into the "reception time" and "RFID reader ID" included in the latest reception history detected, respectively.

[0094] exist Figure 9In the example shown in FIG. 1 , server 12 searches for a reception history containing the RFID tag number "tag4" from the reception history of the RFID reader 10 during business hours. Server 12 then detects the reception history with the latest (most recent) reception time among at least one of the reception history records included in the search results. If the reception history with the reception time "2022 / 01 / 27 17:45" is the latest reception history, server 12 rewrites lost basket data 140 using the reception time "2022 / 01 / 27 17:45" and RFID reader ID "R1" included in that reception history.

[0095] The latest (most recent) reception history in the at least one reception history included in the search results corresponds to the last reception history from shopping cart 1 (lost cart) during business hours. This last reception history indicates that the reception of the response signal from shopping cart 1 was interrupted with respect to this reception history as the last.

[0096] Therefore, the server 12 estimates the reception time of the last reception history to be the time when the shopping basket 1 (lost basket) was taken out of the commercial facility 200. The server 12 rewrites the "reception time" contained in the lost basket data 140 to the estimated time of taking out. Furthermore, the server 12 rewrites the "RFID reader ID" contained in the lost basket data 140 to the RFID reader ID of the RFID reader 10 that received the last response signal from the shopping basket 1. Thus, the lost basket data 140 becomes data that includes the time when the shopping basket 1 (lost basket) was taken out, and the RFID reader ID of the RFID reader 10 that received the response signal from the shopping basket 1 when the shopping basket 1 (lost basket) was taken out through the entrance 202.

[0097] return Figure 4 The server 12 generates camera query data 142 based on the lost basket data 140. The server 12 generates an image request signal 144 using the generated camera query data 142. Figure 10 14 is a diagram showing an example of camera inquiry data 142 and image request signal 144 .

[0098] Reference Figure 10 , the camera query data 142 includes the "receiving time", "RFID reader ID" and "RFID tag number" included in the lost basket data 140. Figure 10 , the reception time “2022 / 01 / 27 17:45”, the RFID reader ID “ R1 ”, and the RFID tag number “tag4 ” are included in the camera query data 142 .

[0099] The camera query data 142 also includes a "camera ID". The "camera ID" is obtained from the store entrance table 132 (see Figure 6 The server 12 detects the “camera ID” associated with the “RFID reader ID” included in the lost basket data 140 in the store entrance and exit table 132 and includes the detected “camera ID” in the camera query data 142.

[0100] exist Figure 6 In the store entrance table 132 shown, the RFID reader ID "R1" is associated with the store name "SH1," the entrance name "ENT1," the entrance ID "E1," and the camera ID "C1." This indicates that an RFID reader 10 with the RFID reader ID "R1" and a camera 20 with the camera ID "C1" are installed at the entrance 202 of the entrance name "ENT1" in the commercial facility 200 with the store name "SH1." Therefore, the server 12 includes the camera ID "C1" in the camera query data 142.

[0101] Next, the server 12 generates an image request signal 144 using the camera query data 142. The image request signal 144 is a signal for requesting the camera system 120 to transmit the image captured by the camera 20. Figure 10 As shown, image request signal 144 includes the identification information for the parts management system 100, namely, the "parts management system ID," "RFID tag number," "basket image," "camera ID," "received time," and "time width." Of these, the "RFID tag number," "camera ID," and "received time" use the data included in camera query data 142.

[0102] "Basket image" represents an image file of the shopping basket 1 (lost basket) having the "RFID tag number". "Basket image" is obtained based on the basket image data 131 (refer to Figure 5 ) is generated. “Time width” indicates the length of the captured image cut out from the captured image data of the camera 20. Figure 10 In the example of FIG. 1 , the image file “kago.png” of the shopping basket 1 having the RFID tag number “tag4” and the time width “10 seconds” are included in the image request signal 144 .

[0103] according to Figure 10 The image request signal 144 shown cuts out a captured image with a time width (10 seconds) of "2022 / 01 / 27 17:45" of the reception time of the response signal from the shopping basket 1 with the RFID tag number "tag4" from the captured image data of the camera 20 with the camera ID "C1" in the camera system 120.

[0104] The server 12 transmits the generated image request signal 144 to the server 22 of the camera system 120 via the communication network NW. Upon receiving the image request signal 144 from the server 12, the server 22 generates an image response signal 300 in response thereto.

[0105] <Functional structure of camera system>

[0106] Next, use Figure 11 The functional structure of the camera system 120 will be described.

[0107] Figure 11 1 is a diagram illustrating a process of generating the image response signal 300 in the server 22 of the camera system 120 .

[0108] Reference Figure 11 In server 22, application server 26 obtains image analysis data 282 from database server 28 based on the "camera ID" included in image request signal 144. Specifically, application server 26 reads image data 281 captured by camera 20 with camera ID "C1" stored in database server 28. Application server 26 extracts a captured image (moving image) having the reception time and time width included in image request signal 144 from the read captured image data 281. This captured image has a time width of 10 seconds centered on the reception time "2022 / 01 / 27 17:45." Application server 26 obtains the captured image extracted from captured image data 281 as image analysis data 282.

[0109] Furthermore, the application server 26 obtains the basket image included in the image request signal 144 as the extraction target image data 283. Figure 11 In the example of , the application server 26 acquires the image file “kago.png” representing the image of the shopping basket 1 having the RFID tag number “tag4” as the extraction target image data 283 .

[0110] Next, the application server 26 performs image analysis processing 270 using the image analysis data 282 and the extraction target image data 283. Specifically, the application server 26 performs processing to detect the basket image shown in the extraction target image data 283 from the image analysis data 282. In this image analysis processing 270, the application server 26 overlays a marker for identifying the basket image contained in the captured image with the captured image, thereby generating an analysis result image 272. Figure 12 2 is a diagram showing an example of the analysis result image 272 .

[0111] like Figure 12As shown, the analysis result image 272 is configured to include an image captured by the camera 20 having the camera ID “ C1 ” and a mark for identifying the extraction target image data 283 (basket image) included in the captured image.

[0112] The captured image is obtained by capturing an entrance 202 having an entrance name "ENT1" and an entrance ID "E1" in a commercial facility 200 having a store name "SH1" by the camera 20. The captured image includes an image of a person M leaving the entrance 202.

[0113] The basket image detected from the captured image matches the image (image file "kago.png") of shopping basket 1 (lost basket) with RFID tag number "tag4" acquired as extraction target image data 283. The marker is displayed, for example, surrounding the detected image of shopping basket 1 and overlapping it with the captured image.

[0114] The analysis result image 272 also displays identification information (RFID tag number “tag4”) of the shopping basket 1 (lost basket) included in the captured image in a superimposed manner.

[0115] This analysis result image 272 captures the person who took shopping basket 1 (lost basket) out of commercial facility 200 around the time (2022 / 01 / 27 17:45). Therefore, the person who stole shopping basket 1 can be identified based on analysis result image 272.

[0116] The application server 26 transmits the generated analysis result image 272 to the web server 24 . The web server 24 stores the analysis result image 272 in the storage device 244 .

[0117] Furthermore, the application server 26 generates an image response signal 300 for the server 12 of the equipment management system 100. The image response signal 300 is a response to the image request signal 144 (see Figure 10 ) is obtained by adding the identification information of the camera system 120, namely the "camera system ID", the URL (Uniform Resource Locator) of the location where the analysis result image 272 is stored (i.e., the WEB server 24), and the key used to access the storage location.

[0118] The application server 26 transmits the generated image response signal 300 to the server 12 of the equipment management system 100 via the communication network NW.

[0119] <Provision of spare parts information>

[0120] In the stock management system 100, upon receiving an image response signal 300 from the server 22 of the camera system 120, the server 12 generates information 302 regarding the lost basket using the image response signal 300. Subsequently, the server 12 provides the information 302 regarding the lost basket in response to an instruction from the manager of the commercial facility 200. For example, the server 12 causes the display unit 116 to display the information 302 regarding the lost basket. Figure 13 3 is a diagram showing a display example of the information 302 related to the lost basket.

[0121] The information 302 about the lost basket includes image search result data 304 and information 306 about the time when the lost basket was taken out. The server 12 adds the URL and key information of the web server 24 included in the image response signal 300 from the server 22 to the camera query data 142 (see Figure 10 ), thereby generating image search result data 304. The server 12 further adds information indicating the store name "SH1" of the commercial facility 200 and the entrance name "ENT1" of the entrance 202 from which the shopping basket 1 was taken out, to the image search result data 304.

[0122] The information 306 related to the time of being taken out includes the identification information of the lost basket (RFID tag number), the image file name of the lost basket, the time when the lost basket was taken out of the commercial facility 200, and information related to the time width of the image analysis performed by the camera system 120.

[0123] While the display unit 116 displays the image search result data 304, the input unit 115 can accept a user operation for displaying the analysis result image 272. For example, if the administrator points the mouse pointer 308 at the URL of the web server 24 and clicks it, the server 12 accesses the web server 24 using the URL and key information and retrieves the analysis result image 272 from the web server 24. The server 12 displays the retrieved analysis result image 272 on the display unit 116.

[0124] By confirming the information displayed on the display unit 116, the manager of the commercial facility 200 can obtain the identification information (RFID tag number) and basket image of the shopping basket 1 taken out of the commercial facility 200, information related to the commercial facility 200 and the entrance and exit 202 from which the shopping basket 1 was taken out, information on the estimated time when the shopping basket 1 was taken out, and an image of the person who took out the shopping basket 1.

[0125] <Processing flow of spare parts information provision>

[0126] Next, the flow of processing executed by the spare parts information providing system will be described.

[0127] Figure 14 and Figure 15 This is a flowchart showing an example of a procedure of a process executed by the equipment management system 100 .

[0128] Reference Figure 14 , a plurality of RFID readers 10 installed in the commercial facility 200 transmit request signals at a certain time (step S01). In addition, at least a portion of the plurality of RFID readers 10 is installed at the entrance 202 of the commercial facility 200 (refer to Figure 1 ).

[0129] RFID tag 2 mounted on shopping basket 1 used in commercial facility 200 operates upon receiving a request signal from RFID reader 10. RFID tag 2 generates a response signal including the RFID tag number, which is identification information of shopping basket 1, and transmits it to RFID reader 10.

[0130] Each RFID reader 10 determines whether it has received a response signal from the RFID tag 2 mounted on the shopping basket 1 (step S02). If a response signal is received from the RFID tag 2 (if S02 determines "yes"), the RFID reader 10 saves the reception history of the response signal in the basket status DB 134 of the storage device 114 provided in the server 12 (step S03). In the basket status DB 134, as shown in FIG. Figure 8 As shown, the reception time of the response signal in each RFID reader 10, the RFID reader ID of the RFID reader 10 that received the response signal, and the RFID tag number of the RFID tag 2 mounted on the shopping basket 1 are associated and stored.

[0131] The server 12 determines whether the commercial facility 200's opening time has arrived (step S04). If it is determined that the commercial facility 200's opening time has arrived (if S04 determines "yes"), the server 12 generates pre-opening inventory data 136 using the reception history stored in the basket status DB 134 and stores it in the storage device 114 (step S05). In S05, the server 12 extracts the reception history of each RFID reader 10 for a specified period of time immediately before the commercial facility 200's opening time from the basket status DB 134 and stores it in the storage device 114 as pre-opening inventory data 136.

[0132] Next, the server 12 determines whether the commercial facility 200 has reached its closing time (step S06). If it is determined that the commercial facility 200 has reached its closing time (if S06 determines "yes"), the server 12 generates post-closing inventory data 138 using the reception history stored in the basket status DB 134 and stores it in the storage device 114 (step S07). In S07, the server 12 extracts the reception history of each RFID reader 10 for a specified period of time immediately after the commercial facility 200's closing time from the basket status DB 134 and stores it in the storage device 114 as post-closing inventory data 138.

[0133] If the store opening time has not yet arrived (if S04 determines "No") or the store closing time has not yet arrived (if S06 determines "No"), the process returns to S01. Wireless communication between the RFID reader 10 and the RFID tag 2 shown in S01 to S03 is continued, and the reception history of the RFID reader 10 is stored in the basket status DB 134.

[0134] When the post-closing inventory data 138 is stored in the storage device 114, the server 12 compares the pre-opening inventory data 136 and the post-closing inventory data 138 stored in the storage device 114 (step S08). Then, the server 12 generates the lost basket data 140 (refer to Figure 9 ) (Step S09). In S09, the server 12 extracts the reception history included in the pre-store opening inventory data 136 but not included in the post-store closing inventory data 138 as the lost basket data 140. The server 12 rewrites the "reception time" and "RFID reader ID" included in the lost basket data 140 into the "reception time" and "RFID reader ID" included in the reception history from the lost basket during business hours with the latest (most recent) reception time.

[0135] Next, the server 12 generates camera query data 142 (see Figure 10 ) (Step S10). In S10, the server 12 uses the lost basket data 140 and the store entrance and exit table 132 ( Figure 6 Reference) detects the “camera ID” of the camera 20 that captured the lost basket, and includes the detected “camera ID” in the camera query data 142.

[0136] Next, the server 12 generates an image request signal 144 based on the camera query data 142 (see Figure 10 ) (Step S11), the generated image request signal is sent to the server 22 of the camera system 120 (Step S12).

[0137] Reference Figure 15 After sending the image request signal 144, the server 12 determines whether it has received the image response signal 300 from the server 22 of the camera system 120 (refer to Figure 11 )(Step S13).

[0138] When the image response signal 300 is received from the server 22 (if S13 determines "yes"), the server 12 generates image search result data 304 (see Figure 13 ) (Step S14 ). The server 12 displays the information 302 on the lost basket including the generated image search result data 304 on the display unit 116 (Step S15 ).

[0139] The server 12 determines whether the input unit 115 has accepted a user operation of clicking the URL of the web server 24 included in the image search result data 304 (step S16). If the user operation has been accepted (if S16 determines "yes"), the server 12 accesses the web server 24 using the URL and key information and obtains the analysis result image 272 from the web server 24 (step S17). The server 12 displays the obtained analysis result image 272 on the display unit 116 (step S18).

[0140] Figure 16 This is a flowchart showing an example of the procedure of the process executed by the camera system 120 .

[0141] Reference Figure 16 The server 22 stores the image data captured by the camera 20 installed at the entrance 202 of the commercial facility 200 in the database 280 in the database server 28 (step S21).

[0142] The server 22 (application server 26) determines whether the image request signal 144 is received from the server 12 of the spare parts management system 100 (step S22). In the case where the image request signal 144 is received (when S22 determines to be "yes"), the server 22 (application server 26) uses the information of "camera ID", "receiving time" and "time width" contained in the image request signal 144 to extract the image analysis data 282 from the captured image data of the camera 20 stored in the database 280, and stores it in the storage device 264 (step S23). In S23, the server 22 reads the captured image data 281 of the camera 20 having the "camera ID" contained in the image request signal 144 from the database 280, and cuts out the captured image (dynamic image) having the "receiving time" and "time width" contained in the image request signal 144 from the read captured image data 281 (refer to Figure 11 ).

[0143] The server 22 (application server 26 ) further stores the “basket image” included in the image request signal 144 as the extraction target image data 283 in the storage device 264 (step S24 ).

[0144] Next, the server 22 (application server 26) performs image analysis processing using the image analysis data 282 and the extraction target image data 283 (step S25). In S25, the server 22 performs processing to detect the basket image shown in the extraction target image data 283 from the image analysis data 282. The server 22 superimposes a mark for identifying the basket image included in the captured image on the captured image, thereby generating an analysis result image 272 (see FIG. Figure 12 )(Step S26).

[0145] The server 22 (application server 26) transmits the analysis result image 272 generated in S26 to the web server 24. The web server 24 stores the analysis result image 272 in the storage device 244 (step S27).

[0146] Next, the server 22 (application server 26) generates an image response signal 300 (see FIG. 1 ) for the server 12 of the parts management system 100. Figure 11 ) (Step S28 ). The server 22 transmits the generated image response signal 300 to the server 12 of the parts management system 100 via the communication network NW (Step S29 ).

[0147] As described above, in the stocking information providing system of this embodiment, an RFID reader 10 and a camera 20 are installed at the entrance 202 of a commercial facility 200, and shopping baskets 1 used within the commercial facility 200 are equipped with RFID tags 2. In this configuration, based on the reception history from the RFID tags 2, inventory information of the shopping baskets 1 at the opening time of the commercial facility 200 (pre-opening inventory data) and inventory information of the shopping baskets 1 at the closing time of the commercial facility 200 (post-closing inventory data) are obtained. Then, based on the results of comparing these two inventory information, information regarding shopping baskets 1 taken out of the commercial facility 200 during business hours (lost baskets) is obtained.

[0148] Furthermore, based on the reception history of the RFID reader 10 during business hours, the time at which the lost basket was taken out and the entrance and exit from which the lost basket was taken out are estimated. Based on this estimated information, an image of the entrance and exit near the time of the removal is acquired from the image data captured by the camera 20. Then, by performing image analysis processing to detect the image of the lost basket from the acquired image, an image of the person who took the shopping basket 1 out of the commercial facility 200 is acquired.

[0149] According to this embodiment, if a shopper temporarily removes a shopping basket from a commercial facility, information related to the shopping basket is not included in the lost basket data 140 obtained based on the pre-store opening and post-store closing inventory data. This prevents the temporary removal of a shopping basket from being mistakenly identified as a stolen basket. This allows for accurate detection of shopping basket theft.

[0150] Furthermore, according to the present embodiment, an image of the person who took out the shopping basket is acquired, and therefore the manager can identify the person who took out the shopping basket based on the acquired image.

[0151] The stock item information provision system of this embodiment improves theft detection accuracy by detecting shopping basket theft after the fact. It is not intended to catch a shopping basket thief in the act. Therefore, it cannot directly prevent shopping basket theft. However, by enabling shoppers to identify the person who stole the shopping basket, the stock item information provision system of this embodiment can be expected to effectively curb shopping basket theft.

[0152] Furthermore, in the above-described embodiment, a shopping basket used in a commercial facility is exemplified as the equipment used in the facility. However, the facilities and equipment to which the equipment supply system of the present embodiment is applied are not limited thereto.

[0153] It should be understood that the embodiments disclosed herein are illustrative in all aspects and are not restrictive. The present invention is defined by the appended claims rather than the foregoing description, and is intended to encompass all modifications within the meaning and scope of the appended claims.

[0154] Label Description

[0155] 1: Shopping basket; 2: RFID tag; 10: RFID reader; 12, 22: Server; 20: Camera; 24: Web server; 26: Application server; 28: Database server; 100: Parts management system; 111, 241, 261: CPU; 112, 242, 262: ROM; 113, 243, 263: RAM; 114, 244, 264: Storage device; 115: Input unit; 116: Display unit; 117, 245, 265: Communication interface; 120: Camera system; 130: Facility information database; 131: Basket map Image data; 132: Store entrance and exit table; 133: Camera system ID table; 134: Basket status DB; 136: Inventory data before store opening; 138: Inventory data after store closing; 140: Lost basket data; 142: Camera inquiry data; 144: Image commission signal; 200: Commercial facility; 202: Entrance and exit; 270: Image analysis and processing; 272: Analysis result image; 280: Database; 281: Captured image data; 282: Image analysis data; 283: Extracted object image data; 300: Image response signal; 302: Image retrieval result data; NW: Communication network.

Claims

1. A system for providing equipment information to a facility manager, wherein: The spare parts information providing system comprises: a plurality of wireless tags, each of which is attached to a plurality of equipment used in the facility and stores identification information of the corresponding equipment; at least one wireless tag reader, disposed within the facility, configured to receive signals containing the identification information from the plurality of wireless tags; A camera is installed at the entrance and exit of the facility to capture people leaving the entrance and exit; a first server communicating with the at least one wireless tag reader, and a second server, which is in communication with the camera and the first server, The at least one wireless tag reader includes at least a first wireless tag reader installed at the entrance. The first server has a first storage device for storing the images of the plurality of parts in association with the corresponding identification information; The second server has a second storage device, and the second storage device is used to store the image data captured by the camera. The first server obtains inventory information of the spare part at a first moment and inventory information of the spare part at a second moment after a predetermined time has passed from the first moment based on a history of reception of the signal by the at least one wireless tag reader. The first server compares the inventory information at the first time with the inventory information at the second time, thereby detecting the identification information of the equipment taken out of the facility during the predetermined time. The first server uses the detected identification information to estimate the time when the equipment is taken out of the facility, i.e., the time of taking out, based on a history of reception of the signal by the at least one wireless tag reader during the predetermined time. The first server uses the detected identification information to obtain an image of the equipment taken out of the facility from the first storage device. The second server obtains the captured image data at the estimated time of taking out from the second storage device, The second server analyzes the captured image data at the estimated take-out time using the acquired image of the equipment, thereby detecting a captured image including an image of the equipment. The first server provides the equipment information including the detected captured image to a manager of the facility.

2. The spare parts information providing system according to claim 1, wherein: The first server obtains the identification information included in the reception history of the at least one wireless tag reader at the first time as the inventory information at the first time, The first server obtains the identification information included in the reception history of the at least one wireless tag reader at the second time as the inventory information at the second time, The first server detects the identification information included in the inventory information at the first time but not included in the inventory information at the second time as the identification information of the equipment brought out of the facility.

3. The spare parts information providing system according to claim 1 or 2, wherein: The camera captures the equipment carried by the person leaving from the entrance and exit and the face of the person.

4. The spare parts information providing system according to claim 1 or 2, wherein: The wireless tag is a passive tag that operates by radio waves from the wireless tag reader.

5. The spare parts information providing system according to claim 1 or 2, wherein: The facility is a commercial facility, The supplies include a shopping basket.

6. A method for providing spare parts information, wherein the system provides spare parts information related to spare parts used in the facility to a facility manager, wherein: The system has: a plurality of wireless tags, each of which is attached to a plurality of equipment used in the facility and stores identification information of the corresponding equipment; at least one wireless tag reader, disposed within the facility, configured to receive signals containing the identification information from the plurality of wireless tags; A camera is installed at the entrance and exit of the facility to capture people leaving the entrance and exit; a first server communicating with the at least one wireless tag reader, and a second server, which is in communication with the camera and the first server, The at least one wireless tag reader includes at least a first wireless tag reader installed at the entrance. The first server includes a first storage device configured to store images of the plurality of parts in association with the corresponding identification information, and The second server has a second storage device, and the second storage device is used to store the image data captured by the camera. The spare parts information providing method comprises the following steps: The first server obtains inventory information of the spare part at a first moment and inventory information of the spare part at a second moment after a predetermined time has passed from the first moment based on a history of reception of the signal by the at least one wireless tag reader; The first server compares the inventory information at the first time with the inventory information at the second time, thereby detecting the identification information of the equipment taken out of the facility during the predetermined time; The first server uses the detected identification information to estimate a time when the equipment is taken out of the facility, that is, a time of taking out, based on a history of reception of the signal by the at least one wireless tag reader during the predetermined time. The first server uses the detected identification information to obtain an image of the equipment taken out of the facility from the first storage device; The second server obtains the captured image data at the estimated time of taking out from the second storage device, the second server uses the acquired image of the equipment to analyze the captured image data at the estimated take-out time, thereby detecting a captured image including an image of the equipment; and The first server provides the equipment information including the detected captured image to a manager of the facility.

7. The method for providing spare parts information according to claim 6, wherein: The step of obtaining the inventory information at the first moment and the inventory information at the second moment includes the following steps: acquiring the identification information included in the reception history of the at least one wireless tag reader at the first moment as the inventory information at the first moment; and acquiring the identification information included in the reception history of the at least one wireless tag reader at the second time as the inventory information at the second time, The step of detecting the identification information of the spare parts brought out of the facility includes the following steps: detecting the identification information included in the inventory information at the first moment but not included in the inventory information at the second moment as the identification information of the spare parts brought out of the facility.

8. The method for providing spare parts information according to claim 6, wherein: The step of detecting the captured image includes the following steps: detecting the image of the spare part based on the captured image data.

Images