Store systems and programs

Abstract

To manage a history of each commodity as to whether a person has taken the commodity or not.SOLUTION: A store system includes movement detection means, date acquisition means, person identification means, and storage means. The movement detection means detects movement of each commodity sold in a store. The date acquisition means acquires a date when the movement of the commodity is detected by the movement detection means. The person identification means identifies a person relating to the movement of the commodity detected by the movement detection means. The storage means stores the date acquired by the date acquisition means and information on the identified person relating to the movement detected at the date by the person identification means for each of the commodity in association with each other.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] An embodiment of the present invention relates to a store system and a program for causing a computer to realize the functions of the store system. [Background technology]

[0002] Conventionally, there are known techniques for creating data on the movement of shoppers moving through a store. In addition, there are also known techniques for creating data on the movement of products moving through a store together with shoppers. By analyzing such data on the movement of shoppers, it is possible to recognize the movement of products as well as the movement of shoppers, and therefore it is easy to obtain information on, for example, the route taken by a shopper to purchase a product.

[0003] However, in reality, it is not possible to grasp information such as, for example, whether a shopper picked up an individual product displayed on a shelf but did not purchase it and then returned it to the shelf. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2005-031963 A [Patent Document 2] JP 2005-174217 A Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments of the present invention is to provide a store system that can manage whether or not there is a history of a person picking up each individual product. [Means for solving the problem]

[0006] In one embodiment, the store system includes a movement detection means, a date and time acquisition means, a person identification means, and a storage means. The movement detection means detects the movement of each item sold in the store. The date and time acquisition means acquires the date and time at which the movement of the item is detected by the movement detection means. The person identification means identifies the person related to the movement of the item whose movement is detected by the movement detection means. The storage means stores, for each item, the date and time acquired by the date and time acquisition means and information on the person identified by the person identification means as related to the movement detected at that date and time, in association with each other. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic configuration diagram of a store system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram showing the functional configuration of the person tracking device. [Diagram 3] FIG. 2 is a schematic diagram showing main items of data stored in a flow line file. [Figure 4] FIG. 2 is a block diagram showing the functional configuration of the shelf monitoring device. [Diagram 5] FIG. 2 is a front view showing an example of a product shelf provided with a shelf monitoring device. [Figure 6] A schematic diagram showing the main items of data stored in the opponent file. [Figure 7] FIG. 2 is a block diagram showing the functional configuration of a transaction processing device. [Figure 8] Schematic diagram showing the main items of data stored in a transaction file. [Figure 9] FIG. 2 is a block diagram showing a functional configuration of the individual item management device. [Figure 10] FIG. 4 is a schematic diagram showing the configuration of a movement history table. [Figure 11] FIG. 4 is a schematic diagram showing main items of data stored in an individual item management file. [Figure 12] 4 is a flowchart showing the procedure of information processing executed by a control unit of the person tracking device. [Figure 13] 4 is a flowchart showing the procedure of information processing executed by a control unit of the shelf monitoring device. [Figure 14]4 is a flowchart showing the procedure of information processing executed by a control unit of the transaction processing device. [Figure 15] 4 is a flowchart showing the procedure of information processing executed by a control unit of the individual item management device. [Figure 16] 16 is a flowchart showing the main steps of an event determination process in FIG. 15 . [Figure 17] 16 is a flowchart showing the main steps of the final event determination process in FIG. 15; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of a store system will be described with reference to the drawings. This embodiment illustrates a store system that is constructed in a store that employs a self-registration method using a user terminal. The self-registration method is a method in which a shopper operates a user terminal to register data of a product to be purchased by himself / herself when placing the product in a shopping basket.

[0009] [Store system configuration explanation] FIG. 1 is a schematic diagram of a store system 100 according to this embodiment. Store system 100 includes a person tracking device 10, a shelf monitoring device 20, a transaction processing device 30, an individual item management device 40, a database server 50, and a communication network 60. Store system 100 connects person tracking device 10, shelf monitoring device 20, transaction processing device 30, individual item management device 40, and database server 50 via communication network 60. Communication network 60 is typically a LAN (Local Area Network). The LAN may be a wired LAN or a wireless LAN. Communication network 60 may be, for example, the Internet or a network constructed by applying Internet technology.

[0010] The database server 50 manages a product database 51 and an individual product database 52 . The product database 51 collectively stores product data generated for each item of product sold in the store. The product data includes items such as product code, product name, and price. The product code is identification information for identifying each product as a unit of item. Each product is affixed with a barcode that represents the product code.

[0011] The individual item database 52 collectively stores individual item data generated for each individual item of a product. The individual item data includes items such as an individual item ID and a product code. The individual item ID is identification information for identifying each product as an individual item. A wireless tag is attached to each product. The wireless tag is a wireless communication medium in which a unique RFID (Radio Frequency Identification) is stored in an IC memory. The RFID is different for each wireless tag. Therefore, a product to which a wireless tag is attached is identified as an individual item by the RFID of the wireless tag. Therefore, in this embodiment, the RFID of the wireless tag attached to the product is used as the individual item ID of the product. The wireless tag can read the RFID stored in the IC memory in a non-contact manner by using a dedicated reader.

[0012] Store system 100 allows the use of user terminal 70. User terminal 70 is used by consumers who shop at the store, so-called shoppers. User terminal 70 has at least a barcode scanning function and an information display function. User terminal 70 also has a wireless communication function, and performs data communication with transaction processing device 30 via an access point AP arranged in the store. User terminal 70 is, for example, a dedicated terminal attached to a shopping cart used in the store. If application programs for realizing each of the above-mentioned functions are implemented, a smartphone, tablet terminal, or the like owned by a shopper can also be used as user terminal 70.

[0013] [Explanation of the person tracking device] The person tracking device 10 is a device for tracking the movement of people who move within a store. The people are not limited to shoppers, but also include store clerks who perform tasks such as putting products on shelves and collecting them.

[0014] 2 is a block diagram showing the functional configuration of the person tracking device 10. The person tracking device 10 has functions as a person detection unit 11, a tracking unit 12, a clock unit 13, a communication unit 14, a storage unit 15, and a control unit 16.

[0015] The person detection unit 11 detects the position of a person moving in the store by using a plurality of sensors arranged in the store. The person detection unit 11 can detect the positions of a plurality of people simultaneously. As the sensor, a well-known camera sensor such as an optical camera, an infrared camera, a TOF (Time of Flight) camera, a stereo camera, etc. Also, the position of a person may be detected by using a transmitter and a receiver of a beacon as a sensor.

[0016] The tracking unit 12 tracks the movement of people moving within the store based on the position information of each person detected by the person detection unit 11.

[0017] The clock unit 13 keeps track of the date and time. The communication unit 14 is connected to a communication network 60. The communication unit 14 performs data communication with other devices connected to the communication network 60 in accordance with a predetermined communication protocol.

[0018] The storage unit 15 includes a non-volatile memory area and a volatile memory area. The storage unit 15 stores a control program for controlling the operation of the person tracking device 10 in the non-volatile memory area. The storage unit 15 stores data required for the operation of the person tracking device 10 in the volatile memory area. The non-volatile memory area is, for example, a ROM (Read Only Memory). The volatile memory area is, for example, a RAM (Random Access Memory).

[0019] The control unit 16 controls the human detection unit 11, the tracking unit 12, the clock unit 13, the communication unit 14, and the storage unit 15 in accordance with the control program. The control unit 16 is mainly configured with a processor. The processor is, for example, a CPU (Central Processing Unit).

[0020] The person tracking device 10 uses a part of the volatile memory area of ​​the storage unit 15 as an area for a flow line file 151. The flow line file 151 is an area for storing data on the flow line tracked by the tracking unit 12 for each person detected by the person detection unit 11.

[0021] 3 is a schematic diagram showing main items of data stored in the flow line file 151. The flow line file 151 stores a person ID, attributes, a plurality of person flow line data, and a tracking end flag. The person ID is a unique code assigned to individually identify a person detected by the person detection unit 11. The person ID is set by the person detection unit 11. The person ID may also be set by the tracking unit 12.

[0022] The attribute is information indicating the attribute of a person. The attributes include a shopper and a store clerk. The attribute is determined by the person detection unit 11. For example, a store clerk wears a uniform specified by the store. When a person detected by analyzing an image obtained by a camera sensor is wearing a uniform, the person detection unit 11 determines the attribute of the person as a store clerk. When a person detected by analyzing the image is not wearing a uniform, the person detection unit 11 determines the attribute of the person as a shopper. When the ID of a beacon received by a receiver is an ID for a store clerk, the person detection unit 11 may determine the attribute of the person as a store clerk, and when the ID is not an ID for a store clerk, the person detection unit 11 may determine the attribute of the person as a shopper.

[0023] The person flow data is data consisting of date and time, location information, and person status. The person flow data may include information other than date and time, location information, and person status. The date and time is the date and time measured by the clock unit 13 at the time when the person identified by the person ID is detected by the person detection unit 11. The location information is coordinates indicating the location in the store when the person is detected at that date and time. The location coordinates are three-dimensional coordinates in which an arbitrary point in the store is set as the origin and the distance from the origin is expressed three-dimensionally in the X-axis direction, the Y-axis direction, and the Z-axis direction. The three-dimensional coordinates are calculated by the tracking unit 12. The three-dimensional coordinates may be calculated by the control unit 16. The person status indicates the state of the person identified by the person ID. The state includes a moving state in which the person moves in the store and a stationary state in which the person stays still without moving.

[0024] In the flow line file 151, person flow line data is stored in chronological order from when a person identified by a person ID is detected by the person detection unit 11 until the person is no longer detected. The tracking end flag is one-bit data that is set when tracking of a person identified by a person ID is ended. In this embodiment, tracking ends when the person identified by a person ID is no longer detected by the person detection unit 11.

[0025] [Explanation of shelf monitoring device] The shelf monitoring device 20 is a device for monitoring the movement of products displayed on the product shelves and the behavior of people standing in front of the product shelves. A shelf monitoring device 20 is provided for each product shelf. One or more products are displayed on one product shelf. Each product is equipped with a wireless tag for individual product identification.

[0026] Fig. 4 is a block diagram showing the functional configuration of the shelf monitoring device 20. Fig. 5 is an example of a product shelf 80 on which the shelf monitoring device 20 is provided. Fig. 5 illustrates a three-tier product shelf 80 viewed from the front, with a bottom plate 81 and a top plate 82 separated by two shelves 83. The front is the side from which products are inserted and removed from the product shelf 80. Each tier of the product shelf 80 is divided into three sections, left, right and center, and basically one product is displayed in one section. One product may be displayed across multiple sections. There is no prohibition on multiple products being displayed in one section.

[0027] The shelf monitoring device 20 has functions as a person detection unit 21, a movement detection unit 22, an individual item recognition unit 23, a clock unit 24, a communication unit 25, a memory unit 26, and a control unit 27.

[0028] The confronting person detection unit 21 detects a person confronting the front of the product shelf. As shown in FIG. 5, in this embodiment, a section of the floor surface on the front side of the product shelf 80, with a width H from the edge of the product shelf 80, is set as the monitored area ARa. Only one person can stand in the monitored area ARa. A camera sensor 91 for detecting a person located in the monitored area ARa is attached above the product shelf 80, for example, to the ceiling. The camera sensor 91 detects the presence of a person in the monitored area ARa by capturing the person in the captured area ARb. The camera sensor 91 is a TOF camera, a stereo camera, or a 2D camera. By using a TOF camera, a stereo camera, or a 2D camera as the camera sensor 91, the skeleton of a person located in the monitored area ARa can be estimated, and the behavior of the person can be detected from the movement of the skeleton. Specifically, the behavior of a person bending down in front of the product shelf 80, the behavior of stretching an arm toward the product shelf 80, or the behavior of pulling an arm back from the product shelf 80 can be detected.

[0029] The movement detection unit 22 detects the movement of products displayed on the product shelf 80. As shown in FIG. 5, in this embodiment, a weight sensor 92 is disposed on the surface of each section of the product shelf 80 on which products are placed. The weight sensor 92 measures the total weight of the products displayed in that section. The movement detection unit 22 detects the movement of a product based on a change in the total weight measured by the weight sensor 92. Specifically, when the total weight changes in an increasing direction, the movement detection unit 22 detects that a product has been placed on the product shelf 80. When the total weight changes in a decreasing direction, the movement detection unit 22 detects that a product has been removed from the product shelf 80.

[0030] A camera sensor 93 is attached to each tier of the product shelf 80. The camera sensor 93 is, for example, an optical camera or an infrared camera, and is for monitoring the products displayed on each tier. The mounting position of the camera sensor is not particularly limited as long as the products can be monitored. In addition, while FIG. 5 shows an example in which one camera sensor 93 is arranged for each tier, the number of camera sensors 93 is not particularly limited. For example, a camera sensor 93 may be arranged for each section of each tier. The movement detection unit 22 may detect the movement of the product by analyzing the image of the camera sensor 93. Alternatively, the movement detection unit 22 may detect the movement of the product by using information on the total weight measured by the weight sensor 92 and information obtained by analyzing the image of the camera sensor 93 in combination.

[0031] The individual item recognition unit 23 recognizes the individual item ID of the item whose movement is detected by the movement detection unit 22. As shown in FIG. 5, an antenna 95 of a wireless tag reader 94 is embedded in each level of the product shelf 80. The wireless tag reader 94 has a function of reading RFID from a wireless tag that communicates with the antenna 95 in a non-contact manner. The output level of the antenna 95 is set so as to enable non-contact communication with the wireless tags attached to all the products displayed on the level in which the antenna 95 is embedded. When the movement detection unit 22 detects that a product has been placed on the product shelf 80, the individual item recognition unit 23 recognizes the newly readable RFID as the individual item ID of the product placed on the product shelf 80. When the movement detection unit 22 detects that a product has been removed from the product shelf 80, the individual item recognition unit 23 recognizes the RFID that can no longer be read as the individual item ID of the product removed from the product shelf 80.

[0032] The clock unit 24 keeps track of the date and time. The communication unit 25 is connected to a communication network 60. The communication unit 25 performs data communication with other devices connected to the communication network 60 in accordance with a predetermined communication protocol.

[0033] The storage unit 26 includes a nonvolatile memory area and a volatile memory area. In the nonvolatile memory area, the storage unit 26 stores a control program for controlling the operation of the shelf monitoring device 20. In the volatile memory area, the storage unit 26 stores data necessary for the operation of the shelf monitoring device 20. The nonvolatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0034] The control unit 27 controls the confronting person detection unit 21, the movement detection unit 22, the individual item recognition unit 23, the clock unit 24, the communication unit 25, and the storage unit 26 in accordance with the control program. The control unit 27 is mainly composed of a processor. The processor is, for example, a CPU.

[0035] The shelf monitoring device 20 uses a part of the volatile memory area of ​​the storage unit 26 as an area for a confrontation person file 261. The confrontation person file 261 is an area for storing data on products moved by each person who confronts the front of the product shelf 80.

[0036] FIG. 6 is a schematic diagram showing main items of data stored in the confrontation person file 261. The confrontation person file 261 stores a confrontation person ID, confrontation position coordinates, at least one individual item movement data, and a monitoring end flag. The confrontation person ID is a unique code assigned to individually identify a person detected by the confrontation person detection unit 21. The confrontation person ID is set by the confrontation person detection unit 21.

[0037] The confrontation position coordinates are coordinates indicating the position of the person detected by the confronting person detection unit 21 within the monitored area ARa. The confrontation position coordinates are two-dimensional coordinates that, like the position coordinates related to the person flow line data, have an arbitrary point within the store as the origin and express the distance from the origin in two dimensions along the X-axis and Y-axis directions. The two-dimensional coordinates are calculated by the confronting person detection unit 21. The confrontation position coordinates may be three-dimensional coordinates including the height direction from the floor surface as the Z-axis direction.

[0038] The individual item movement data is data consisting of date and time, individual item ID, product code, section ID, and individual item status. The individual item movement data may include information other than date and time, individual item ID, product code, section ID, and individual item status. The date and time is the date and time measured by the clock unit 24 at the time when the movement detection unit 22 detects the movement of the product. The individual item ID is the RFID of the wireless tag attached to the product whose movement is detected. The product code is the product code of the product whose movement is detected. The section ID is the section ID of the section whose movement is detected by the movement detection unit 22. A unique section ID is preset in each section of the product shelf 80 as identification information for individually identifying the section. The individual item status indicates the state of the product whose movement is detected. The state includes a removed state in which the product is removed from the product shelf 80 and a placed state in which the product is placed on the product shelf 80.

[0039] In the confronting person file 261, each time a product moves on the product shelf 80 facing the person detected by the confronting person detection unit 21 until the person moves out of the monitored area ARa, individual item movement data relating to the movement is stored in chronological order. The monitoring end flag is one-bit data that is set when monitoring of the person identified by the confronting person ID ends. In this embodiment, monitoring ends when the person identified by the confronting person ID moves out of the monitored area ARa and is no longer detected by the confronting person detection unit 21.

[0040] [Description of transaction processing device] Transaction processing device 30 creates a list of products purchased by a shopper, a so-called purchase list, and settles transactions with the shopper based on the data in the purchase list.

[0041] 7 is a block diagram showing the functional configuration of transaction processing device 30. Transaction processing device 30 has functions as registration processing unit 31, return processing unit 32, individual item recognition unit 33, payment processing unit 34, clock unit 35, first communication unit 36, second communication unit 37, memory unit 38, and control unit 39.

[0042] The registration processing unit 31 executes a process for registering sales data of products purchased by a shopper from the product shelf 80 in a purchase list. For example, when the barcode of a product is scanned by the user terminal 70, the registration processing unit 31 searches the product database 51 for the product code obtained from the barcode. The registration processing unit 31 then obtains product data including the product code from the product database 51, generates sales data based on the product data, and registers it in the purchase list.

[0043] The return processing unit 32 executes a process for canceling from the purchase list the sales data of a product that a shopper has returned to the product shelf 80. For example, when the barcode of a product is scanned after a return operation on the user terminal 70, the return processing unit 32 deletes the sales data including the product code obtained from the barcode from the purchase list.

[0044] The individual item recognition unit 33 executes a process for recognizing the individual item ID of an item purchased by a shopper from the product shelf 80 or an item returned by a shopper to the product shelf 80. When a shopper purchases an item picked up from the product shelf 80, the shopper scans the barcode of the item with the user terminal 70 and then places the item in a shopping basket. The individual item recognition unit 33 then recognizes the individual item ID contained in the individual item movement data for the past date and time closest to the current date and time, among the individual item movement data containing the product code of the scanned barcode, as the individual item ID of the item purchased by the shopper from the product shelf 80. When a shopper returns a scanned item to the product shelf 80 for return, the shopper performs a return operation on the user terminal 70, scans the barcode of the item with the user terminal 70, and then returns the item to the product shelf 80. The individual item recognition unit 33 then recognizes the individual item ID contained in the individual item movement data for the future date and time closest to the current date and time among the individual item movement data including the product code of the scanned barcode as the individual item ID of the product returned by the shopper to the product shelf 80.

[0045] In addition, by installing a reader for reading the wireless tags attached to items in the shopping basket, for example, in a shopping cart, the individual item recognition unit 33 may recognize the RFID of the newly read wireless tag as the individual item ID of the item that the shopper purchased from the product shelf 80, and recognize the RFID of the wireless tag that can no longer be read after the return operation as the individual item ID of the item that the shopper returned to the product shelf 80.

[0046] The payment processing unit 34 executes a process for settling a transaction with a shopper based on the data in the purchase list. The payment method is not particularly limited. Existing payment methods such as cash payment, credit card payment, electronic money payment, code payment, etc. can be used as is.

[0047] The clock unit 35 keeps track of the date and time. The individual item recognition unit 33 regards the date and time kept by the clock unit 35 as the current date and time. The first communication unit 36 ​​is connected to a communication network 60. The first communication unit 36 ​​performs data communication with other devices connected to the communication network 60 in accordance with a predetermined communication protocol. The second communication unit 37 is connected to an access point. The second communication unit 37 performs wireless communication with the user terminal 70 via the access point.

[0048] Storage unit 38 includes a nonvolatile memory area and a volatile memory area. Storage unit 38 stores a control program for controlling the operation of transaction processing device 30 in the nonvolatile memory area. Storage unit 38 stores data necessary for operation as transaction processing device 30 in the volatile memory area. The nonvolatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0049] The control unit 39 controls the registration processing unit 31, the return processing unit 32, the payment processing unit 34, the clock unit 35, the first communication unit 36, the second communication unit 37, and the memory unit 38 in accordance with the control program. The control unit 39 is mainly composed of a processor. The processor is, for example, a CPU.

[0050] Transaction processing device 30 uses a part of the volatile memory area of ​​storage unit 38 as an area for transaction file 381. Transaction file 381 is an area for storing data of a purchase list for each shopper who performs self-registration using user terminal 70.

[0051] 8 is a schematic diagram showing main items of data stored in the transaction file 381. The transaction file 381 stores a terminal ID, at least one sales data, payment data, and a transaction completion flag. The terminal ID is a unique code set for each user terminal 70 to identify each user terminal 70. A unique terminal ID is set in the memory unit of each user terminal 70.

[0052] The sales data is data consisting of a product code, a product name, a price, an individual product ID, a processing date and time, and a cancellation flag. The sales data may include information other than the product code, the product name, the price, the individual product ID, the processing date and time, and the cancellation flag. The product code, the product name, and the price are product data set in the product database 51. The individual product ID is an individual product ID recognized by the individual product recognition unit 33. The processing date and time is the date and time measured by the clock unit 35 at the time when the sales data is registered or canceled. The cancellation flag is 1-bit data that is set when the sales data is canceled. A purchase list is created by the sales data in which the cancellation flag is in a reset state. The payment data is data of the price used to settle the transaction. For example, in the case of a transaction settled by credit card payment, the credit payment amount becomes the payment data. In the case of a transaction settled by electronic money payment, the payment amount by electronic money becomes the payment data. The transaction completion flag is 1-bit data that is set when a transaction with a shopper using a user terminal 70 identified by a terminal ID is settled.

[0053] [Explanation of the individual item management device] The individual item management device 40 manages the correspondence between the items displayed and sold on the product shelves 80 and the people involved in the movement of those items on an individual item basis based on the data processed by the person tracking device 10, the shelf monitoring device 20, and the transaction processing device 30, respectively.

[0054] 9 is a block diagram showing the functional configuration of the individual item management device 40. The individual item management device 40 has functions as an individual item movement acquisition unit 41, a person flow line acquisition unit 42, a purchased item acquisition unit 43, a clock unit 44, a communication unit 45, a memory unit 46, and a control unit 47.

[0055] The individual item movement acquisition unit 41 acquires at least one confrontation person file 261 to be processed from the shelf monitoring device 20. The person flow line acquisition unit 42 acquires at least one flow line file 151 to be processed from the person tracking device 10. Purchased product obtaining unit 43 obtains from transaction processing device 30 at least one transaction file 381 to be processed.

[0056] The clock unit 44 keeps track of the date and time. The communication unit 45 is connected to a communication network 60. The communication unit 45 performs data communication with other devices connected to the communication network 60 in accordance with a predetermined communication protocol.

[0057] The storage unit 46 includes a non-volatile memory area and a volatile memory area. The storage unit 46 stores a control program for controlling the operation of the individual item management device 40 in the non-volatile memory area. The storage unit 46 stores data necessary for the operation of the individual item management device 40 in the volatile memory area. The non-volatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0058] The control unit 47 controls the individual item movement acquisition unit 41, the person flow line acquisition unit 42, the purchased item acquisition unit 43, the clock unit 44, the communication unit 45, and the memory unit 46 in accordance with the control program. The control unit 47 is mainly composed of a processor. The processor is, for example, a CPU.

[0059] The individual item management device 40 uses part of the volatile memory area of ​​the storage unit 46 as an area for a movement history table 461 and an area for an individual item management file 462 .

[0060] 10 is a schematic diagram showing the configuration of the movement history table 461. The movement history table 461 has areas for writing the date and time, section ID, individual item status, confrontation person ID, and confrontation position coordinates in the order of a series of table numbers (No.) from "1" to "N".

[0061] 11 is a schematic diagram showing main items of data stored in the individual item management file 462. The individual item management file 462 stores an individual item ID, a product code, at least one individual item management data, and a management end flag.

[0062] The individual item management data includes a date and time, a confronting person ID, a person ID, an attribute, an event, and a section ID. The individual item management data may include items other than the date and time, the confronting person ID, the person ID, the attribute, the event, and the section ID. The date and time is the date and time when the movement of the item identified by the individual item ID was detected by the movement detection unit 22 of the shelf monitoring device 20. The confronting person ID is the confronting person ID detected by the confronting person detection unit 21 of the shelf monitoring device 20 when the movement of the item was detected at the above date and time. The person ID and the attribute are the person ID and the attribute of the flow line file 151 including the person flow line data of the person whose person status is in a stationary state at the above date and time at the location of the position coordinates whose XY coordinates match the confronting position coordinates of the confronting person file 261 including the above confronting person ID. The event will be described later. The section ID is the section ID detected by the movement detection unit 22 of the shelf monitoring device 20 when the movement of the item was detected at the above date and time.

[0063] The management end flag is one-bit data that is set when the individual item identified by the individual item ID is purchased by a shopper or collected from the store.

[0064] [Store system operation explanation] Fig. 12 is a flow chart showing the procedure of information processing executed by the control unit 16 of the person tracking device 10. Fig. 13 is a flow chart showing the procedure of information processing executed by the control unit 27 of the shelf monitoring device 20. Fig. 14 is a flow chart showing the procedure of information processing executed by the control unit 39 of the transaction processing device 30. Figs. 15 to 17 are flow charts showing the procedure of information processing executed by the control unit 47 of the individual item management device 40. Note that the procedure of information processing is not limited to that shown in the flow chart. The procedure can be changed as appropriate as long as similar operational effects can be obtained.

[0065] First, the operation of the person tracking device 10 will be described with reference to FIGS. In ACT1, the control unit 16 of the person tracking device 10 waits for a person to be detected by the person detection unit 11. When a shopper or store clerk enters an area in the store that can be tracked by the tracking unit 12, the person detection unit 11 detects the person. The control unit 16 judges YES in ACT1 and proceeds to ACT2. In ACT2, the control unit 16 recognizes the attributes of the person determined by the person detection unit 11.

[0066] If the attribute is a store clerk, the control unit 16 determines YES in ACT2 and proceeds to ACT3. The control unit 16 generates a person ID for the store clerk in ACT3. For example, the control unit 16 generates a code that combines the symbol "S" and a four-digit number as the person ID for the store clerk.

[0067] If the attribute is not a store clerk, i.e., if the attribute is a shopper, the control unit 16 judges NO in ACT2 and proceeds to ACT4. The control unit 16 generates a person ID for the shopper in ACT4. For example, the control unit 16 generates a code that combines the symbol "C" and a four-digit number as the person ID for the shopper.

[0068] When the process of ACT3 or ACT4 is completed, the control unit 16 proceeds to ACT5. The control unit 16 creates a flow line file 151 in the storage unit 15 as ACT5. That is, when a store clerk is detected, the control unit 16 creates a flow line file 151 that stores a person ID for the store clerk and attributes indicating the store clerk. When a shopper is detected, the control unit 16 creates a flow line file 151 that stores a person ID for the shopper and attributes indicating the shopper. Then, the control unit 16 registers the first person flow line data as ACT6. The date and time of the person flow line data is the current date and time measured by the clock unit 13. The position coordinates are three-dimensional coordinates calculated by the tracking unit 12 based on the point where the person was detected. The person status is arbitrary. The person status may be in a moving state or a stationary state. The control unit 16 resets the tracking end flag of the flow line file 151 to "0" as ACT7.

[0069] The control unit 16 waits for the monitoring time to elapse in ACT8. The monitoring time is a time effective for determining whether a person is moving or stationary. For example, if a person is deemed stationary when it is detected that the person remains in one place for 5 seconds or more, the monitoring time is set to 5 seconds. When the monitoring time has elapsed, the control unit 16 judges YES in ACT8 and proceeds to ACT9. In ACT9, the control unit 16 checks whether the tracking unit 12 has been able to track the person.

[0070] If the person has been tracked, the control unit 16 judges YES in ACT9 and proceeds to ACT10. In ACT10, the control unit 16 acquires the current position coordinates of the person. Then, in ACT11, the control unit 16 checks whether the position coordinates match the position coordinates of the person flow line data registered in the flow line file 151 immediately before. For example, if the length of the line segment connecting the previous position coordinates and the current position coordinates is equal to or less than a predetermined length, the control unit 16 considers the position coordinates to match. If the length of the line segment exceeds the predetermined length, the control unit 16 considers the position coordinates to be misaligned.

[0071] If the position coordinates are shifted, the control unit 16 recognizes that the person is moving. The control unit 16 judges YES in ACT 11 and proceeds to ACT 12. In ACT 12, the control unit 16 sets the person status to a moving state.

[0072] If the position coordinates match, the control unit 16 recognizes that the person is stationary. The control unit 16 judges NO in ACT 11 and proceeds to ACT 13. In ACT 13, the control unit 16 sets the person status to a stationary state.

[0073] Upon completing the processing of ACT12 or ACT13, the control unit 16 proceeds to ACT14. The control unit 16 registers person flow line data in the flow line file 151 as ACT14. The date and time of the person flow line data is the current date and time measured by the clock unit 13. The position coordinates are three-dimensional coordinates calculated by the tracking unit 12 based on the point where the person was detected. The person status is information on the state set in the processing of ACT12 or ACT13. That is, if the person is determined to be moving in ACT11, the person status is in a moving state. If the person is determined to be stationary in ACT11, the person status is in a stationary state.

[0074] When the process of ACT14 is completed, the control unit 16 returns to ACT8. That is, the control unit 16 waits for the monitoring time to elapse. Then, when the monitoring time elapses, the control unit 16 executes the processes from ACT9 onwards in the same manner as described above. Therefore, in the flow line file 151 in which the person ID of the person being tracked by the tracking unit 12 is set, person flow line data is registered every time the monitoring time elapses.

[0075] If the person leaves an area that can be tracked by the tracking unit 12 and the tracking unit 12 is no longer able to track the person, the control unit 16 judges NO in ACT 9 and proceeds to ACT 15. The control unit 16 sets the tracking end flag of the flow line file 151 in which the person ID of the person is set to "1" in ACT 15. With this, the control unit 16 ends the information processing of the procedure shown in the flowchart of FIG.

[0076] In this way, the control unit 16 executes the processes of ACT1 to ACT15, so that the person tracking device 10 functions as a flow line tracking means for tracking the flow line of a person moving within the store. With this function, the person tracking device 10 chronologically registers person flow line data related to the person in a flow line file 151 created for each person. The person flow line data consists of date and time, position coordinates, and person status. Therefore, by analyzing the person flow line data with a computer or the like, information on person behavior, such as how a person moved within the store over time and how long they stayed in a certain place, can be easily obtained.

[0077] Next, the operation of the shelf monitoring device 20 will be described with reference to FIGS. The control unit 27 of the shelf monitoring device 20 waits for the confronting person detection unit 21 to detect a person confronting the product shelf 80 in ACT21. When a store clerk or shopper enters the monitored area ARa, the confronting person detection unit 21 detects the person. The control unit 27 judges YES in ACT21 and proceeds to ACT22. Hereinafter, the person detected by the confronting person detection unit 21 will be referred to as a confronting person.

[0078] The control unit 27 generates a unique confrontation person ID for the confrontation person as ACT 22. The confrontation person ID is an arbitrary number string or a code combining letters and numbers that does not overlap with other confrontation person IDs at least within one business day. The control unit 27 also acquires confrontation position coordinates as ACT 23. The confrontation position coordinates are three-dimensional coordinates calculated by the confrontation person detection unit 21 based on the point where the confrontation person is detected.

[0079] The control unit 27 creates a confrontation person file 261 in the storage unit 26 in ACT 24. That is, the control unit 16 creates the confrontation person file 261 that stores the confrontation person ID generated in the process of ACT 22 and the confrontation position coordinates acquired in the process of ACT 23. The control unit 16 resets the tracking end flag of the confrontation person file 261 to "0" in ACT 25.

[0080] In ACT26, the control unit 27 checks whether the person standing against the object remains within the monitored area ARa. If the person standing against the object detection unit 21 detects a person standing against the object, the control unit 27 judges YES in ACT26 and proceeds to ACT27. In ACT27, the control unit 27 checks whether the movement detection unit 22 detects a movement of the product. If no movement of the product is detected, the control unit 27 judges NO in ACT27 and returns to ACT26. Here, the control unit 27 waits for the person standing against the object detection unit 21 to no longer be detected in ACT26 and ACT27, or for the movement detection unit 22 to detect a movement of the product.

[0081] In the standby state of ACT26 and ACT27, when the movement detection unit 22 detects the movement of the product, the control unit 27 judges YES in ACT27 and proceeds to ACT28. In ACT28, the control unit 27 acquires the current date and time measured by the clock unit 24 as the date and time when the movement of the product was detected by the movement detection unit 22. In addition, the control unit 27 acquires the individual item ID of the product whose movement was detected by the movement detection unit 22 in ACT29. That is, the control unit 27 acquires the RFID of the wireless tag recognized by the individual item recognition unit 23 as being attached to the moved product based on the information of the RFID read by the wireless tag reader 94. In addition, the control unit 27 acquires the section ID of the section in which the movement of the product was detected based on the information of the total weight measured by the weight sensor 92 as information related to the position of the product whose movement was detected by the movement detection unit 22 in ACT30.

[0082] The control unit 27 determines whether the movement of the product is in the removal direction or the placement direction as ACT 31. That is, when the movement detection unit 22 detects that the product has been removed from the product shelf 80 based on information on the total weight measured by the weight sensor 92 or information on the image detected by the camera sensor 93, the control unit 27 determines that the movement is in the removal direction. When the movement detection unit 22 detects that the product has been placed on the product shelf 80 based on the above information, the control unit 27 determines that the movement is in the placement direction.

[0083] If the control unit 27 determines that the movement of the product is in the removal direction, it judges YES in ACT31 and proceeds to ACT32. The control unit 27 sets the individual item status to a removal state in ACT32. If the control unit 27 determines that the movement of the product is in the placement direction, it judges NO in ACT31 and proceeds to ACT33. The control unit 27 sets the individual item status to a placement state in ACT33.

[0084] Upon completing the processing of ACT32 or ACT33, the control unit 16 proceeds to ACT34. The control unit 16 registers individual item movement data in the confronting person file 261 as ACT34. The date and time of the individual item movement data is the date and time obtained in the processing of ACT28. The individual item ID is the individual item ID obtained in the processing of ACT29. The product code is the product code stored in association with the individual item ID in the individual item database 52. The section ID is the section ID obtained in the processing of ACT30. The individual item status is status information set in the processing of ACT32 or ACT33. That is, if the removal direction is determined in ACT31, the individual item status is the removal state. If the placement direction is determined in ACT31, the individual item status is the placement state.

[0085] When the process of ACT 34 is completed, the control unit 27 returns to ACT 26. That is, the control unit 27 waits again until the confrontation person detection unit 21 no longer detects a confrontation person or the movement detection unit 22 detects the movement of the product.

[0086] In this standby state, when the movement detection unit 22 detects the movement of the product again, the control unit 27 executes the process from ACT28 onwards in the same manner as described above. Therefore, new individual item movement data is registered in the confrontation person file 261. That is, when the confrontation person picks up the product from the product shelf 80, individual item registration data consisting of the date and time at that time, the individual item ID which is the RFID of the wireless tag attached to the product, the product code associated with the individual item ID, the section ID of the section where the product was placed, and the individual item status in the removed state is registered. When the confrontation person places the product on the product shelf 80, individual item registration data consisting of the date and time at that time, the individual item ID which is the RFID of the wireless tag attached to the product, the product code associated with the individual item ID, the section ID of the section where the product was placed, and the individual item status in the placed state is registered.

[0087] In the standby state of ACT26 and ACT27, when the confronting person detection unit 21 no longer detects the confronting person, the control unit 27 judges NO in ACT26 and proceeds to ACT35. In ACT35, the control unit 27 sets the tracking end flag of the confronting person file 261 to "1". With this, the control unit 27 ends the information processing of the procedure shown in the flowchart of FIG.

[0088] In this way, the shelf monitoring device 20 functions as movement detection means that detects movement of individual products sold in the store by the control unit 27 executing the processing of ACT27 in Figure 13. The shelf monitoring device 20 also functions as date and time acquisition means that acquires the date and time at which the movement of a product was detected by the movement detection means by the control unit 27 executing the processing of ACT28 in Figure 13. The shelf monitoring device 20 also functions as position acquisition means that acquires information indicating the position of a product whose movement has been detected by the movement detection means by the control unit 27 executing the processing of ACT30 in Figure 13.

[0089] Then, shelf monitoring device 20 chronologically registers individual item movement data relating to products moved by the attendant in attendant file 261 created for each attendant. The individual item movement data consists of date and time, individual item ID, item code, section ID, and individual item status. Therefore, by analyzing the individual item flow line data with a computer or the like, it is possible to easily obtain information relating to product movement, for each individual item, such as which section of product shelf 80 an attendant facing product shelf 80 picked up an item from, and which section of product shelf 80 an attendant placed the item in, over time.

[0090] Next, the operation of transaction processing device 30 will be described with reference to FIGS. Control unit 39 of transaction processing device 30 waits for a command to start registering products as ACT41. When starting shopping, a shopper operates user terminal 70 to make it possible to register purchased products. This operation causes user terminal 70 to wirelessly transmit a registration start command to transaction processing device 30. The registration start command includes the terminal ID set in user terminal 70. When control unit 39 receives the registration start command, it determines YES in ACT41 and proceeds to ACT42. Control unit 39 acquires the terminal ID from the registration start command as ACT42. Then control unit 39 creates transaction file 381 including the terminal ID in memory unit 38 as ACT43. Control unit 39 resets the transaction end flag of transaction file 381 to "0" as ACT44.

[0091] The control unit 39 checks whether or not a purchase command has been received from the user terminal 70 in ACT45. If a purchase command has not been received, the control unit 39 judges NO in ACT45 and proceeds to ACT46. The control unit 39 checks whether or not a return command has been received from the user terminal 70 in ACT46. If a return command has not been received, the control unit 39 judges NO in ACT46 and proceeds to ACT47. The control unit 39 checks whether or not a checkout command has been received in ACT47. If a checkout command has not been received, the control unit 39 judges NO in ACT47 and returns to ACT45. In this way, the control unit 39 waits for a command from the user terminal 70 in ACT45 to ACT47.

[0092] When a shopper uses the scanning function of the user terminal 70 to scan the barcode attached to an item picked up from the product shelf 80 in order to purchase the item, a purchase command is transmitted from the user terminal 70. The purchase command includes data of the scanned barcode.

[0093] When the control unit 39 receives the purchase command, it judges YES in ACT45 and proceeds to ACT48. In ACT48, the control unit 39 controls the individual item recognition unit 33 to execute individual item recognition processing. In this processing, the individual item recognition unit 33 recognizes the individual item ID of the item purchased by the shopper from the product shelf 80. Once the individual item ID is recognized, the control unit 39 controls the registration processing unit 31 to execute registration processing in ACT49. In this processing, the registration processing unit 31 generates sales data of the item with the barcode attached, and registers it in the transaction file 381. Specifically, the sales data consisting of the product code, product name, and price, the individual item ID recognized by the individual item recognition unit, the date and time currently measured by the clock unit 35, and the cancellation flag in the reset state are registered in the transaction file 381. When the registration processing is completed, the control unit 39 returns to the standby state in ACT45 to ACT47.

[0094] When a shopper performs a return operation on the user terminal 70 to return an item that has already been scanned, and then scans the barcode on the item, a return command is sent from the user terminal 70. The return command includes the data of the scanned barcode.

[0095] When the control unit 39 receives the return command, it judges YES in ACT46 and proceeds to ACT50. In ACT50, the control unit 39 controls the individual item recognition unit 33 to execute individual item recognition processing. In this processing, the individual item recognition unit 33 recognizes the individual item ID of the item that the shopper has returned to the product shelf 80. If the individual item ID is recognized, the control unit 39 controls the return processing unit 32 to execute return processing in ACT51. In this processing, the return processing unit 32 cancels the sales data of the barcoded item from the transaction file 381. Specifically, the cancellation flag of the sales data including the individual item ID recognized by the individual item recognition unit 33 is set to "1". In addition, the date and time of the sales data is updated to the date and time currently measured by the clock unit 35. When the return processing is completed, the control unit 39 returns to the standby state in ACT45 to ACT47.

[0096] When a shopper has finished shopping and performs a checkout operation on the user terminal 70, a checkout command is sent from the user terminal 70. The checkout command includes price payment data.

[0097] When the control unit 39 receives the accounting command, it judges YES in ACT47 and proceeds to ACT52. In ACT52, the control unit 39 controls the payment processing unit 34 to execute payment processing. Through this process, the payment processing unit 34 executes payment processing based on the payment data. For example, if the payment data is a credit card payment amount, payment processing for credit card payment is executed. If the payment data is an amount paid by electronic money, payment processing for electronic money payment is executed. If the payment data is an amount paid by code payment, payment processing for code payment is executed.

[0098] When the settlement process is completed, the control unit 39 sets the transaction completion flag in the transaction file 381 to "1" in ACT 53. With this, the control unit 39 ends the information processing of the procedure shown in the flowchart of FIG.

[0099] In this way, transaction processing device 30 functions as a registration processing means when control unit 39 executes the processes in ACT48 and ACT49 of Figure 14. Also, transaction processing device 30 functions as a return processing means when control unit 39 executes the processes in ACT50 and ACT51 of Figure 14. Also, transaction processing device 30 functions as a payment processing means when control unit 39 executes the process in ACT52 of Figure 14.

[0100] Transaction processing device 30 then registers sales data relating to products purchased by the shopper, who is the user of user terminal 70, in transaction file 381 created for each user terminal 70. Therefore, by analyzing the sales data with a computer or the like, information on products purchased or returned by the shopper can be easily obtained, together with the processing date and time, for each individual product identified by the individual product ID.

[0101] Next, the operation of the individual item management device 40 will be described with reference to FIGS. 9, 10, 11, 15, 16 and 17. FIG. The control unit 47 of the individual item management device 40 starts information processing of the procedure shown in the flow chart of FIG. 15, for example, when the time measured by the clock unit 44 becomes the time after the store closes on each business day. The control unit 47 selects an individual item ID to be inspected in ACT61. For example, the control unit 47 selects an arbitrary individual item ID as the individual item ID to be inspected from the list of individual item IDs stored in the individual item database 52 according to a predetermined rule. At this time, the control unit 47 may select multiple individual item IDs. In that case, the control unit 47 repeatedly executes the processes of ACT62 to ACT71 described later for each individual item ID. Note that the method of selecting the individual item ID to be inspected is not limited to the above-mentioned method. In short, it is sufficient if the individual item ID to be inspected can be selected automatically or manually.

[0102] When acquiring the individual item ID of the inspection target, the control unit 47 creates an individual item management file 462 including the individual item ID of the inspection target in the storage unit 46 as ACT62. Then, the control unit 47 resets the management end flag of the individual item management file 462 to "0" as ACT62.

[0103] The control unit 47 controls the individual item movement acquisition unit 41 as ACT64 to collect from the shelf monitoring device 20 the confronting person file 261 in which individual item movement data including the individual item ID of the inspection target is registered. The control unit 47 acquires individual item movement data including the individual item ID of the inspection target from the confronting person file 261 collected as ACT65. The control unit 47 then creates a movement history table 461 as ACT66. Specifically, the control unit 47 creates a movement history table 461 in which the date and time, section ID, and individual item status of the individual item movement data, and the confronting person ID and confronting position information of the confronting person file 261 including that individual item movement data are arranged in order from earliest date and time, starting with table number No. = 1.

[0104] The control unit 47 initializes the number counter n to "0" in ACT 67. Next, the control unit 47 counts up the number counter n by "1" in ACT 68. Then, the control unit 47 checks whether the number counter n has exceeded the maximum value N of the table number No. in the movement history table 461 in ACT 69.

[0105] If the number counter n does not exceed the maximum value N, the control unit 47 judges NO in ACT 69 and proceeds to ACT 70. The control unit 47 executes an event determination process in ACT 70.

[0106] 16 is a flow chart showing the main steps of the event determination process. When the event determination process starts, the control unit 47 acquires data (date and time, section ID, individual item status, confrontation person ID, confrontation position coordinates) with the number counter n as the table number No. from the movement history table 461 as ACT81. For the sake of convenience, the data of table number No.=n acquired from the movement history table 461 will be referred to as number n data below.

[0107] The control unit 47 detects the date and time and the confrontation position coordinates from the number n data as ACT 82. Then, the control unit 47 controls the person flow line acquisition unit 42 as ACT 83 to acquire from the person tracking device 10 a flow line file 151 including person flow line data in which the date and time is immediately after the date and time detected from the number n data, the position coordinates match the confrontation position coordinates detected from the number n data, and the person status is stationary.

[0108] The control unit 47 specifies the person ID in the flow line file 151 acquired from the person tracking device 10 as the person ID of the person identified by the confrontation person ID of the number n data as ACT84. The control unit 47 also acquires attributes from the same flow line file 151 as ACT85. Furthermore, the control unit 47 acquires individual item status from the number n data as ACT86.

[0109] The control unit 47 checks whether the attribute acquired from the flow line file 151 indicates a store clerk in ACT87. If the attribute indicates a store clerk, the control unit 47 judges YES in ACT87 and proceeds to ACT88. The control unit 47 judges whether the individual item status acquired from the number n data indicates a placed state in ACT88. If the individual item status indicates a placed state, the movement of the item identified by the number n data is assumed to be a case where the store clerk puts the item on the product shelf 80. The control unit 47 judges YES in ACT88 and proceeds to ACT89. The control unit 47 determines the event to be "stocking" in ACT89.

[0110] If the individual item status indicates a removal state, the movement of the item identified by the number n data is assumed to be a case where a store clerk retrieves the item from the product shelf 80. The control unit 47 judges NO in ACT88 and proceeds to ACT90. The control unit 47 determines the event to be "recovery" in ACT90.

[0111] On the other hand, if the attribute acquired from the flow line file 151 indicates a shopper, the control unit 47 judges NO in ACT87 and proceeds to ACT91. The control unit 47 judges whether the individual item status acquired from the number n data indicates a removal state in ACT91. If the individual item status indicates a removal state, the movement of the item identified by the number n data is assumed to be a case in which the shopper picks up the item from the product shelf 80. The control unit 47 judges YES in ACT91 and proceeds to ACT92. The control unit 47 determines the event to be "pickup" in ACT90.

[0112] When the individual item status indicates a placed state, the movement of the item identified by the number n data is assumed to be a case where the shopper returns the item that he or she picked up from the product shelf 80 to its original place. The control unit 47 judges NO in ACT91 and proceeds to ACT93. The control unit 47 determines the event to be "return" in ACT93.

[0113] When an event is determined in ACT89, ACT90, ACT92 or ACT93, the control unit 47 ends the event determination process and proceeds to ACT71 in FIG. 15. The control unit 47 registers individual item management data in the individual item management file 462 as ACT71. In the individual item management data, the date and time, the section ID and the person ID facing the event are the date and time, the section ID and the person ID facing the event of the number n data. The person ID is the person ID identified in the process of ACT84 in FIG. 16. The attribute is the attribute acquired in the process of ACT85 in FIG. 16. The event is the event determined in ACT89, ACT90, ACT92 or ACT93 in FIG. 16.

[0114] After registering the individual item management data in the individual item management file 462, the control unit 47 returns to ACT68. That is, the control unit 47 further counts up the number counter n by "1". Then, the control unit 47 executes the processes from ACT69 onwards in the same manner as described above. Therefore, the control unit 47 repeatedly executes the processes of ACT70 and ACT71, that is, the process of determining an event accompanying the movement of an item by a store clerk or a shopper and registering the individual item management data including the event in the individual item management file 462, until the number counter n reaches the maximum value N.

[0115] When the number counter n reaches the maximum value N, the control unit 47 judges YES in ACT 69 and proceeds to ACT 72. The control unit 47 executes a final event judgment process in ACT 72.

[0116] 17 is a flow chart showing the main steps of the final event determination process. When the final event determination process starts, the control unit 47 acquires the event of the individual item management data last registered in the individual item management file 462 based on the number n data when the number counter n is at the maximum value N in ACT101. Hereinafter, this event will be referred to as the final event.

[0117] The control unit 47 checks whether the final event is "pick up" in ACT102. If the final event is not "pick up", the control unit 47 judges NO in ACT102 and proceeds to ACT103. The control unit 47 checks whether the final event is "recovery" in ACT103. If the final event is not "recovery", the control unit 47 judges NO in ACT103 and ends the final event judgment process.

[0118] If the final event is neither "pickup" nor "recovery", i.e., if it is "put out" or "return", the product with a wireless tag having an individual item ID in the individual item management file 462 containing the individual item management data as an RFID is displayed on the product shelf 80. Therefore, the final event maintains the status quo.

[0119] On the other hand, if the final event is "pickup", the control unit 47 judges YES in ACT102 and proceeds to ACT104. In ACT104, the control unit 47 controls the purchased product acquisition unit 43 to acquire the transaction file 381 in which the sales data including the individual product ID of the individual product management file 462 in which the individual product management data is registered is registered.

[0120] When the corresponding transaction file 381 is acquired from transaction processing device 30, control unit 47 checks the transaction end flag of that transaction file 381 in ACT105. If the transaction end flag is set to "1", the shopper managed in that transaction file 381 has completed payment for the transaction. In other words, the product with a wireless tag having an RFID as the individual item ID in individual item management file 462 in which the individual item management data is registered has been purchased by the shopper. In this case, control unit 47 judges YES in ACT105 and proceeds to ACT106. Control unit 47 changes the final event to "purchase" in ACT106.

[0121] If the transaction completion flag is not set to "1", the shopper managed in the transaction file 381 has not completed payment for the transaction. In other words, it is presumed that the product with a wireless tag having an RFID as the individual item ID in the individual item management file 462 in which the individual item management data is registered has been taken away without being paid for by the shopper. In this case, the control unit 47 judges NO in ACT105 and proceeds to ACT107. The control unit 47 changes the final event to "abnormal" in ACT107.

[0122] When the control unit 47 finishes the process of ACT106 or ACT107, the process proceeds to ACT 108. In ACT 108, the control unit 47 sets the management end flag of the individual item management file 462 in which the individual item management data is registered to "1".

[0123] On the other hand, if the final event is "collection", the control unit 47 judges YES in ACT103 and proceeds to ACT 108. In ACT 108, the control unit 47 sets the management end flag of the individual item management file 462 in which the individual item management data is registered to "1".

[0124] This is the end of the final event determination process by the control unit 47. When the final event determination process is completed, the control unit 47 ends the information processing of the procedure shown in FIG.

[0125] In this way, the control unit 47 executes the processes of ACT82 to ACT84, and the individual item management device 40 functions as a person identification means for identifying a person involved in the movement of an item whose movement is detected by the movement detection means. In detail, the control unit 47 identifies a person involved in the movement of an item based on the movement of each person tracked by the movement line tracking means. More specifically, the control unit identifies, from among the movement lines of each person, a person whose movement line is stationary at the point where the movement of the item is detected at the time the movement of the item is detected.

[0126] Furthermore, the control unit 47 executes the processes of ACT85 to ACT93, so that the individual item management device 40 functions as an event determination means for determining an event associated with the movement detected by the movement detection means. In particular, the control unit 47 determines the event based on the attributes of the person identified by the person identification means. More particularly, the control unit 47 determines the event based on the attributes of the person identified by the person identification means and the movement direction of the item whose movement is detected by the movement detection means.

[0127] Furthermore, the control unit 47 cooperates with the storage unit 46 to execute the processes of ACT67 to ACT72, so that the individual item management device 40 functions as a storage unit that stores individual item management data for each item that associates the date and time acquired by the date and time acquisition means with information on a person identified by the person identification means as being involved in the movement detected at that date and time. In detail, the control unit 47 stores individual item management data for each item that associates the above-mentioned date and time and person information with information on an event determined by the event determination means. More specifically, the control unit 47 stores individual item management data for each item that associates the above-mentioned date and time and person information with location information acquired by the location acquisition means, i.e., a section ID, in association with the above-mentioned date and time and person information.

[0128] The individual item management device 40 then chronologically registers individual item management data relating to the individual item in the individual item management file 462 created for each individual item of the product. As described above, the individual item management data associates the date and time when the product was moved with information on the person identified as being involved in the movement. Therefore, by analyzing the individual item management data with a computer, it is possible to easily obtain the time when each individual item was placed on the product shelf 80 or taken out of the product shelf, and information on the person involved in the movement. From this information, it is possible to easily analyze whether or not a person has picked up each individual item, and if so, how many times the item has been picked up, and further whether the person who picked it up was a shopper or a store clerk.

[0129] Furthermore, events related to the movement of goods can be understood from event information stored in association with time and person information. Specifically, when a store clerk puts a product on the product shelf 80, an event called "putting out" is included in the individual item management data. When a store clerk collects a product from the product shelf 80, an event called "collection" is included in the individual item management data. When a shopper picks up a product from the product shelf, an event called "pickup" is included in the individual item management data. When a shopper returns a product that was once picked up to the product shelf, an event called "return" is included in the individual item management data. Therefore, from the event information, it is easy to know whether the movement of goods related to the event is a movement related to putting out, a movement related to collection, a movement related to picking up, or a movement related to returning.

[0130] Furthermore, the location information stored in association with the time and person information makes it possible to ascertain the location where the movement of the product occurred, that is, the section of the product shelf 80. Therefore, when a shopper returns an item that he or she picked up, the shopper may return the item to a different location from the original location, and it is possible to easily ascertain when such an event occurred.

[0131] Furthermore, when the event of the individual item management data last registered in the individual item management file 462, that is, the final event, is "pickup," the individual item management device 40 determines whether or not the item managed by that individual item management data has been purchased by the shopper from the information in the transaction file 381 managed by the transaction processing device 30. If the item has been purchased, the individual item management device 40 sets the final event to "purchase." However, if the item has not been purchased, the individual item management device 40 sets the final event to "abnormal." Therefore, by verifying the event of the individual item management data last registered in the individual item management file 462, it is possible to easily determine whether or not an item has been shoplifted.

[0132] Although the embodiment of the store system 100 has been described above, the embodiment is not limited to this. In the above embodiment, the store system 100 is illustrated as being constructed in a store employing a self-registration system using a user terminal 70. The store system 100 is not necessarily limited to a system in a store employing a self-registration system using a user terminal 70. For example, even in a store in which products purchased by shoppers are registered in a POS (Point Of Sales) terminal by a store clerk or a self-service person at a checkout area called a cash register, the same effect as in the embodiment can be achieved by having a function of reading wireless tags attached to the products all at once when the products are registered in the POS terminal.

[0133] In the above embodiment, it is assumed that each product has a barcode indicating the product code. However, some products, such as fresh foods, may not have a barcode. In such a case, for example, a function for displaying a list of products without barcodes may be provided in the user terminal 70, and when a product is selected from the list, information on the selected product may be transmitted from the user terminal 70 to the transaction processing device and registered.

[0134] The above embodiment has been described as an example of a case where individual item data is collectively stored in the individual item database 52. In another embodiment, data set in the individual item database 52, such as a product code, in addition to the RFID as the individual item ID, is stored in the wireless tag attached to each individual item. By doing so, the individual item database 52 can be made unnecessary.

[0135] In the above embodiment, the attributes of a person are shoppers and store clerks. For example, for shoppers, attributes may include customer demographics such as gender and age. Such attributes can be obtained, for example, by analyzing images of shoppers. For store clerks, attributes may include employment status such as store manager, full-time employee, part-time employee, etc. Such attributes can be obtained, for example, by including employment status identification information in a beacon signal emitted from a nameplate carried by each store clerk and installing a receiver for this beacon signal on the product shelf.

[0136] In the above embodiment, the confronting person detection unit 21 generates an arbitrary confronting person ID. In this regard, the confronting person detection unit 21 may use as the confronting person ID a person ID in the flow line file 151 including the person flow line data of a person who became stationary at the position coordinates that match the confronting position coordinates within a predetermined time after detecting the confronting person.

[0137] In the above embodiment, a store system 100 is exemplified in which the person tracking device 10 has a function as a movement line tracking means, the shelf monitoring device 20 has functions as a movement detection means, a date and time acquisition means, and a position acquisition means, and the individual item management device 40 has functions as a person identification means, a storage means, and an event determination means. For example, the functions as the movement detection means, the date and time acquisition means, the person identification means, and the storage means may be realized by one computer device. In other words, by providing a program that can cause one computer to function as the movement detection means, the date and time acquisition means, the person identification means, and the storage means, a store system that can achieve the same effects as the above embodiment can be obtained.

[0138] Furthermore, the above-mentioned single computer device may have a function as an event determination means, a function as a position acquisition means, and a function as a flow line tracking means.

[0139] Although several other embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the invention and its equivalents described in the claims. The invention as originally claimed in the present application is set forth below. [1] A store system comprising: a movement detection means for detecting the movement of each item sold in a store; a date and time acquisition means for acquiring a date and time at which the movement of the item is detected by the movement detection means; a person identification means for identifying a person related to the movement of the item whose movement is detected by the movement detection means; and a storage means for storing, for each of the items, the date and time acquired by the date and time acquisition means and information on the person identified by the person identification means as being related to the movement detected at that date and time in association with each other. [2] The store system described in Appendix [1] further includes an event determination means for determining an event associated with the movement detected by the movement detection means, and the storage means stores information on the event determined by the event determination means for each of the products in association with the date and time and information on the person. [3] The store system according to appendix [2], wherein the event determination means determines an event based on attributes of the person identified by the person identification means. [4] A store system as described in any one of appendices [1] to [3], further comprising a location acquisition means for acquiring information indicating the location of a product whose movement is detected by the movement detection means, wherein the storage means stores the location information acquired by the location acquisition means for each of the products in association with the date and time and information on the person. [5] A store system as described in any one of appendices [1] to [4], further comprising a movement path tracking means for tracking the movement paths of people moving within the store, wherein the person identification means identifies people involved in the movement of goods based on the movement paths of each person tracked by the movement path tracking means. [6] A program for causing a computer to function as a movement detection means for detecting the movement of individual products sold in a store, a person identification means for identifying a person related to the movement of a product whose movement is detected by the movement detection means, a date and time acquisition means for acquiring the date and time at which the movement of the product was detected by the movement detection means, and a storage means for storing, for each of the individual products, in association with the date and time acquired by the date and time acquisition means and information on the person identified by the person identification means as being related to the movement detected at that date and time. [Explanation of symbols]

[0140] 10...person tracking device, 11...person detection unit, 12...tracking unit, 13,24,35,44...clock unit, 14,25,45...communication unit, 15,26,37,46...memory unit, 16,27,38,47...control unit, 20...shelf monitoring device, 21...opposite person detection unit, 22...movement detection unit, 23...individual item recognition unit, 30...transaction processing device, 31...registration processing unit, 32...return processing unit, 33...individual item recognition unit, 34...payment processing unit, 36...first communication unit, 37...second communication unit, 40...individual item management device, 41...individual item movement acquisition unit, 42...person movement line acquisition unit, 43...purchased item acquisition unit, 50...database server, 51...product database, 52...individual item database, 60...communication network, 70...user terminal 70...product shelf, 91, 93...camera sensor, 92...weight sensor, 94...wireless tag reader, 95...antenna, 151...movement line file, 261...opponent file, 381...transaction file, 461...movement history table, 462...individual item management file.

Claims

1. A movement detection means for detecting the movement of each item sold in the store; a date and time acquisition means for acquiring a date and time when the movement of the product is detected by the movement detection means; a person identification means for identifying a person related to the movement of the product whose movement is detected by the movement detection means; an event determination means for determining an event associated with the movement detected by the movement detection means based on an attribute of the person identified by the person identification means; a storage means for storing, for each of the products, the date and time acquired by the date and time acquisition means, information on a person identified by the person identification means as being involved in the movement detected at the date and time, and information on the event determined by the event determination means, in association with each other; Equipped with The event determination means When the attribute of the person is a store clerk and the movement of the product is a movement to place the product on a product shelf, the event is determined to be "stocking the product", When the attribute of the person is a store clerk and the movement of the product is a movement of removing the product from a product shelf, the event is determined to be "collection"; When the attribute of the person is a customer and the movement of the product is a movement to place the product on a product shelf, the event is determined to be "return"; When the attribute of the person is a customer and the movement of the product is a movement of the product being taken out from a product shelf, the store system determines the event to be "pickup."

2. a position acquisition means for acquiring information indicating a position of a commodity whose movement has been detected by the movement detection means; Further comprising:

2. The store system according to claim 1, wherein the storage means stores the location information acquired by the location acquisition means in association with the date and time and the person information for each of the products.

3. A flow line tracing means for tracing the flow line of a person moving within the store; Further comprising:

3. The store system according to claim 1, wherein the person identification means identifies a person involved in the movement of merchandise based on the movement of each person tracked by the movement line tracking means.

4. Computer, a movement detection means for detecting the movement of each item sold in the store; a date and time acquisition means for acquiring a date and time when the movement of the product is detected by the movement detection means; a person identification means for identifying a person related to the movement of the commodity whose movement is detected by the movement detection means; an event determination means for determining an event associated with the movement detected by the movement detection means based on an attribute of the person identified by the person identification means; and a storage means for storing, for each of the products, the date and time acquired by the date and time acquisition means, information on a person identified by the person identification means as being involved in the movement detected at the date and time, and information on the event determined by the event determination means, in association with each other; Function as a The event determination means When the attribute of the person is a store clerk and the movement of the product is a movement to place the product on a product shelf, the event is determined to be "stocking the product", When the attribute of the person is a store clerk and the movement of the product is a movement of removing the product from a product shelf, the event is determined to be "collection"; When the attribute of the person is a customer and the movement of the product is a movement to place the product on a product shelf, the event is determined to be "return"; When the attribute of the person is a customer and the movement of the product is a movement of the product being taken out from a product shelf, the program determines the event to be "pickup."

Images