Display fixtures

Abstract

To allow an automatic registration of an item while reducing the load of introducing a system for a store.SOLUTION: The display container according to an embodiment includes a display unit, monitoring means, movement detection means, and determination means. The display unit displays an item. The monitoring means monitors actions of a person in a purchase area defined around the display unit. The movement detection means detects a movement of an item from the display unit. The determination means determines an item that has been moved from the display unit to be a transaction item related to the person on the basis of the result of monitoring by the monitoring means and the result of detection by the movement detection means.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] FIELD OF THE INVENTION An embodiment of the present invention relates to a display fixture. [Background technology]

[0002] In recent years, labor shortages have become a social problem in the retail industry, and there is an increasing demand for systems to solve this problem. To address this issue, various store systems have been proposed that automatically register the products purchased by consumers based on their in-store behavior, eliminating the need to register products at checkout. One such system identifies consumers who remove products from shelves near the shelves they are removed from as the purchasers of those products. However, in order to automate the entire store, such a store system requires changes to the store layout and the installation of numerous cameras, placing a significant burden on the store. Therefore, there is a need for a system that can automatically register products while reducing the system installation burden on the store. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-150123 Summary of the Invention [Problem to be solved by the invention]

[0004] The problem that the present invention aims to solve is to provide a display fixture that can automatically register products while reducing the burden on stores of introducing a system. [Means for solving the problem]

[0005] The display fixture of the embodiment comprises a display unit, a monitoring means, a tracking means, an activating means, a detecting means, and a transmitting means. The display unit displays merchandise. The monitoring means monitors the behavior of a person in a purchasing area defined around the display unit. The tracking means tracks the person and stores the information in a data record.Authentication flag and exit flag The means for turning on turns on the authentication flag of the data record when the person is located within a predetermined authentication area from the display unit based on the tracking result of the tracking means. The means for finding finds a data record in which the authentication flag is set to ON when the person's member ID has been notified. The means for transmitting Found out Data Records If the exit flag is set to ON, sales management Request data requesting the start of payment for the registered product is transmitted to the device. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a perspective view schematically showing the appearance of a display fixture according to one embodiment. [Figure 2] A block diagram showing the main circuit configuration of the display fixture and the general configuration of the transaction processing system. [Figure 3] FIG. 2 is a block diagram showing the main circuit configuration of a user interface unit. [Figure 4] FIG. 2 is a block diagram showing the main circuit configuration of the merchandise monitoring unit. [Figure 5] FIG. 2 is a diagram schematically showing the configuration of a data record included in a product management database. [Figure 6] FIG. 2 is a block diagram showing the main circuit configuration of a main processing unit. [Figure 7] FIG. 2 is a diagram illustrating the structure of a data record contained in a tracking database. [Figure 8] FIG. 2 is a diagram schematically showing the configuration of a data record included in a member management database. [Figure 9] FIG. 10 is a plan view showing the area setting status within the tracking area. [Figure 10] 10 is a flowchart of a tracking process. [Figure 11] 10 is a flowchart of a tracking process. [Figure 12] 10 is a flowchart of a monitoring process. [Figure 13] 10 is a flowchart of a customer service process. [Figure 14] 10 is a flowchart of a customer service process. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment will be described below with reference to the drawings. In this embodiment, a shelf-type display fixture and a transaction processing system using this display fixture will be described as an example. Furthermore, the transaction processing system will be described as an example of processing a transaction in which a customer purchases a product displayed in a store.

[0008] FIG. 1 is a perspective view schematically showing the appearance of a display fixture 101 according to this embodiment. The display fixture 101 mainly comprises a shelf 1. The shelf 1 is a hollow rectangular parallelepiped with one side open. The shelf 1 includes a plurality of shelf boards 1a, a plurality of casters 1b, a plurality of handles 1c, and a support member 1d.

[0009] Shelves 1a are attached to the interior space. The number and position of the shelves 1a are arbitrary, but FIG. 1 shows an example in which there are five shelves 1a. Products are displayed on the shelves 1a as shown in the figure. Thus, the shelf 1 is an example of a display section for displaying products. Casters 1b are attached to the bottom of shelf 1. These casters 1b allow display fixture 101 to be easily moved on the floor. In other words, casters 1b are an example of a moving part for moving shelf 1 as a display unit. The handles 1c are attached to the outer surfaces of the two side walls that are perpendicular to the opening of the shelf 1. The handles 1c are grasped by an operator when moving the display fixture 101. The number and positions of the handles 1c are optional. Also, the handles 1c do not have to be provided. The support member 1d is attached to the outer surface of the top board of the shelf 1 in a state where it protrudes upward. The support member 1d supports two tracking cameras 2, a surveillance camera 3, and a projector 4.

[0010] The two tracking cameras 2 capture images of people within a photography area that includes a purchasing area, a detection area, a reserve area, and a confirmation area, which will be described later. Each of the two tracking cameras 2 may capture images within the photography area, or only one tracking camera 2 may capture images of a portion of the photography area. Only one of the tracking cameras 2 may be used, or one or more additional tracking cameras 2 may be installed. The position of the tracking cameras 2 is also arbitrary. Images captured by the tracking cameras 2 are used to track people. This tracking will be described later. Well-known camera devices such as optical cameras, infrared cameras, TOF (time of flight) cameras, and stereo cameras can be used as the tracking cameras 2. Camera devices suitable for measuring the distance to a subject, such as TOF cameras or stereo cameras, are suitable for the tracking cameras 2.

[0011] The surveillance camera 3 captures images of the opening of the shelf 1 and the space outside the opening of the shelf 1. The images captured by the surveillance camera 3 are used to monitor the behavior of a person reaching into the shelf 1. This monitoring will be described later. The surveillance camera 3 can be any well-known camera device such as an optical camera, infrared camera, TOF camera, or stereo camera. A camera device suitable for measuring the distance to a subject, such as a TOF camera or stereo camera, is suitable for the surveillance camera 3. Projector 4 projects any image onto the floor. The line PL1 and letters PC1 shown in Fig. 1 are included in the image projected by projector 4. Note that projector 4 can be omitted, provided that measures such as laying a mat of a size equivalent to the area represented by line PL1 are taken.

[0012] User interface units (hereinafter referred to as UI units) 5 are attached to both sides of the open surface of shelf 1. The UI units 5 are equipped with a touch panel 5a and a reader 5b, and perform user interface operations. The touch panel 5a and the reader 5b will be described later. In the following, when it is necessary to distinguish between the two UI units 5, the UI unit 5 shown on the left side in FIG. 1 will be referred to as the "first UI unit 5," and the other UI unit 5 will be referred to as the "second UI unit 5."

[0013] 2 is a block diagram showing the main circuit configuration of display fixture 101 and the general configuration of transaction processing system 100. In FIG. 2, the same elements as those shown in FIG. 1 are denoted by the same reference numerals. A transaction processing system 100 is configured by display fixtures 101, a sales management device 102, and a settlement device 103 being able to communicate with each other via a communication network 104.

[0014] The sales management device 102 is an information processing device that performs information processing for managing the sales of merchandise displayed on the display fixtures 101. The payment device 103 is an information processing device that performs information processing for payment related to the sales of merchandise displayed on the display fixtures 101. As the communication network 104, for example, the Internet, a virtual private network (VPN), a local area network (LAN), a public communication network, a mobile communication network, etc. can be used alone or in appropriate combination. As an example, the display fixtures 101, the sales management device 102, and the payment device 103 are installed in one store. In this case, an in-store LAN is typically used as the communication network 104.

[0015] The display fixture 101 includes the tracking camera 2, surveillance camera 3, projector 4 and UI unit 5 also shown in FIG. 1, as well as multiple weighing scales 6, a communication unit 7, an in-furniture communication path 8, a product monitoring unit 9 and a main processing unit 10. The tracking camera 2, the monitoring camera 3, and the projector 4 are connected to a main processing unit 10. The UI unit 5 is also connected to an in-furniture communication path 8.

[0016] A plurality of weighing scales 6 are provided on shelf board 1a to measure the weight of the products displayed on shelf board 1a. One weighing scale 6 may be provided on one shelf board 1a, or a plurality of weighing scales 6 may be provided on one shelf board 1a. Weighing scale 6 outputs measurement data indicating the measured weight to product monitoring unit 9.

[0017] The communication unit 7 performs wireless communication for sending and receiving data via the communication network 104. When the communication network 104 is a LAN, for example, a well-known communication device conforming to the IEEE802.11 standard can be used as the communication unit 7. However, a communication device performing wired communication may also be used as the communication unit 7. The in-furniture communication path 8 enables data to be exchanged between the UI unit 5, the communication unit 7, the merchandise monitoring unit 9, and the main processing unit 10. As the in-furniture communication path 8, for example, a LAN is used.

[0018] The product monitoring unit 9 is an information processing unit that performs information processing for monitoring the display status of products on the shelf 1 based on the measurement data provided by the weighing scale 6. The main processing unit 10 is an information processing unit that performs information processing to identify the person who took the product from the shelf 1 based on images taken by the tracking camera 2 and the surveillance camera 3, and to have that person pay for the product.

[0019] Fig. 3 is a block diagram showing the main circuit configuration of the UI unit 5. In Fig. 3, the same elements as those shown in Figs. 1 and 2 are denoted by the same reference numerals. The UI unit 5 includes a processor 5c, a main memory 5d, an auxiliary storage unit 5e, a sound unit 5f, a communication unit 5g, and a transmission path 5h in addition to the touch panel 5a and reader 5b shown in FIG. The processor 5c is capable of communicating with the touch panel 5a, the reader 5b, the main memory 5d, the auxiliary storage unit 5e, the sound unit 5f, and the communication unit 5g via a transmission path 5h.

[0020] The touch panel 5a is a display device that displays various screens such as an operation screen, etc. The touch panel 5a is an operation device that receives operations according to the operation screen. The reader 5b reads the member ID (identifier) ​​from a medium carried by the customer. The reader 5b may be a well-known data reading device that reads a visible code such as a barcode or two-dimensional code displayed on the surface of a card or a display device. The reader 5b may also be another type of well-known data reading device such as a well-known magnetic card reader, IC (integrated circuit) card reader, or contactless card reader. The reader 5b may be equipped with multiple types of reading devices.

[0021] The processor 5c, the main memory 5d, and the auxiliary storage unit 5e are connected by a transmission line 5h, thereby forming a computer for controlling the UI unit 5. The processor 5c corresponds to the central part of the computer. The processor 5c executes information processing to realize various functions of the UI unit 5 in accordance with information processing programs such as an operating system and application programs. The processor 5c is, for example, a CPU (central processing unit).

[0022] The main memory 5d corresponds to the main storage portion of the computer. The main memory 5d includes a nonvolatile memory area and a volatile memory area. The main memory 5d stores the information processing program in the nonvolatile memory area. The main memory 5d may store data required for the processor 5c to execute information processing in either the nonvolatile or volatile memory area. The main memory 5d uses the volatile memory area as a work area where data is rewritten by the processor 5c as appropriate. The nonvolatile memory area is, for example, ROM (read only memory). The volatile memory area is, for example, RAM (random access memory).

[0023] The auxiliary storage unit 5e corresponds to the auxiliary storage portion of the computer. The auxiliary storage unit 5e may be a storage unit using a well-known storage device such as an EEPROM (electric erasable programmable read-only memory), a hard disk drive (HDD), or a solid state drive (SSD). The auxiliary storage unit 5e stores data used by the processor 5c when performing various processes, or data created by the processes performed by the processor 5c. The auxiliary storage unit 5e may also store the information processing program.

[0024] The sound unit 5f outputs various sounds such as voices and melodies. The communication unit 5g is an interface for data communication via the in-furniture communication path 8. As the communication unit 5g, for example, a well-known communication device for performing data communication via a LAN can be used. The transmission path 5h includes an address bus, a data bus, and control signal lines, and transmits data and control signals exchanged between the connected components.

[0025] The auxiliary storage unit 5e stores a UI program AP1, which is one of the information processing programs. The UI program AP1 is an application program that describes information processing for causing the UI unit 5 to function as a user interface for the display fixture 101.

[0026] Fig. 4 is a block diagram showing the main circuit configuration of the merchandise monitoring unit 9. In Fig. 4, the same elements as those shown in Figs. 1 and 2 are given the same reference numerals. The merchandise monitoring unit 9 includes a processor 9a, a main memory 9b, an auxiliary storage unit 9c, a communication unit 9d, an interface unit 9e, and a transmission line 9f.

[0027] The processor 9a, the main memory 9b, the auxiliary storage unit 9c, the communication unit 9d, and the interface unit 9e are capable of communicating with each other via a transmission path 9f. The processor 9a, the main memory 9b, and the auxiliary storage unit 9c are connected via the transmission path 9f to form a computer for controlling the merchandise monitoring unit 9. The processor 9a corresponds to the central part of the computer. The processor 9a executes information processing to realize various functions of the merchandise monitoring unit 9 in accordance with information processing programs such as an operating system and application programs. The processor 9a is, for example, a CPU.

[0028] The main memory 9b corresponds to the main storage portion of the computer. The main memory 9b includes a nonvolatile memory area and a volatile memory area. The main memory 9b stores the information processing program in the nonvolatile memory area. The main memory 9b may store data required for the processor 9a to execute information processing in either the nonvolatile or volatile memory area. The main memory 9b uses the volatile memory area as a work area where data is rewritten by the processor 9a as appropriate. The nonvolatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0029] The auxiliary storage unit 9c corresponds to the auxiliary storage portion of the computer. The auxiliary storage unit 9c may be a storage unit using a well-known storage device such as an EEPROM, HDD, or SSD. The auxiliary storage unit 9c stores data used by the processor 9a when performing various processes, or data created by the processes performed by the processor 9a. The auxiliary storage unit 9c may also store the information processing program.

[0030] The communication unit 9d is an interface for data communication via the in-furniture communication path 8. As the communication unit 9d, for example, a well-known communication device for performing data communication via a LAN can be used. A plurality of weighing scales 6 are connected to interface unit 9e. Interface unit 9e acts as an interface for transmitting and receiving data between processor 9a and weighing scale 6. As interface unit 9e, well-known devices such as various interface boards, for example, a USB (universal serial bus) board, can be used. A plurality of interface units 9e may be provided. The transmission path 9f includes an address bus, a data bus, and control signal lines, and transmits data and control signals exchanged between the connected components.

[0031] The auxiliary storage unit 9c stores a merchandise monitoring program AP2, which is one of the information processing programs. The merchandise monitoring program AP2 is an application program that describes the information processing described below for realizing the functions of the merchandise monitoring unit 9. A portion of the storage area of ​​the auxiliary storage unit 9c is used as the storage area for a merchandise management database DB1. The merchandise management database DB1 is a database for managing the merchandise displayed on the display fixtures 101.

[0032] FIG. 5 is a diagram showing a typical structure of a data record DR1 contained in the product management database DB1. The product management database DB1 is a collection of multiple data records DR1 associated with multiple weighing scales 6. Data record DR1 includes fields F11, F12, F13, and F14. Field F11 contains a weighing scale ID for distinguishing the associated weighing scale 6 from other weighing scales. Field F12 contains a product code for distinguishing the product placed on the associated weighing scale 6 from other products. The product code is an identification code established to identify products by SKU (stock keeping unit), and is, for example, a JAN (Japanese article number) code. Field F13 contains the weight of the individual product identified by the product code set in field F12. Field F14 contains the previous measurement value from the associated weighing scale 6. Note that data record DR1 may also contain fields in which other data other than those described above is set.

[0033] Fig. 6 is a block diagram showing the main circuit configuration of the main processing unit 10. In Fig. 6, the same elements as those shown in Figs. 1 and 2 are given the same reference numerals. The main processing unit 10 includes a processor 10a, a main memory 10b, an auxiliary storage unit 10c, a communication unit 10d, an interface unit 10e, and a transmission path 10f.

[0034] The processor 10a, the main memory 10b, the auxiliary storage unit 10c, the communication unit 10d, and the interface unit 10e are capable of communicating with each other via a transmission path 10f. The processor 10a, the main memory 10b, and the auxiliary storage unit 10c are connected by the transmission path 10f to form a computer for controlling the main processing unit 10.

[0035] The processor 10a corresponds to the central part of the computer. The processor 10a executes information processing to realize various functions as the main processing unit 10 in accordance with information processing programs such as an operating system and application programs. The processor 10a is, for example, a CPU.

[0036] The main memory 10b corresponds to the main storage portion of the computer. The main memory 10b includes a nonvolatile memory area and a volatile memory area. The main memory 10b stores the information processing program in the nonvolatile memory area. The main memory 10b may store data required for the processor 10a to execute information processing in either the nonvolatile or volatile memory area. The main memory 10b uses the volatile memory area as a work area where data is rewritten by the processor 10a as appropriate. The nonvolatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0037] The auxiliary storage unit 10c corresponds to the auxiliary storage portion of the computer. The auxiliary storage unit 10c may be a storage unit using a well-known storage device such as an EEPROM, HDD, or SSD. The auxiliary storage unit 10c stores data used by the processor 10a when performing various processes, or data created by the processes performed by the processor 10a. The auxiliary storage unit 10c may also store the information processing program.

[0038] The communication unit 10d is an interface for data communication via the in-furniture communication path 8. As the communication unit 10d, for example, a well-known communication device for performing data communication via a LAN can be used. The interface unit 10e is connected to two tracking cameras 2, a monitoring camera 3, and a projector 4. The interface unit 10e interfaces the processor 10a with the tracking camera 2, the monitoring camera 3, and the projector 4 to exchange data between them. As the interface unit 10e, well-known devices such as various interface boards, for example, a USB board, can be used. A plurality of interface units 10e may be provided. The transmission path 10f includes an address bus, a data bus, and control signal lines, and transmits data and control signals exchanged between the connected components.

[0039] The auxiliary memory unit 10c stores a tracking program AP3 and a customer interaction program AP4, each of which is an information processing program. The tracking program AP3 is an application program that describes the information processing described below for tracking a person. The customer interaction program AP4 is an application program that describes the information processing described below for customer interaction. Part of the memory area of ​​the auxiliary memory unit 10c is used as the memory area for the tracking database DB2 and the member management database DB3. The tracking database DB2 is a database for managing data for tracking the person being tracked. The member management database DB3 is a database for managing the members being tracked.

[0040] FIG. 7 is a diagram showing a typical structure of a data record DR2 contained in the tracking database DB2. The tracking database DB2 is a collection of data records DR2 associated with each tracked person. Each data record DR2 includes fields F21, F22, F23, F24, F25, F26, and F27. The data record DR2 may also include fields F28 and subsequent fields. Field F21 contains a tracking ID assigned to distinguish the associated person from other persons. The tracking ID is temporarily assigned to the person being tracked and is not data for identifying the individual. Field F22 contains a monitoring flag indicating whether the associated person is subject to behavior monitoring. In this embodiment, the monitoring flag indicates that the associated person is subject to behavior monitoring when it is in an on state. Field F23 contains a first authentication flag indicating whether the associated person is located within an authentication area corresponding to the first UI unit 5. Field F24 contains a second authentication flag indicating whether the associated person is located within an authentication area corresponding to the second UI unit 5. In this embodiment, when the first authentication flag and the second authentication flag are in an on state, they indicate that the associated person is located within the authentication area. A reserve flag indicating whether the associated person is located within a reserve area (described later) is set in field F25. In this embodiment, when the reserve flag is in an on state, it indicates that the associated person is located within the reserve area. A field F26 is set with an exit flag indicating whether the associated person has exited a tracking area (described later). In this embodiment, when the exit flag is in an on state, it indicates that the associated person has exited. Field F27 is set with detection data indicating the result of a single position detection for the associated person. As the associated person moves, fields setting with detection data indicating the result of position detection after the movement are sequentially added from field F28 onwards. Note that data record DR2 may include a field in which any data other than those described above is set.

[0041] FIG. 8 is a diagram showing a typical structure of a data record DR3 contained in the member management database DB3. The member management database DB3 is a collection of data records DR3 associated with each person who is the target of tracking and has completed member authentication. Therefore, the number of data records DR3 contained in the member management database DB3 varies depending on the number of relevant people. There may also be situations where the member management database DB3 does not contain any data records DR3. The data record DR3 includes fields F31 and F32. Field F31 is set with a member ID previously assigned to the associated person. Field F32 is set with a tracking ID for tracking the associated person. Note that the data record DR3 may also include fields in which any data other than those described above is set.

[0042] The merchandise monitoring unit 9 or the main processing unit 10 may be implemented using, for example, a general-purpose information processing device. The merchandise monitoring unit 9 or the main processing unit 10 is typically transferred in a state in which the merchandise monitoring program AP2 or the tracking program AP3 and the customer interaction program AP4 are stored in the auxiliary storage unit 9c or the auxiliary storage unit 10c, respectively, but the merchandise management database DB1 or the tracking database DB2 and the member management database DB3 are not. However, the merchandise monitoring unit 9 or the main processing unit 10 may be transferred in a state in which the merchandise monitoring program AP2 or the tracking program AP3 and the customer interaction program AP4 are not stored in the auxiliary storage unit 9c or the auxiliary storage unit 10c, or in which different versions of the same application programs are stored in the auxiliary storage unit 9c or the auxiliary storage unit 10c, along with the merchandise monitoring program AP2 or the tracking program AP3 and the customer interaction program AP4 separately. The merchandise monitoring unit 9 or the main processing unit 10 may then be configured by writing the merchandise monitoring program AP2 or the tracking program AP3 and the customer interaction program AP4 to the auxiliary storage unit 9c or the auxiliary storage unit 10c in response to an operator's operation. The product monitoring program AP2 or tracking program AP3 and customer interaction program AP4 can be transferred to the auxiliary storage unit 9c or auxiliary storage unit 10c by recording them on a removable recording medium such as a magnetic disk, magneto-optical disk, optical disk, or semiconductor memory, or by communication via a network. The product management database DB1 or tracking database DB2 and member management database DB3 are configured in the auxiliary storage unit 9c or auxiliary storage unit 10c by the processor 9a or 10a executing information processing based on the product monitoring program AP2 or tracking program AP3 and customer interaction program AP4. At least one of the product monitoring program AP2 and product management database DB1 may be stored in the main memory 9b. At least a portion of the tracking program AP3, customer interaction program AP4, tracking database DB2, and member management database DB3 may be stored in the main memory 10b.

[0043] Next, we will explain the operation of the transaction processing system 100 configured as above. Note that the content of the processing described below is an example, and it is possible to change the order of some of the processing, omit some of the processing, or add other processing as appropriate.

[0044] The display fixture 101 is expected to be temporarily installed in a storefront or the like during peak customer times, such as lunchtime, to display best-selling products during that time period, allowing unmanned sales of the displayed products. For this purpose, the display fixture 101 is provided with casters 1b and handles 1c and is configured to be easily moved by a store clerk or the like. However, the display fixture 101 may be installed anywhere, such as inside a company building, or may be permanently installed, and its use is not limited to the above example. If the display fixture is permanently installed, the casters 1b and handles 1c may be omitted. The electrical elements of the display fixture 101 may be powered by a commercial power source or the like using a power cable, or may be powered by a battery installed in the display fixture 101.

[0045] A rule for the use of display fixtures 101 is that when multiple products are displayed in a measurement area measured by one weighing scale 6 on shelf 1a, the multiple products must be identified by the same product code. A manager such as a store clerk then specifies which products will be displayed in which measurement area by performing a predetermined operation on UI unit 5. For example, processor 5c displays a GUI (graphical user interface) screen for selecting a measurement area on touch panel 5a, and receives designation of the measurement area by touching the GUI screen. Processor 5c also causes reader 5b to read a product barcode held up by the manager. Processor 5c then determines that the designated measurement area is designated to contain the product identified by the product code displayed in the product barcode read by reader 5b. Upon receiving this specification, processor 5c in UI unit 5 finds data record DR1 in product management database DB1, in which the scale ID of weighing scale 6 corresponding to the specified measurement area is set in field F11, and sets the product code of the specified product in field F12 of the corresponding data record DR1. At this time, for example, the manager places a specified number of the product in the corresponding measurement area. Processor 5c, for example, obtains the measurement value of weighing scale 6 corresponding to the corresponding measurement area and calculates the individual product weight by dividing the measurement value by the specified number. Processor 5c then sets the calculated individual product weight in field F13 of data record DR1 in which the above-mentioned product code is set. Processor 5c may set field F14 of the same data record DR1 with the obtained measurement value, or may temporarily set a predetermined value such as 0.

[0046] The product management database DB1 may be updated in any manner as long as it matches the display status of the products on the shelf 1a. For example, the processor 5c may update the product management database DB1 in response to an instruction from an external information processing device. The processor 5c may also access the sales management device 102 or any other server device via the communication unit 5g, the in-furniture communication path 8, and the communication network 104 to obtain the single product weight associated with the product code.

[0047] When the display fixture 101 is in an operational state for serving customers, the processor 10a in the main processing unit 10 executes information processing in accordance with the tracking program AP3 (hereinafter referred to as tracking processing). The tracking process is primarily a process of identifying the current location of the person being tracked (hereinafter referred to as the tracked person) within the tracking area, and confirming which of several areas defined within the tracking area relative to the display fixture 101 the location is in. Therefore, before explaining the tracking process, we will explain the areas defined within the tracking area.

[0048] FIG. 9 is a plan view showing the area setting status within the tracking area. As shown in FIG. 9, a purchase area AR1, a detection area AR2, a reserve area AR3, a confirmed area AR4, and two authentication areas AR5 are logically defined based on the position of the display fixture 101. A rectangular area encompassing the entire confirmed area AR4 is the tracking area. The specific areas to be defined as each may be arbitrarily determined, for example, by the creator of the tracking program AP3. In other words, the individual size of each area or the size ratio between multiple areas may be changed from the state shown in FIG. 9. Furthermore, the size of each area may be changeable in response to instructions from an operator such as a maintenance worker or store manager. In this way, it is possible to adjust each area taking into account the structure of the installation location of the display fixture 101.

[0049] The purchasing area AR1 is an area where customers who wish to remove products from the display fixtures 101 should be positioned. The projector 4 projects an image so that the outer edge of the purchasing area AR1 roughly coincides with the line PL1 shown in FIG. 1. If the size of the purchasing area AR1 is changeable as described above, the projector 4 is configured to be able to change the projection magnification of the image. The projector 4 changes the projection magnification in response to an operation by the maintenance worker or store manager, or in response to an instruction from, for example, the processor 10a of the main processing unit 10.

[0050] The detection area AR2 is an area in which a person to be tracked is newly detected. The detection area AR2 is defined, for example, as an area through which a person entering the purchasing area AR1 passes. In other words, the detection area AR2 is, for example, a strip-shaped area surrounding the purchasing area AR1. The detection area AR2 may partially overlap with the purchasing area AR1.

[0051] The reserve area AR3 and the determined area AR4 are areas used to determine whether a tracked person has left the tracking area. Both the reserve area AR3 and the determined area AR4 are defined as areas through which a person leaving the purchasing area AR1 passes. The reserve area AR3 is closer to the purchasing area AR1 than the determined area AR4. In the example of FIG. 9, a portion of the reserve area AR3 and a portion of the determined area AR4 overlap each other. The reserve area AR3 and the determined area AR4 may be adjacent to each other without overlapping. The reserve area AR3 is separated from the determined area AR4. However, a portion of the determined area AR4 and a portion of the reserve area AR3 may overlap each other. The determined area AR4 and the reserve area AR3 may be adjacent to each other without overlapping.

[0052] As described above, the two authentication areas AR5 correspond to the two UI units 5, respectively. In the following, when it is necessary to distinguish between the two authentication areas AR5, the authentication area AR5 corresponding to the first UI unit 5 will be referred to as the first authentication area AR5, and the authentication area AR5 corresponding to the second UI unit 5 will be referred to as the second authentication area AR5. In the example of Fig. 9, a circular area centered on the corresponding UI unit 5 is defined as the authentication area AR5.

[0053] The two tracking cameras 2 are set with their respective shooting directions and field-of-view sizes so that they each capture an image of a shooting area that includes at least the tracking area. The processor 10a performs information processing (hereinafter referred to as "detection processing") for determining the current position of a person based on images captured by the tracking cameras 2, separately from the tracking processing described below. For example, the processor 10a attempts to detect a person reflected in an image captured by the tracking cameras 2. If the processor 10a detects a person, it determines the person's location. Various well-known processes can be used as appropriate for determining the position of a person reflected in an image. If a camera device with a distance measurement function, such as a TOF camera or a stereo camera, is used as the tracking camera 2, the processor 10a may determine the person's current location by taking into account the measurement results of the function. The processor 10a periodically performs the detection processing at predetermined intervals.

[0054] 10 and 11 are flowcharts of the tracking process. In ACT11 of FIG. 10, the processor 10a waits for a new person to be tracked to be detected. For example, if the person detected as being located within the detection area by the above detection process is not a tracking target, the processor 10a determines YES and proceeds to ACT12. Note that when the processor 10a proceeds to ACT12 in this way, the tracking process continues and starts tracking processing in a different thread. In other words, in a situation where there are multiple people to be tracked, the tracking process is executed for each of those people in parallel. Then, if the person detected as being located within the detection area by the detection process is not a person to be tracked in another tracking process, the processor 10a determines that the person is not a tracking target.

[0055] In ACT12, the processor 10a determines a tracking ID for the newly detected person so that the tracking ID does not overlap with the tracking IDs of other people to be tracked. In ACT13, the processor 10a updates the tracking database DB2 to manage the newly detected person as a tracked person. For example, the processor 10a adds a new data record DR2 to the tracking database DB2. The processor 10a sets the tracking ID determined in ACT12 in field F21 of the new data record DR2. The processor 10a turns off all flags in fields F22 to F26 of the new data record DR2. The processor 10a sets detection data representing the current location and current date and time determined by the detection process for the newly detected person in field F27 of the new data record DR2. The processor 10a does not include fields F28 and subsequent fields in the new data record DR2. As a result, the newly detected person is designated as the person to be tracked. As mentioned above, multiple tracking processes may be executed in parallel, and multiple people may exist for the display fixture 101 to track at the same time, but in the following explanation, when the term "person to be tracked" is simply used, it refers to the person to be tracked who is the target of the tracking process being explained.

[0056] In ACT 14, the processor 10a checks whether the person being tracked has moved. If the processor 10a cannot confirm the movement of the person being tracked, it determines "NO" and proceeds to ACT 15. In ACT 15, the processor 10a checks whether the person being tracked has been lost. If tracking of the person being tracked is continuing, the processor 10a determines that the result is NO, and returns to ACT 14. Thus, in ACT14 and ACT15, the processor 10a waits for the person being tracked to move or be lost.

[0057] For example, each time a new result of the detection process is obtained, the processor 10a identifies a person to be tracked from among the newly detected people based on the current location of the newly detected person and the location represented by the detection data set in the data record DR2 associated with the person to be tracked.The processor 10a then determines whether the person to be tracked has moved based on the relationship between the current location of the person to be tracked and the location represented by the detection data set at the end of the data record DR2 associated with the person to be tracked.For example, if the distance between the two locations is equal to or greater than a predetermined threshold, the processor 10a determines that the person to be tracked has moved.If the person to be tracked has moved, the processor 10a determines YES in ACT14 and proceeds to ACT16.

[0058] In ACT16, the processor 10a checks whether the current location of the person being tracked is within the purchasing area AR1. If the current location of the person being tracked is outside the purchasing area AR1, the processor 10a determines NO and proceeds to ACT17. In ACT 17, the processor 10a checks whether the current position of the person to be tracked is outside the detection area AR2. If the current position of the person to be tracked is within the detection area AR2, the processor 10a determines NO and returns to ACT 14. Thus, in ACT14 to ACT17, the processor 10a waits for the person being tracked to move into the purchasing area AR1 or move in the opposite direction from the purchasing area AR1 and exit the detection area AR2.

[0059] If the person being tracked leaves the detection area AR2 without entering the purchasing area AR1, the processor 10a judges YES in ACT17 and proceeds to ACT18. The processor 10a determines that a person is lost when the data record DR2 associated with the person to be tracked in the tracking database DB2 is not updated for a predetermined period of time. If a loss occurs during the standby state of ACT14 and ACT15, the processor 10a determines YES in ACT15 and proceeds to ACT18.

[0060] In ACT18, the processor 10a updates the tracking database DB2 to exclude the tracking person from the tracking persons. For example, the processor 10a deletes the data record DR2 in which the tracking ID of the tracking person is set in the field F21 from the tracking database DB2. The processor 10a then ends the tracking process.

[0061] A person who wishes to purchase a product displayed on the display fixture 101 will pass through the detection area AR2 and proceed to the purchase area AR1. If the person being tracked moves in this manner, the processor 10a determines YES in ACT16 and proceeds to ACT19. In ACT19, the processor 10a turns on the monitoring flag set in the field F22 of the data record DR2 in which the tracking ID of the person to be tracked is set in the field F21.

[0062] In ACT20, the processor 10a adds a field containing new detection data to the end of data record DR2, in which the tracking ID of the person being tracked is set in field F21. The processor 10a sets the new detection data to data representing the current position and current time of the person being tracked, as determined in the most recent detection process. In this way, detection data is added as the person being tracked moves, thereby recording the movement trajectory of the person being tracked.

[0063] In ACT21, the processor 10a checks whether the person being tracked has moved. If the processor 10a cannot confirm the movement of the person being tracked, it determines NO and proceeds to ACT22. In ACT22, the processor 10a checks whether the person being tracked has been lost. If tracking of the person being tracked is continuing, the processor 10a determines that the result is NO, and returns to ACT21. Thus, the processor 10a waits for the person being tracked to move or be lost in ACT 21 and ACT 22. If the processor 10a confirms that the person being tracked has moved in the same manner as in ACT 14, it determines YES in ACT 21 and proceeds to ACT 23.

[0064] In ACT23, the processor 10a checks whether the current location of the person being tracked is within the purchasing area AR1. If the current location of the person being tracked is within the purchasing area AR1, the processor 10a determines YES and proceeds to ACT24. In ACT24, the processor 10a checks whether the current location of the person being tracked is within the first or second authentication area AR5. If the current location of the person being tracked is within the first or second authentication area AR5, the processor 10a determines YES and proceeds to ACT25. In other words, if the person being tracked is located in an area where the purchasing area AR1 and the first or second authentication area AR5 overlap, the processor 10a proceeds to ACT25.

[0065] In ACT25, the processor 10a turns on a first authentication flag if the person being tracked is located within the first authentication area, and turns on a second authentication flag if the person being tracked is located within the second authentication area.Then, the processor 10a returns to ACT20, adds detection data relating to the position of the person being tracked after movement, and returns to the standby state in ACT21.

[0066] If the current location of the person to be tracked is within the purchasing area AR1 but outside the first or second authentication area AR5, the processor 10a determines NO in ACT24 and proceeds to ACT26. In ACT 26, the processor 10a turns off both the first authentication flag and the second authentication flag. Then, the processor 10a returns to ACT 20, adds detection data related to the position of the person being tracked after moving, and then returns to the standby state in ACT 21.

[0067] When the person to be tracked leaves the purchasing area AR1, the processor 10a determines NO in ACT23 and proceeds to ACT27 in FIG. In ACT 27, the processor 10a adds a field to which the detection data is set, similar to ACT 20. That is, the processor 10a adds new detection data to the data record DR2 associated with the tracking person in order to record the above-mentioned movement of the tracking person.

[0068] In ACT28, the processor 10a checks whether the person being tracked has moved. If the processor 10a cannot confirm the movement of the person being tracked, it determines "NO" and proceeds to ACT29. In ACT 29, the processor 10a checks whether the person being tracked has been lost. If tracking of the person being tracked is continuing, the processor 10a determines that the result is NO, and returns to ACT 28. Thus, the processor 10a waits for the person being tracked to move or be lost in ACT 28 and ACT 29. If the processor 10a confirms that the person being tracked has moved in the same manner as in ACT 14, it determines YES in ACT 28 and proceeds to ACT 30.

[0069] In ACT30, the processor 10a checks whether the current location of the person being tracked is within the shopping area AR1. If the current location of the person being tracked is within the shopping area AR1, the processor 10a determines YES and returns to ACT20 in Fig. 10. In other words, if the person being tracked returns to the shopping area AR1, the processor 10a adds new detection data to record the above movement of the person being tracked, and then transitions to a standby state for ACT21 and ACT22.

[0070] If the person being tracked does not return to the purchasing area AR1, the processor 10a determines NO in ACT30 in FIG. 11 and proceeds to ACT31. In ACT31, the processor 10a checks whether the current location of the person being tracked is within the reserve area AR3. If the current location of the person being tracked is outside the reserve area AR3, the processor 10a determines "NO" and returns to ACT27. That is, the processor 10a adds new detection data to record the above movement of the person being tracked, and then returns to the standby state in ACT28 and ACT29.

[0071] If the person being tracked leaves the purchasing area AR1 and moves into the reserve area AR3 without returning to the purchasing area AR1, the processor 10a determines YES in ACT31 and proceeds to ACT32. In ACT32, the processor 10a turns on the auxiliary flag set in field F25 of the data record DR2 in which the tracking ID of the person to be tracked is set in field F21.

[0072] In ACT 33, the processor 10a checks whether the person being tracked has moved. If the processor 10a cannot confirm the movement of the person being tracked, it determines NO and proceeds to ACT 34. In ACT 34, the processor 10a checks whether the person being tracked has been lost. If tracking of the person being tracked is continuing, the processor 10a determines that the result is NO, and returns to ACT 33. Thus, the processor 10a waits for the person being tracked to move or be lost in ACT 33 and ACT 34. If the processor 10a confirms that the person being tracked has moved in the same manner as in ACT 14, it determines YES in ACT 33 and proceeds to ACT 35.

[0073] In ACT 35, the processor 10a checks whether the current position of the person being tracked is within the defined area AR4. If the current position of the person being tracked is outside the defined area AR4, the processor 10a determines NO and proceeds to ACT 36. In ACT36, the processor 10a checks whether the current position of the person being tracked is within the reserve area AR3. If the current position of the person being tracked is within the reserve area AR3, the processor 10a determines YES and returns to ACT33. Thus, in ACT33 to ACT36, the processor 10a waits for the person to move into the defined area AR4, move in the opposite direction from the defined area AR4 and leave the reserve area AR3, or be lost.

[0074] If the person being tracked leaves the preliminary area AR3 without entering the fixed area AR4, the processor 10a determines "NO" in ACT36 and proceeds to ACT37. In ACT37, the processor 10a turns off the auxiliary flag set in field F25 of the data record DR2 in which the tracking ID of the person being tracked is set in field F21. Then, the processor 10a returns to ACT27, that is, the processor 10a adds new detection data to record the above-mentioned movement of the person being tracked, and then transitions to the standby state in ACT28 and ACT29.

[0075] When the person being tracked passes through the reserve area AR3 and moves into the fixed area AR4 to leave the display fixture 101, the processor 10a determines YES in ACT35 and proceeds to ACT38. In ACT38, the processor 10a adds a field to which the detection data is set, similar to ACT20. That is, the processor 10a adds new detection data to the data record DR2 associated with the tracking person to record the above-mentioned movement of the tracking person. The processor 10a then proceeds to ACT39. If the processor 10a confirms that tracking of the person being tracked has been lost in either the standby state of ACT21 and ACT22 in Figure 10, the standby state of ACT28 and ACT29 in Figure 11, or the standby state of ACT33 and ACT34 in Figure 11, it judges YES in ACT22, ACT29 or ACT34 and proceeds to ACT39 in Figure 11.

[0076] In ACT39, the processor 10a turns off the monitoring flag set in the field F22 of the data record DR2 in which the tracking ID of the person to be tracked is set in the field F21. In ACT40, the processor 10a turns on the exit flag set in field F26 of the data record DR2 in which the tracking ID of the person being tracked is set in field F21, and the processor 10a then ends the tracking process.

[0077] By executing the tracking process as described above, the processor 10a can confirm the area in which each person is located and their movement trajectory based on the tracking database DB2. Based on the tracking results, the processor 10a also detects that the person has left the shelf 1 serving as a display section. Thus, by the processor 10a executing information processing based on the tracking program AP3, the computer with the processor 10a as its central part functions as a tracking means and a departure detection means.

[0078] On the other hand, when the display fixture 101 is in an operating state for serving customers, the processor 9a in the product monitoring unit 9 executes information processing (hereinafter referred to as monitoring processing) in accordance with the product monitoring program AP2. The monitoring processing is information processing for monitoring the movement of products displayed on the display fixture 101. FIG. 12 is a flowchart of the monitoring process.

[0079] In ACT41, the processor 9a checks whether or not the number of products displayed on the display fixture 101 has decreased. If the processor 9a cannot confirm this, it determines NO and proceeds to ACT42. In ACT42, the processor 9a checks whether or not the number of products displayed on the display fixture 101 has increased. If the processor 9a cannot confirm this, it determines NO and returns to ACT41. Thus, the processor 9a waits for the number of products to decrease or increase as ACT41 and ACT42.

[0080] When a customer removes an item that was displayed on display fixture 101 from display fixture 101, or when an item that was displayed on display fixture 101 falls from display fixture 101, the number of items displayed on display fixture 101 decreases. In this case, the measurement value on weight scale 6 in the measurement area where the item was placed decreases. Also, when an item that was temporarily removed from display fixture 101 is returned to display fixture 101, the number of items displayed on display fixture 101 increases. In this case, the measurement value on weight scale 6 in the measurement area where the item was placed increases.

[0081] If the measurement value of any weighing scale 6 has decreased, processor 9a determines YES in ACT41 and proceeds to ACT43. Note that processor 9a determines that the measurement value of a weighing scale 6 has decreased, for example, if the measurement value acquired from a weighing scale 6 is smaller than the previous measurement value set in field F14 of data record DR1 associated with the same weighing scale 6 in product management database DB1, and the difference between the two is equal to or greater than a specified value.

[0082] In ACT43, processor 9a determines the reduced product. For example, processor 9a finds data record DR1 in product management database DB1 in which the scale ID of scale 6 that measured the reduced measurement value as described above is set in field F11. Processor 9a then determines the reduced product as the product identified by the product code set in field F12 of the corresponding data record DR1.

[0083] In ACT 44, processor 9a calculates the number of items to be reduced. For example, processor 9a divides the difference value calculated in ACT 43 by the item weight set in field F13 of data record DR1 associated with the same weighing scale 6 in product management database DB1 to obtain a value, and performs a predetermined rounding operation to obtain an integer value to be reduced.

[0084] As ACT45, the processor 9a notifies the main processing unit 10 of the reduction in the number of products. For example, the processor 9a sends notification data for notifying the reduction in the number of products from the communication unit 9d to the main processing unit 10 via the in-furniture communication path 8. The processor 9a includes in the notification data identification data that identifies the notification as a reduction, the product code of the reduced product, and the reduced number. Thus, processor 9a detects the movement of merchandise from shelf 1 serving as a display section based on changes in the measured values ​​of weighing scale 6. Therefore, processor 9a executes information processing based on merchandise monitoring program AP2, and the computer with processor 9a as its central part functions as movement detection means.

[0085] On the other hand, if the measurement value of any weighing scale 6 has increased, processor 9a determines YES in ACT42 and proceeds to ACT 46. Note that processor 9a determines that the measurement value of a weighing scale 6 has increased if, for example, the measurement value acquired from a weighing scale 6 is greater than the previous measurement value set in field F14 of data record DR1 associated with the same weighing scale 6 in product management database DB1, and the difference between the two is equal to or greater than a specified value.

[0086] In ACT46, processor 9a determines the increased product. For example, processor 9a finds data record DR1 in product management database DB1 in which the scale ID of scale 6 that measured the increased measurement value as described above is set in field F11. Processor 9a then determines the increased product as the product identified by the product code set in field F12 of the corresponding data record DR1.

[0087] In ACT 47, processor 9a calculates the number of items to be increased. For example, processor 9a divides the difference value calculated in ACT 43 by the item weight set in field F13 of data record DR1 associated with the same weighing scale 6 in product management database DB1, and performs a predetermined rounding operation to obtain the resulting integer value, which is then used as the number of items to be increased.

[0088] As ACT48, the processor 9a notifies the main processing unit 10 of the increase in products. For example, the processor 9a sends notification data for notifying the increase in products from the communication unit 9d to the main processing unit 10 via the in-furniture communication path 8. The processor 9a includes in the notification data identification data that identifies the notification as an increase, the product code of the increased product, and the increased quantity.

[0089] Once the processor 9a has completed the notification in ACT45 or ACT48, it proceeds to ACT49 in either case. In ACT49, processor 9a updates the previous measurement value set in field F14 of data record DR1 associated in product management database DB1 with weighing scale 6 whose measurement value has changed to the new measurement value. Processor 9a then returns to the standby state of ACT41 and ACT42.

[0090] When the display fixture 101 is in an operating state for customer service, the processor 10a in the main processing unit 10 executes information processing in accordance with the customer service program AP4 (hereinafter referred to as customer service processing) in addition to the detection processing and tracking processing described above. 13 and 14 are flowcharts of the customer handling process.

[0091] In ACT51 in Fig. 13, the processor 10a checks whether or not the member ID has been notified. If the processor 10a cannot confirm the notification, it determines NO and proceeds to ACT52. In ACT 52, the processor 10a checks whether a decrease notification has been sent. If the processor 10a cannot confirm the notification, it determines "NO" and proceeds to ACT 53. In ACT 53, the processor 10a checks whether an increase notification has been sent. If the processor 10a cannot confirm the notification, it determines "NO" and proceeds to ACT 54. In ACT 54, the processor 10a checks whether the exit flag is turned on. If the processor 10a cannot check the relevant event, it determines "NO" and returns to ACT 51. Thus, in ACT51 to ACT54, the processor 10a waits for notification of the member ID, decrease or increase, or for the exit flag to be turned on.

[0092] Customers who have completed member registration are assigned a member ID to distinguish them from other customers. Registered customers can also register payment information for payment methods that do not involve the exchange of cash. The various personal information, member IDs, and payment information of registered customers are managed by the sales management device 102 or the payment device 103, or by a separate member server.

[0093] When a customer who has registered as a member wishes to pay for the purchase of a product displayed on display fixture 101 using registered payment information, he or she has UI unit 5 read the member ID. For example, the customer displays a barcode representing the member ID on the display device of a mobile information terminal carried by the customer, and has reader 5b of UI unit 5 read the barcode. Note that the method for reading the member ID in UI unit 5 may be any other method.

[0094] When the member ID is read by the reader 5b, the processor 5c in the UI unit 5 notifies the main processing unit 10 of the member ID through information processing based on the UI program AP1. For example, the processor 5c sends notification data including the member ID and identification data for identifying that the notification is for the member ID from the communication unit 5g to the in-furniture communication path 8, addressed to the main processing unit 10.

[0095] For example, if a customer is required to have the UI unit 5 read their member ID while facing the UI unit 5, and the size of the authentication area AR5 is appropriately determined, the same authentication flag will not be turned on for multiple tracking persons when the member ID is read by the UI unit 5. However, the processor 5c may identify a tracking person who has performed an action that caused the member ID to be read, for example, based on an image captured by the surveillance camera 3 or an image captured by another TOF camera, and notify the tracking ID of that tracking person.

[0096] When the notification data for notifying the member ID is received by the communication unit 10d, the processor 10a in the main processing unit 10 judges YES in ACT51 and proceeds to ACT55. In ACT55, the processor 10a acquires the tracking ID of the person to be tracked corresponding to the customer who had the UI unit 5 read the notified member ID. For example, if the member ID is notified from the first UI unit 5, the processor 10a finds from the tracking database DB2 a data record DR2 in which the first authentication flag is set to ON. If the member ID is notified from the second UI unit 5, the processor 10a also finds from the tracking database DB2 a data record DR2 in which the second authentication flag is set to ON. The processor 10a then acquires the tracking ID set in field F21 of the corresponding data record DR2. Note that if the processor 10a finds multiple data records DR2 in which the authentication flag corresponding to the UI unit 5 that notified the member ID is set to ON, the processor 10a selects one data record DR2 according to a predetermined rule. For example, the processor 10a selects the data record DR2 in which the position represented by the detection data set in the last field is closest to the center of the authentication area.

[0097] As ACT 56, processor 10a performs authentication processing for the notified member ID. For example, processor 10a queries a device that monitors various personal information, member IDs, and payment information about customers who have registered as members, and verifies that the notified member ID is a legitimate member ID assigned to the member.

[0098] In ACT 57, the processor 10a checks whether the authentication has been successful. If the authentication has been successful, the processor 10a determines YES and proceeds to ACT 58. In ACT58, the processor 10a updates the member management database DB3 to include a data record DR3 for managing the member whose member ID was read by the UI unit 5. That is, the processor 10a, for example, sets the notified member ID in field F31 and adds a new data record DR3 to the member management database DB3 in which the tracking ID acquired in ACT55 is set in field F32. The processor 10a then returns to the standby state of ACT51 to ACT54.

[0099] Thus, the processor 10a identifies the person being tracked as a member identified by the notified member ID. A member is identified as an individual through membership registration. In other words, the processor 10a identifies the individual person being tracked. Therefore, by the processor 10a executing information processing based on the customer service program AP4, the computer with the processor 10a as its central part functions as an identification means.

[0100] If the authentication in ACT56 fails, the processor 10a determines NO in ACT57 and proceeds to ACT59. In ACT59, the processor 10a executes error processing. The error processing is processing for notifying the customer that authentication has failed. For example, the processor 10a instructs the UI unit 5 that read the member ID to display a predetermined error screen for notifying the customer that authentication has failed. Alternatively, the processor 10a instructs the mobile information terminal that displays a barcode representing the member ID to display the above-mentioned error screen. Then, the processor 10a returns to the standby state of ACT51 to ACT54.

[0101] When the communication unit 10d receives the notification data for the decrease notification, the processor 10a determines YES in ACT52 and proceeds to ACT60 in FIG. In ACT60, processor 10a determines the person who removed the removed item from display fixture 101. For example, processor 10a extracts from tracking database DB2 all data records DR2 for which the monitoring flag set in field F22 is on, and determines all tracking persons identified by the tracking ID set in field F21 of the corresponding data records DR2 as candidates for the remover. When a customer removes an item from display fixture 101, they extend their arm toward the item, grasp the item, and then pull their arm back. Therefore, processor 10a, for example, identifies, based on images captured by surveillance camera 3, a tracking person who performed the above-mentioned behavior among the tracking persons who are candidates for the remover, and determines that tracking person as the remover.

[0102] More specifically, the processor 10a identifies the person who performed the above-mentioned behavior and further determines the location of the person by analyzing changes in multiple images captured by the surveillance camera 3 during a predetermined monitoring period, taking into account the period during which the behavior to take the product is performed. The processor 10a selects, from among the extracted data records DR2, the data record DR2 in which the position indicated by the detection data set in the last field is closest to the identified position. If the distance between the position indicated by the detection data set in the last field of the corresponding data record DR2 and the identified position is shorter than a specified distance, the processor 10a determines that the person being tracked, identified by the tracking ID set in field F21 of the corresponding data record DR2, is the taker. If the processor 10a cannot find the relevant person being tracked, it determines that the taker is unknown. In addition, the processor 10a measures the arm length of the person who took the item based on the relationship between the position indicated in the detection data set in the last field of the selected data record DR2 and the display position of the reduced item, and based on the image taken by the surveillance camera 3, and if the length is longer than the specified length, it may determine that the person who took the item is unknown.

[0103] In many cases, when the arm is pulled, the product moves, causing a change in the measurement value of the weighing scale 6. However, because it takes some time for the measurement value of the weighing scale 6 to stabilize due to factors such as the vibration of the shelf 1a, there is a time lag before the weighing scale 6 outputs a new measurement value. In other words, by the time the processor 10a receives the decrease notification, the user has already completed most of the product removal action. In other words, the above-mentioned monitoring period begins before the processor 10a receives the decrease notification. Therefore, the processor 10a buffers images captured by the surveillance camera 3 for a certain period of time in the auxiliary storage unit 10c, etc. Then, after receiving the decrease notification, the processor 10a analyzes the buffered images related to the monitoring period. Alternatively, the processing of ACT60 may be executed by the processor 10a as processing of a thread separate from the customer service processing. Thus, by having the processor 10a execute information processing based on the customer service program AP4, the computer with the processor 10a as its central part monitors the behavior of people in the purchasing area AR1 and functions as a monitoring means.

[0104] In ACT 61, the processor 10a checks whether the identification of the taker has been successful. If the identification of the taker has been successful, the processor 10a determines YES and proceeds to ACT 62. In ACT62, the processor 10a checks whether the tracking person determined to be the extractor has been authenticated as a member. The processor 10a searches the member management database DB3 for a data record DR3 in which the same tracking ID set in field F32 as that set in field F21 of the data record DR2 selected in ACT60 is set. If the corresponding data record DR3 is found, the processor 10a determines YES and proceeds to ACT63.

[0105] In ACT63, the processor 10a requests the sales management device 102 to register the item as a purchased item. For example, the processor 10a sends request data for this request from the communication unit 10d to the sales management device 102 via the in-furniture communication path 8. The request data is then relayed by the communication unit 7 and transmitted to the sales management device 102 via the communication network 104. The processor 10a includes in the request data identification data identifying this as a registration request, the product code of the purchased item, the purchased quantity, and the member ID. The processor 10a includes in the request data the product code included in the received notification data as the product code of the purchased item. The processor 10a includes in the request data the reduced quantity included in the received notification data as the purchased quantity. The processor 10a includes in the request data the member ID set in field F31 of the data record DR3 found in ACT62.

[0106] Thus, based on the monitoring results of processor 10a functioning as a monitoring means and the detection results of processor 9a functioning as a movement detection means, processor 10a determines that the item moved from shelf 1 serving as a display section is the transaction item related to the person being tracked. Therefore, by processor 10a executing information processing based on customer response program AP4, the computer with processor 10a as its central part functions as a determination means.

[0107] When the sales management device 102 receives the request data, it performs a registration process to register the products identified by the product codes included in the request data, in the number of purchases included in the request data, as purchased products of the member identified by the member ID included in the request data. This registration process may be similar to the process performed by existing transaction processing devices such as POS terminals.

[0108] If the processor 10a confirms in ACT62 that the member has not been authenticated, it judges the result as NO and proceeds to ACT64. For example, if the processor 10a cannot find a data record DR3 in the member management database DB3 in which the same tracking ID as that set in field F21 of the data record DR2 selected in ACT60 is set in field F32, it judges that the member has not been authenticated.

[0109] As ACT64, the processor 10a performs a first alarm action. The first alarm action is an action for prompting the user to pay for the product taken from the display fixture 101. As the first alarm action, the processor 10a instructs the UI unit 5 to display a predetermined screen, for example. As the first alarm action, the processor 10a instructs the UI unit 5 to output a predetermined voice message, for example. As the first alarm action, the processor 10a may perform any action other than the above, or may perform a plurality of actions. The content of the screen, voice message, etc. may be determined appropriately depending on the circumstances of the store in which the display fixture 101 is installed. In a store that has a checkout corner with a store clerk or a self-service checkout corner, for example, the content may prompt the user to pay at the checkout corner. Furthermore, in a store that restricts purchases of products displayed in the display fixture 101 to members only, the content may prompt the user to return the product to a store clerk, for example. This first warning operation makes it possible to make a customer who does not understand the service provided by the display fixture 101 take an item from the shelf 1 take appropriate action afterwards.

[0110] In addition, if customers who are not members are allowed to pay for products displayed on display fixture 101 at a checkout corner where a store clerk is present or at a self-service checkout corner, the fact that a person to be tracked who has not completed membership authentication has taken an item from shelf 1 does not constitute an abnormal state. Therefore, the first alarm operation in this case is not an alarm for an abnormal state. In a store that limits the purchase of products displayed on display fixture 101 to members only, the fact that a person to be tracked who has not completed membership authentication has taken an item from shelf 1 constitutes an abnormal state. Therefore, the first alarm operation in this case corresponds to an alarm for an abnormal state.

[0111] If the processor 10a is unable to identify the remover in ACT60, it determines NO in ACT61 and proceeds to ACT65. This case applies when the processor 10a determines in ACT60 that the remover is unknown as described above. This case also applies when a person who is not being tracked by the tracking process due to some kind of obstacle removes an item, or when an item falls from the shelf 1a. These cases correspond to abnormal states. Thus, the processor 10a executes information processing based on the customer service program AP4, and the computer with the processor 10a as its central part functions as an abnormality detection means.

[0112] In ACT65, the processor 10a issues a second alarm. The second alarm may be similar to the first alarm. However, the content of the second alarm may be different from that of the first alarm. For example, the content of the second alarm may be a prompt to the customer or nearby people to consult a store clerk. Alternatively, the second alarm may be a screen display or voice message output on the terminal device used by the store clerk. In this case, the content of the second alarm may be a prompt to the store clerk to confirm the situation and take appropriate action. Thus, by the processor 10a executing information processing based on the customer response program AP4, the computer including the processor 10a as its central component functions as an alarm means. Because the customer does not know whether the tracking process is correctly tracking the customer, any abnormal condition that occurs when the customer removes an item from the shelf 1 is not the customer's responsibility, and the customer will not understand why it is considered abnormal. However, the customer can consult with a store clerk in response to the second alarm, and the abnormal situation can be resolved by the store clerk taking appropriate measures to deal with the abnormal situation. When the processor 10a has completed ACT63, ACT64 or ACT65, it returns to the standby state of ACT51 to ACT54 in FIG.

[0113] When the communication unit 10d receives the notification data for the increase notification, the processor 10a determines YES in ACT 53 in FIG. 13 and proceeds to ACT 66 in FIG. In ACT66, the processor 10a determines the person who returned the increased item to the display fixture 101. For example, the processor 10a extracts from the tracking database DB2 all data records DR2 for which the monitoring flag set in field F22 is on, and determines all tracking persons identified by the tracking ID set in field F21 of the corresponding data records DR2 as candidates for returners. When a customer takes an item from the display fixture 101, they extend their arm toward the item, place the item they were holding on the shelf 1a, and then pull their arm back. Therefore, the processor 10a, for example, identifies, based on images captured by the surveillance camera 3, among the tracking persons who are candidates for returners, a tracking person who has performed the above-mentioned behavior, and determines that tracking person as a returner.

[0114] More specifically, the processor 10a identifies the person who performed the above-mentioned behavior and further determines the person's location by analyzing changes in multiple images captured by the surveillance camera 3 during a predetermined monitoring period, taking into account the period during which the behavior to return the product is performed. The processor 10a selects, from among the extracted data records DR2, the data record DR2 in which the position indicated by the detection data set in the last field is closest to the identified position. If the distance between the position indicated by the detection data set in the last field of the corresponding data record DR2 and the identified position is shorter than a specified distance, the processor 10a determines the person to be tracked, identified by the tracking ID set in field F21 of the corresponding data record DR2, as the returner. If the processor 10a cannot find the corresponding person to be tracked, the processor 10a determines the returner as unknown. The processor 10a may also measure the arm length of the returner based on the relationship between the position indicated by the detection data set in the last field of the selected data record DR2 and the increased display position of the product, as well as the images captured by the surveillance camera 3, and determine the returner as unknown if the arm length is longer than a specified length.

[0115] When a product is returned, the monitoring period begins before the processor 10a receives the increase notification, just as when a product is taken out. Therefore, the processor 10a buffers images taken by the surveillance camera 3 in the auxiliary storage unit 10c or the like for a certain period of time. After receiving the increase notification, the processor 10a analyzes the images related to the monitoring period among the buffered images. Alternatively, the processing of ACT66 may be executed by the processor 10a as processing of a thread separate from the customer service processing.

[0116] In ACT 67, the processor 10a checks whether the determination of the returner has been successful. If the determination of the returner has been successful, the processor 10a determines YES and proceeds to ACT 68. In ACT68, the processor 10a checks whether the tracking person determined to be the returner has been authenticated as a member. The processor 10a searches the member management database DB3 for a data record DR3 in which the same tracking ID set in field F32 as that set in field F21 of the data record DR2 selected in ACT66 is set. If the corresponding data record DR3 is found, the processor 10a determines YES and proceeds to ACT69.

[0117] In ACT69, the processor 10a requests the sales management device 102 to cancel the purchased items. For example, the processor 10a sends request data for this request from the communication unit 10d to the sales management device 102 via the in-furniture communication path 8. The request data is then relayed by the communication unit 7 and transmitted to the sales management device 102 via the communication network 104. The processor 10a includes in the request data identification data identifying this as a cancellation request, the product code of the purchased item to be canceled, the number of items to be canceled, and the member ID. The processor 10a includes in the request data the product code contained in the received notification data as the product code of the purchased item to be canceled. The processor 10a includes in the request data the number of items to be reduced contained in the received notification data as the number of items to be canceled. The processor 10a includes in the request data the member ID set in field F31 of the data record DR3 found in ACT68.

[0118] When the sales management device 102 receives the request data, it performs cancellation processing to delete the products identified by the product codes included in the request data, by the number of cancellations included in the request data, from the purchased products of the member identified by the member ID included in the request data. Thus, if the customer has been authenticated as a member, they are allowed to freely return products that they have once removed from shelf 1 to shelf 1. This allows the customer to pick up products from shelf 1 and check them, while selecting the products to purchase.

[0119] If the processor 10a confirms in ACT68 that the member has not been authenticated, it determines NO and proceeds to ACT70. For example, if the processor 10a cannot find in the member management database DB3 a data record DR3 in which the same tracking ID set in field F32 as that set in field F21 of the data record DR2 selected in ACT66 is set, it determines that the member has not been authenticated. This case applies when a customer who does not understand the service provided by the display fixture 101 takes an item from shelf 1, is surprised by the first alarm operation that is activated in response to the removal of the item, and hastily returns the item to shelf 1.

[0120] Furthermore, if the processor 10a is unable to determine the person returning the item in ACT66, it determines NO in ACT67 and proceeds to ACT70. This case applies when the processor 10a determines in ACT66 that the person returning the item is unknown, as described above. This case also applies when a person who has not been tracked by the tracking process due to some kind of failure returns the item. These cases correspond to abnormal states. Thus, the processor 10a executes information processing based on the customer service program AP4, and the computer with the processor 10a as its central part functions as an abnormality detection means.

[0121] As ACT70, processor 10a performs a third alarm action. The third alarm action is an action to notify a store clerk or the like that an unauthorized product return has been made and to prompt them to take action. As the third alarm action, processor 10a instructs a terminal device used by the store clerk to display a screen or output a voice message, for example. As the third alarm action, processor 10a may perform any other action or may perform multiple types of actions. The content of the screen or voice message may be determined appropriately depending on the circumstances of the store in which display fixture 101 is installed. Thus, by processor 10a executing information processing based on customer service program AP4, the computer with processor 10a as its central part functions as an alarm means.

[0122] As mentioned above, if a customer is surprised by the first alarm and returns the product to shelf 1 in a hurry, there is no guarantee that the product will be returned to its original location, and therefore such behavior is considered to be an abnormal state. However, if the person being tracked who removed the product that triggered the first alarm returns the same product to the correct location on shelf 1 in response to the first alarm, this does not need to be considered to be an abnormal state. Therefore, if the same product is returned by the person being tracked who triggered the first alarm while the first alarm is being activated, the first alarm may be canceled without the third alarm being activated. When the processor 10a has completed ACT69 or ACT70, it returns to the standby state of ACT51 to ACT54 in FIG.

[0123] If the exit flag set in field F26 in any of the data records DR2 included in the tracking database DB2 is changed from off to on, the processor 10a determines YES in ACT54 in FIG. 13 and proceeds to ACT71. In ACT71, the processor 10a checks whether the tracking person associated with the exit flag that has been changed to on has been authenticated as a member. The processor 10a selects from the tracking database DB2 a data record DR2 in which the exit flag that has been changed to on is set in field F26. The processor 10a then searches the member management database DB3 for a data record DR3 in which the same tracking ID set in field F32 as the one set in field F21 of the selected data record DR2 is set. If the corresponding data record DR3 is found, the processor 10a determines YES and proceeds to ACT72.

[0124] In ACT72, processor 10a requests sales management device 102 to start payment. For example, processor 10a sends request data for this request from communication unit 10d to intra-furniture communication path 8, addressed to sales management device 102. This request data is then relayed by communication unit 7 and transmitted to sales management device 102 via communication network 104. Processor 10a includes in the request data identification data that identifies this as a request to start payment, and the member ID set in field F31 of data record DR3 found in ACT71. Processor 10a then returns to the standby state of ACT51 to ACT54. If the member has not been authenticated and the corresponding data record DR3 cannot be found, the processor 10a judges NO in ACT71, skips ACT72, and returns to the standby state of ACT51 to ACT54.

[0125] When the sales management device 102 receives the request data, it instructs the payment device 103 to settle the price of the product registered as a purchased product for the member identified by the member ID included in the request data. Upon receiving this instruction, the payment device 103 settles the price using the payment information registered for the member. This settlement process may be a well-known settlement process such as credit settlement or electronic money settlement.

[0126] As described above, display fixture 101 determines the product that the person being tracked has taken from shelf 1 as the purchased product for that person based on the movement of the product from shelf 1 and the behavior of the person being tracked in purchasing area AR1. This eliminates the need for customers to use devices such as barcode reading terminals to register the products as purchased products, making it possible to process transactions efficiently.

[0127] Furthermore, transaction processing system 100 makes it possible to automate transaction processing for some of the products sold in a store. For example, in a retail store where staff are present, such as a convenience store or supermarket, transaction processing system 100 can be used to sell some of the products, such as boxed lunches and rice balls, unmanned during busy lunch hours, thereby reducing the burden on the staff.

[0128] Furthermore, the display fixture 101 identifies the individual of the person being tracked through member authentication, thereby making it possible to identify the individual who has taken the product from the shelf 1.

[0129] Furthermore, according to the display fixture 101, any product that an authenticated member has removed from shelf 1 is determined to be a product purchased by the authenticated member until it is detected that the tracked person has left shelf 1. Therefore, a customer who is a member simply enters the purchasing area, has his / her member ID read by the UI unit 5, and then leaves shelf 1 with the product that he / she removed from shelf 1. Therefore, the customer does not need to perform any operation to declare that the registration of the purchased product has been completed.

[0130] Furthermore, according to the display fixture 101, if an abnormal state occurs, such as when a product falls from the shelf 1 or when a person who has been lost in the tracking process takes out a product from the shelf 1, a second alarm operation is executed. Therefore, it is possible to prevent such an abnormal state from being left unattended.

[0131] Furthermore, the display fixture 101 is equipped with casters 1b and can be easily moved, making it suitable for convenient applications such as temporarily running unmanned sales during peak customer hours in a store that normally handles customer service at manned checkout corners.

[0132] This embodiment can be modified in various ways as follows. The appearance of the display fixture 101 shown in Fig. 1 is an example, and the display fixture of the embodiment may be realized in any other form. For example, it may be a platform type or a type with an opening at the top. It may also be provided with an openable door on the opening.

[0133] A door may be provided to close the opening for the purpose of keeping the container warm or cold.

[0134] The tracking process, monitoring process, or customer interaction process may be distributed and processed by multiple computers. The tracking process, monitoring process, and customer interaction process may all be processed by the same computer. The tracking process and customer interaction process may each be processed by a separate computer. The tracking process, monitoring process, and customer interaction process may each be processed by a separate computer, or the tracking process, monitoring process, and customer interaction process may each be processed by a separate computer.

[0135] At least a part of the registration process in the sales management device 102 may be executed by the processor 9a or the processor 10a. At least a part of the payment process in the payment device 103 may be executed by the processor 9a or the processor 10a. At least a part of the customer handling process may be executed by the sales management device 102.

[0136] Even if the member has been authenticated, the payment may be made at a checkout corner where a store clerk is present or at a self-service checkout corner.

[0137] Purchased items may be registered in association with a tracking ID. If member authentication is performed after product registration has begun, the member ID may be associated with the purchased items. Alternatively, a payment device installed within the tracking area may be used to make payment for purchased items associated with a tracked person located in an area corresponding to the payment device.

[0138] Instead of using a tracking ID, the person to be tracked may be identified by a member ID.

[0139] Member authentication may be performed by biometric authentication such as face authentication based on an image captured by the tracking camera 2.

[0140] Each function realized by processor 5c, 9a, or 10a through information processing can be realized in part or in whole by hardware that executes information processing not based on a program, such as a logic circuit, etc. Each of the above functions can also be realized by combining hardware such as the above logic circuit with software control.

[0141] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. The inventions described in the original claims of this application are set forth below. [Appendix 1] A display unit for displaying merchandise; a monitoring means for monitoring the behavior of people in a purchasing area defined around the display unit; a movement detection means for detecting movement of the product from the display unit; A display fixture comprising: a determination means for determining that the product moved from the display section is a trading product related to the person based on the monitoring results by the monitoring means and the detection results by the movement detection means. [Appendix 2] Identification means for identifying the person as an individual; The display fixture according to claim 1, further comprising: [Appendix 3] A tracking means for tracking the person; a departure detection means for detecting that the person has left the display unit based on the tracking result of the tracking means; Further comprising: the determination means determines the transaction commodity for the person whose individual has been identified by the identification means until the departure detection means detects that the person has left the display unit; Display fixtures as described in Appendix 2. [Supplementary Note 4] An abnormality detection means for detecting an abnormal state based on the monitoring result by the monitoring means and the detection result by the movement detection means; an alarm means for executing an alarm operation in response to the abnormal state being detected by the abnormality detection means; A display fixture according to any one of claims 1 to 3, further comprising: [Appendix 5] A moving part for moving the display unit; A display fixture according to any one of claims 1 to 4, further comprising: [Explanation of symbols]

[0142] 1...shelf, 1a...shelf board, 1b...caster, 1c...handle, 1d...support member, 2...tracking camera, 3...surveillance camera, 4...projector, 5...user interface unit (UI unit), 5a...touch panel, 5b...reader, 5c...processor, 5d...main memory, 5e...auxiliary storage unit, 5f...sound unit, 5g...communication unit, 5h...transmission path, 6...weighing scale, 7...communication unit, 8...internal communication path within the fixture, 9...product monitoring unit, 9a ...processor, 9b...main memory, 9c...auxiliary storage unit, 9d...communication unit, 9e...interface unit, 9f...transmission path, 10...main processing unit, 10a...processor, 10b...main memory, 10c...auxiliary storage unit, 10d...communication unit, 10e...interface unit, 10f...transmission path, 100...transaction processing system, 101...display fixtures, 102...sales management device, 103...payment device, 104...communication network.

Claims

1. a display unit for displaying merchandise; a monitoring means for monitoring the behavior of people in a purchasing area defined around the display unit; tracking means for tracking said person and storing an authentication flag and an exit flag in a data record; means for turning on the authentication flag of the data record when the person is located within a predetermined authentication area from the display unit based on the tracking result of the tracking means; means for finding a data record in which the authentication flag is set to ON when the member ID of the person has been notified; means for transmitting request data to the sales management device to request the start of payment for the registered product when the exit flag of the found data record is set to an ON state; Display fixtures equipped with:

2. the tracking means sequentially adds to the data record a field in which detection data indicating the result of position detection after the person has moved is set; When there are a plurality of data records in which the authentication flag is set to an on state, the finding means finds, among the plurality of data records, a data record in which the position indicated by the detection data set in the last field is closest to the authentication area. The display fixture according to claim 1.

3. The method further comprises: when the exit flag of the found data record is set to an on state, a means for confirming whether or not the tracking person associated with the data record has been authenticated as a member; the transmitting means transmits the request data when it is confirmed by the confirming means that the member has been authenticated. A display fixture according to claim 1 or claim 2.

4. a means for updating a member management database so as to associate the tracking ID included in the data record found by the finding means with the notified member ID; the transmitting means includes in the request data a member ID associated in the member management database with a tracking ID included in the data record; A display fixture according to any one of claims 1 to 3.

5. The authentication area is predetermined based on the position of the display unit. A display fixture according to any one of claims 1 to 4.

6. the means for finding finds a data record in which the authentication flag is set to an ON state and the position represented by the detection data set in the last field is closer to the center of the authentication area; The display fixture according to claim 2.

7. a movement detection means for detecting movement of the product from the display unit; A display fixture as described in any one of claims 1 to 6, further comprising a determination means for determining that the product moved from the display section is a trading product related to the person based on the monitoring results by the monitoring means and the detection results by the movement detection means.

Images