Information processing apparatus, guidance system, and program

Abstract

To enable a customer using a checkout counter where a plurality of self-service transaction processing apparatuses is installed to be guided to an appropriate transaction processing apparatus.SOLUTION: An information processing apparatus comprises an acquisition unit, a reception unit, a determination unit, and an output unit. The acquisition unit acquires image information that allows identification of a state of each of a plurality of transaction processing apparatuses where a customer performs operations related to a transaction. The reception unit receives, for each of the plurality of transaction processing apparatuses, detection information indicating the presence of a person at a specified operating position relative to the transaction processing apparatus. The determination unit determines, based on the image information and the detection information, whether each of the transaction processing apparatuses is in the state where the customer can start performing an operation. The output unit outputs guidance information to guide a waiting customer who is waiting to start performing an operation to a transaction processing apparatus among the plurality of transaction processing apparatuses that is in the state where the customer can start performing an operation, in accordance with the determination result by the determination unit.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an information processing device, a guidance system, and a program. [Background technology]

[0002] In recent years, supermarkets and other mass retailers have increasingly introduced self-service transaction processing devices, which allow customers to process their own payments, and there have been an increasing number of cases where a large number of self-service transaction processing devices have been installed.When a large number of self-service transaction processing devices are installed in this way, the work of guiding and directing customers who are processing their payments to available self-service transaction processing devices becomes a burden.

[0003] Therefore, various technologies have been proposed to automatically provide this guidance and direction.For example, there is a technology that uses a motion sensor or a camera to detect whether or not a customer is near each transaction processing device, determines which transaction processing device is available, and then displays a guidance device to guide the customer to the determined available device.

[0004] However, such methods of determining whether a machine is available based on the results of detecting the presence or absence of a customer using a motion sensor, a camera, or the like have a problem of low accuracy. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-173751 Summary of the Invention [Problem to be solved by the invention]

[0006] The problem that the embodiments of the present invention aim to solve is to make it possible to guide customers using a checkout counter where multiple self-service transaction processing devices are installed to the appropriate transaction processing device. [Means for solving the problem]

[0007] In one embodiment, the information processing device includes an acquisition unit, a receiving unit, a determination unit, and an output unit. The acquisition unit acquires image information capable of identifying the status of each of a plurality of transaction processing devices on which a customer performs a transaction-related operation. The receiving unit receives, for each of the plurality of transaction processing devices, detection information indicating the presence of a person at a specified operation position relative to the transaction processing device. The determination unit determines, based on the image information and the detection information, whether each of the plurality of transaction processing devices is in a state in which the customer can begin performing the operation. The output unit outputs guidance information, in accordance with the determination result by the determination unit, to a waiting customer waiting to begin performing the operation, to a transaction processing device among the plurality of transaction processing devices that is in a state in which the customer can begin performing the operation. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic configuration diagram showing a guidance system according to a first embodiment. [Figure 2] FIG. 2 is a perspective view showing an example of the external configuration of a self-service POS terminal as an example of a self-service transaction processing apparatus included in the guidance system. [Figure 3] FIG. 3 is a block diagram showing an example of a main circuit configuration of a self-service POS terminal. [Figure 4] FIG. 4 is a schematic diagram showing an example of a camera image captured by a transaction camera included in the guidance system. [Figure 5] FIG. 5 is a schematic diagram showing an example of an image captured by a camera. [Figure 6] FIG. 6 is a schematic diagram showing an example of a checkout area to which the guidance system is applied. [Figure 7] FIG. 7 is a diagram illustrating the status information of a transaction processing device represented by the color pattern and light emission pattern of a patrol lamp provided on the transaction processing device. [Figure 8] FIG. 8 is a block diagram showing the main circuit configuration of a store server as an information processing device according to the first embodiment included in the guidance system. [Figure 9] FIG. 9 is a schematic diagram showing the main data structure stored in the terminal status table provided in the store server. [Figure 10] FIG. 10 shows the first part of a sequence diagram illustrating an outline of the operation of the guidance system in providing guidance on available registers. [Figure 11] FIG. 11 shows the second part of a sequence diagram illustrating an outline of the operation of the guidance system in providing guidance on available registers. [Figure 12] FIG. 12 is a flowchart showing the main steps of the information processing executed by the processor of the store server. [Figure 13] FIG. 13 is a diagram showing a display example on a display device included in the guidance system. [Figure 14] FIG. 14 is a diagram showing another example of display on the display device. [Figure 15] FIG. 15 is a diagram showing yet another example of display on the display device. [Figure 16] FIG. 16 is a diagram showing an example of an idle screen displayed on a touch panel of a self-service POS terminal as an example of a self-service transaction processing apparatus according to the second embodiment. [Figure 17] FIG. 17 is a diagram showing an example of a transaction start screen displayed on the touch panel of the self-service POS terminal. [Figure 18] FIG. 18 is a diagram showing an example of a registration screen displayed on the touch panel of the self-service POS terminal. [Figure 19] FIG. 19 is a diagram showing an example of a payment selection screen displayed on the touch panel of the self-service POS terminal. [Figure 20] FIG. 20 is a diagram showing an example of a transaction completion screen displayed on the touch panel of the self-service POS terminal. [Figure 21] FIG. 21 is a schematic diagram showing an example of a checkout counter to which the guidance system according to the third embodiment is applied. [Figure 22] FIG. 22 is a diagram showing an example of a screen displayed on a touch panel of the attendant terminal in the third embodiment. [Figure 23] FIG. 23 is a diagram showing an example of a screen displayed on the touch panel of the attendant terminal. [Figure 24] FIG. 24 is a sequence diagram showing an outline of the operation of the guidance system according to the fourth embodiment in relation to guidance of available registers. [Figure 25] FIG. 25 is a flowchart showing the main steps of information processing executed by a processor of a store server as an information processing device according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the guidance system will be described with reference to the drawings.

[0010] [First embodiment] FIG. 1 is a schematic diagram showing a guidance system according to a first embodiment. The guidance system includes multiple self-service transaction processing devices 1, multiple transaction cameras 2, multiple detection terminals 3, an attendant terminal 4, a store server 5, a checkout area camera 6, and a display device 7. The guidance system is configured by connecting these transaction processing devices 1, transaction cameras 2, detection terminals 3, attendant terminal 4, store server 5, checkout area cameras 6, and display devices 7 via a communications network NW such as a local area network (LAN). Each transaction processing device 1 is associated with one transaction camera 2 and one detection terminal 3, and the transaction processing device 1, transaction camera 2, and detection terminal 3 constitute a transaction system TS. Each transaction system TS is installed at a checkout counter in a store. Here, it is assumed that one transaction camera 2 and one detection terminal 3 are associated with each transaction processing device 1, but one transaction camera 2 or one detection terminal 3 may be associated with two or more transaction processing devices 1, and furthermore, one transaction camera 2 and one detection terminal 3 may be associated with all transaction processing devices 1.

[0011] Self-service transaction processing device 1 is a terminal where a customer performs operations related to a transaction. This self-service transaction processing device 1 includes a self-service payment terminal with a payment function whereby the customer, who is a shopper, makes a payment based on registered product transaction data, a self-service product registration terminal with a product registration function whereby the customer registers products, and a self-service POS (Point of Sales) terminal with a product registration function and a payment function whereby the customer registers products and makes a payment based on the registered transaction data.

[0012] FIG. 2 is a perspective view showing an example of the external configuration of the self-checkout POS terminal 100, and FIG. 3 is a block diagram showing an example of the main circuit configuration of the self-checkout POS terminal 100. As shown in FIG.

[0013] As shown in FIG. 2, the self-service POS terminal 100 includes a main body 101 installed on the floor and a scale unit 102 installed beside the main body 101. A display pole 103 and a touch panel 104 are attached to the top of the main body 101. A basket stand 105 is provided in the center of the side of the main body 101 opposite the side on which the scale unit 102 is installed. The basket stand 105 is used by customers coming from the sales floor to place shopping baskets containing purchased items. Customers stand in front of the main body 101 in FIG. 2 so that they can see the screen of the touch panel 104. Therefore, from the customer's perspective, the basket stand 105 is on the right side of the main body 101, and the scale unit 102 is on the left side. In the following description, the side on which the customer stands is referred to as the front of the main body 101, the side on which the scale unit 102 is installed is referred to as the left side of the main body 101, and the side on which the basket stand 105 is installed is referred to as the right side of the main body 101.

[0014] The scale unit 102 has a structure in which a scale pan 107 is provided on top of a housing 106, and a bag holder 108 is attached to the top of the scale pan 107. The top surface of the scale pan 107 serves as a placement surface 109. The bag holder 108 has a pair of holding arms 110, which hold a plastic bag or a shopping bag brought by a customer, known as a "my bag." The scale unit 102 measures the weight of an item placed in the plastic bag or my bag held by the holding arms 110 and placed on the placement surface 109. The placement surface 109 is an example of a product placement area where purchased items to be checked out are placed. The scale unit 102 is an example of a weighing device that measures the weight of an object placed in the product placement area.

[0015] The display pole 103 is provided at its tip with a patrol lamp 111 that displays status information indicating the state of the self-service POS terminal 100. The patrol lamp 111 is provided with a first light-emitting unit 112 that selectively emits light, for example, blue or red, and a second light-emitting unit 113 that emits yellow. The light has two types of light emission patterns: continuous illumination, which is lighting, and flashing, which is lighting and turning off for a certain period of time. The display pole 103 can display status information by combining the color pattern and light emission pattern of the first light-emitting unit 112 with the light emission pattern of the second light-emitting unit 113.

[0016] The touch panel 104 is composed of a display for displaying various screens related to transactions such as registration and accounting to the user operating the self-service POS terminal 100, and a touch sensor for detecting touch inputs on the screen by the user. In the case of the self-service POS terminal 100, the user is usually a customer.

[0017] A reading window 115 for a scanner 114 (see FIG. 3), a card insertion slot 117 for a card reader 116 (see FIG. 3), and an issuing slot 119 for receipts printed by a printer 118 (see FIG. 3) are formed on the front of the main body 101. Furthermore, a coin insertion slot 121, a coin dispensing slot 122, a bill insertion slot 123, and a bill dispensing slot 124 of an automatic change dispenser 120 (see FIG. 3) are also formed on the front of the main body 101.

[0018] Furthermore, a communication cable 125 extends from the right side of the main body 101 to the outside, and a reader / writer 126 for electronic money media is connected to the tip of this communication cable 125. The reader / writer 126 is placed on a stand 127 provided on the upper right side of the main body 101.

[0019] As shown in FIG. 3, the self-service POS terminal 100 includes the touch panel 104, patrol lamp 111, scanner 114, card reader 116, printer 118, automatic change dispenser 120, and reader / writer 126 described above, as well as a processor 128, main memory 129, auxiliary storage device 130, a communication interface 131, and a system transmission path 132. The system transmission path 132 includes an address bus, a data bus, and control signal lines. The system transmission path 132 connects the processor 128 to each of the other components directly or via a signal input / output circuit, and transmits data signals exchanged between them. The processor 128, main memory 129, and auxiliary storage device 130 are connected via the system transmission path 132 to form a computer for the self-service POS terminal 100.

[0020] The processor 128 corresponds to the central part of the computer. The processor 128 controls each part to realize various functions of the self-checkout POS terminal 100 in accordance with an operating system or a control program. The processor 128 is, for example, a central processing unit (CPU). The processor 128 may be, for example, a micro processing unit (MPU), a system on a chip (SoC), a digital signal processor (DSP), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field-programmable gate array (FPGA). Alternatively, the processor 128 may be a combination of these.

[0021] The main memory 129 corresponds to the main storage portion of the computer. The main memory 129 includes a nonvolatile memory area and a volatile memory area. The main memory 129 stores an operating system or a control program in the nonvolatile memory area. The main memory 129 may store data required for the processor 128 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 129 uses the volatile memory area as a work area where data is rewritten by the processor 128 as appropriate. An example of the nonvolatile memory area is ROM (Read Only Memory). An example of the volatile memory area is RAM (Random Access Memory). For example, the main memory 129 stores a transaction file 133.

[0022] The transaction file 133 is a data file for storing data related to one commercial transaction processed by the self-service POS terminal 100. The transaction file 133 stores data such as a transaction number, purchased product data, total number of items, total amount, discount amount, and settlement amount. The transaction number is a series of numbers that is issued each time a commercial transaction is processed by the self-service POS terminal 100. The purchased product data is record data created for each product sold in a commercial transaction identified by the transaction number. Here, the purchased product data consists of items such as product code, product name, price, number of items, and amount. The number of items is the number of purchased items identified by the product code. The amount is the amount for the number of items purchased. The transaction file 133 can store multiple purchased product data. The total number of items is the sum of the number of items in each purchased product data. The total amount is the sum of the amounts in each purchased product data. The discount amount is the amount discounted from the total amount. The settlement amount is the amount obtained by subtracting the discount amount from the total amount.

[0023] The auxiliary storage device 130 corresponds to the auxiliary storage portion of the computer. For example, the auxiliary storage device 130 may be an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), or an SSD (Solid State Drive). The auxiliary storage device 130 stores data used by the processor 128 when performing various processes, data created by the processes in the processor 128, etc. The auxiliary storage device 130 may also store the above-mentioned control program.

[0024] The communication interface 131 performs data communication in accordance with a preset communication protocol with an external device connected via the communication network NW. The external device is, for example, the attendant terminal 4, the store server 5, etc.

[0025] The scanner 114 reads a code symbol from a product held over the reading window 115. Each product sold in a store is affixed with a code symbol that encodes a product ID or the like to identify the product. The code symbol is, for example, a barcode. The code symbol may also be, for example, a two-dimensional data code. The scanner 114 may be of a type that reads a code symbol by scanning with laser light, or of a type that reads a code symbol from an image captured by an imaging device.

[0026] Card reader 116 reads card data recorded on a card medium such as a credit card, a point card, etc. Card reader 116 pulls the card medium inserted into card insertion slot 117 into main body 101, reads the card data, and then ejects the card from card insertion slot 117.

[0027] The printer 118 prints receipt data and other information indicating the details of the transaction on receipt paper. The receipt paper on which the receipt data is printed is ejected from the issuing port 119, cut by a cutter (not shown), and issued as a receipt or proof of purchase.

[0028] The automatic change dispenser 120 includes a coin unit 134 and a banknote unit 135. The coin unit 134 sorts coins inserted into the coin insertion slot 121 one by one, identifies the denomination, and stores them in a safe by denomination. The coin unit 134, for example, based on change data, removes coins of the corresponding denomination from the safe and dispenses them to the coin dispensing outlet 122. The banknote unit 135 sorts banknotes inserted into the banknote insertion slot 123 one by one, identifies the denomination, and stores them in the safe by denomination. The banknote unit 135, for example, based on change data, removes banknotes of the corresponding denomination from the safe and dispenses them to the banknote dispensing outlet 124.

[0029] The reader / writer 126 reads and rewrites electronic money recorded on an electronic money medium. The electronic money medium is, for example, a contactless IC card. The electronic money medium may also be an electronic device such as a smartphone or a tablet terminal.

[0030] Processor 128 implements processing units related to well-known product registration and payment. Each unit implemented in processor 128 can also be referred to as a function. Each unit implemented in processor 128 can also be referred to as being implemented in a control unit including processor 128 and main memory 129.

[0031] In this way, the self-service POS terminal 100 has a payment function that allows both cash and cashless payments. Cashless payments include credit card payments, electronic money payments, point payments, code payments, etc. Multiple self-service POS terminals 100 are installed at the checkout area, which is the checkout area of ​​the store, and are operated by customers who have finished shopping. Customers who move to the checkout area after placing their purchases in a shopping basket or shopping cart in a sales area where products are displayed operate the self-service POS terminal 100 to register the purchased products and settle the transaction data for the registered purchased products, i.e., to make a payment. In this way, customers make payments for transactions themselves, from product registration to payment.

[0032] The following description will be given assuming that transaction processing device 1 is such a self-service POS terminal 100. Transaction system TS can be rephrased as cash register system RS. It goes without saying that the present invention may also apply to a transaction processing device 1 other than self-service POS terminal 100, such as a self-service payment terminal or self-service registration terminal.

[0033] As shown in FIG. 2, the transaction camera 2 is composed of a camera pole 21 attached to the top of the main body 101 of the self-service POS terminal 100 and a camera 22 attached to the tip of the camera pole 21. As shown by the dashed line in FIG. 2, the camera 22 is attached at a position and orientation such that the angle of view, i.e., the imaging area, includes at least a customer standing within a predetermined operating range, including the front of the main body 101 for operating the self-service POS terminal 100. The camera 22 captures images of the behavior of a customer operating the self-service POS terminal 100 and transmits the captured images to the corresponding detection terminal 3 via the communication network NW based on a pre-established correspondence relationship with the detection terminal 3. Note that, although the communication network NW is used here, the camera-captured images may also be transmitted directly from the camera 22 to the detection terminal 3 via, for example, a Universal Serial Bus (USB) cable. In this case, it is not necessary to previously set a correspondence relationship between the camera 22 and the detection terminal 3.

[0034] The detection terminal 3 is an edge computer such as a personal computer. The detection terminal 3 is equipped with an AI human detection engine and constitutes an AI camera in cooperation with the camera 22 of the transaction camera 2. The detection terminal 3 detects the presence or absence of a customer operating the self-service POS terminal 100 from camera images acquired by the camera 22 of the transaction camera 2 at regular time intervals. The detection terminal 3 detects the presence or absence of a customer using, for example, a recognition technology such as a well-known face detection method or a moving object detection method.

[0035] 4 is a schematic diagram showing an example of a camera image 221 acquired by camera 22 of transaction camera 2. When the camera image 221 acquired by camera 22 is a camera image 221 that shows a person as shown in FIG. 4, detection terminal 3 detects that a person is present within a predetermined operation range 222 that includes the front of main body 101 for operating self-service POS terminal 100. When detection terminal 3 detects that a person is present within operation range 222, it transmits a person detection notification to store server 5.

[0036] 5 is a schematic diagram showing an example of the camera-captured image 223. As shown in FIG. 5, a person cannot be detected from the camera-captured image 223 in which no person appears within the operation range 222. Therefore, in this case, the detection terminal 3 does not transmit a person detection notification to the store server 5.

[0037] Attendant terminal 4 is a terminal operated by an attendant store clerk who is a supervisor who monitors self-service POS terminals 100, which are multiple transaction processing devices 1 connected via communication network NW. Attendant terminal 4 can be wirelessly connected to communication network NW and may be a tablet terminal that can be carried by the store clerk.

[0038] The attendant terminal 4 is a terminal operated by a store attendant who monitors the self-POS terminals 100, which are multiple transaction processing devices 1 connected via a communication network NW. The attendant terminal 4 may have a configuration similar to that of the self-POS terminal 100 shown in FIGS. 2 and 3, except that the attendant terminal 4 does not have the camera pole 21 and the camera 22 attached. The attendant terminal 4 stores the status of each self-POS terminal 100 in the main memory 129. For example, the attendant terminal 4 can store a list of purchased items registered in each self-POS terminal 100, error occurrence status, etc., in the main memory 129. The attendant terminal 4 displays the status of each self-POS terminal 100 stored in the main memory 129 on the display of the touch panel 104. In addition to cash and cashless payment functions, the attendant terminal 4 may also be equipped with functions for handling payments requiring manual intervention, such as payments using non-machine-readable vouchers and gift certificates, returns, and refunds. The attendant terminal 4 may be a personal computer that does not have a transaction processing function, or a tablet terminal that can be wirelessly connected to the communication network NW and that can be carried by the store clerk.

[0039] The store server 5 provides various services related to the transaction system to each self-service POS terminal 100 connected via the communication network NW. The store server 5 also transmits display information indicating the content to be displayed on the display device 7 connected via the communication network NW. The detailed configuration of this store server 5 will be described later.

[0040] Fig. 6 is a schematic diagram showing an example of a checkout location CE to which the guidance system is applied. In the example of Fig. 6, the checkout location CE is equipped with eight cash register systems RS, each including a self-service POS terminal 100, and one attendant terminal 4. While not limited to this, the following description will explain the configuration and operation based on the number of cash register systems RS and their installation layout at this checkout location CE.

[0041] The checkout area CE has an entrance and an exit for shoppers. At the entrance, there is an entrance lane AL where shoppers SC line up while waiting at the cash register. At the exit, there is an exit lane EL where shoppers SC pass through after completing their payment. In addition, one display device 7 is installed at the checkout area CE corresponding to the entrance lane AL.

[0042] Each cash register system RS is assigned a cash register number R1 to R8 to uniquely identify it. These cash register numbers R1 to R8 can be assigned arbitrarily by the manager of the store server 5. A store clerk SP is assigned to the attendant terminal 4.

[0043] The checkout area camera 6 is placed on the ceiling or the like of the checkout area CE, captures images of the checkout area CE, and transmits the captured camera image to the store server 5. The checkout area camera 6 is, for example, a 360-degree camera or a fisheye camera that is capable of capturing images. As shown in FIG. 6 , the checkout area camera 6 is installed so that its capturing range 61 includes all of the self-service POS terminals 100 of the multiple cash register systems RS placed at the checkout area CE, specifically, the patrol lights 111 of all of the self-service POS terminals 100. Note that if one checkout area camera 6 cannot capture images of all of the patrol lights 111, multiple checkout area cameras 6 may be provided. The checkout area camera 6 is an example of a generating device that generates image information that can identify the status of each of the multiple transaction processing devices 1.

[0044] FIG. 7 is a diagram illustrating the status information of transaction processing devices, i.e., self-service POS terminal 100, self-service payment terminal, and self-service registration terminal, represented by the color pattern and light emission pattern of patrol lamp 111. In FIG. 7, solid hatching indicates a lit state, and dashed hatching indicates a flashing state. Patrol lamp 111 indicates that the device is in use by flashing first light-emitting unit 112 in blue, and indicates that the device is idle, i.e., unoccupied, by illuminating it in blue. Therefore, store server 5 can determine the availability of each self-service POS terminal by recognizing the color pattern and light emission pattern of patrol lamp 111 of each self-service POS terminal 100 from the camera image captured by checkout area camera 6. Thus, patrol lamp 111 can indicate whether transaction processing device 1 is in a waiting state or in use state by at least one of its light emission color and light emission state. Patrol lamp 111 is an example of an indicator that indicates whether transaction processing device 1 is in a waiting state or in use state. In this embodiment, the example of the patrol lamp 111 is one having two light-emitting elements, a first light-emitting element 112 and a second light-emitting element 113, but it is also acceptable for one light-emitting element to indicate whether the transaction processing device 1 is in a state of waiting to be used or in use.

[0045] Display device 7 is a display device such as a liquid crystal display. Display device 7 displays display information transmitted from store server 5. The display information can be screen information for displaying guidance to a waiting customer, who is a shopper waiting to check out, to a device that is currently available, i.e., an available device, among multiple self-service POS terminals 100. Therefore, display device 7 is an example of a presentation device that presents guidance information generated by store server 5, which is an example of an information processing device, to a waiting customer waiting to start performing an operation. In other words, the presentation device displays guidance information for guiding to available transaction processing devices 1.

[0046] FIG. 8 is a block diagram showing the main circuit configuration of the store server 5. The store server 5 includes a processor 51, a main memory 52, an auxiliary storage device 53, an input / output device 54, a communication interface 55, and a system transmission path 56. The system transmission path 56 includes an address bus, a data bus, a control signal line, etc. The system transmission path 56 connects the processor 51 to each of the other components directly or via a signal input / output circuit, and transmits data signals exchanged between them. The store server 5 computer is configured by connecting the processor 51, the main memory 52, and the auxiliary storage device 53 via the system transmission path 56.

[0047] The processor 51 corresponds to the central part of the computer. The processor 51 controls each part to realize various functions of the store server 5 in accordance with an operating system or a control program. The processor 51 is, for example, a CPU. The processor 51 may be, for example, an MPU, an SoC, a DSP, a GPU, an ASIC, a PLD, or an FPGA. Alternatively, the processor 51 may be a combination of two or more of these.

[0048] The main memory 52 corresponds to the main storage portion of the computer. The main memory 52 includes a nonvolatile memory area and a volatile memory area. The main memory 52 stores an operating system or a control program in the nonvolatile memory area. The main memory 52 may store data required for the processor 51 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 52 uses the volatile memory area as a work area where data is rewritten by the processor 51 as appropriate. The nonvolatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0049] The auxiliary storage device 53 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM, HDD, or SSD can be the auxiliary storage device 53. The auxiliary storage device 53 stores data used by the processor 51 when performing various processes, data created by the processes in the processor 51, etc. The auxiliary storage device 53 may also store the above-mentioned control program.

[0050] The input / output device 54 is a user interface that includes input devices such as a keyboard and a mouse, and a display device such as a liquid crystal display. The store server 5 does not necessarily have to include the input / output device 54. In this case, the user interface can be a management terminal (not shown) that can communicate via the communication network NW using the communication interface 55. The management terminal can include, for example, a personal computer, a smartphone, a tablet computer, etc.

[0051] The communication interface 55 communicates data with external devices connected via the communication network NW in accordance with a preset communication protocol. Examples of the external devices include the self-POS terminal 100, the attendant terminal 4, the checkout area camera 6, and the display device 7.

[0052] The store server 5 includes, in the auxiliary storage device 53, a product master database 531, a store member master database 532, a sales data database 533, a terminal status table 534, and a video temporary storage unit 535. In Fig. 8, database is abbreviated as DB.

[0053] The product master database 531 stores data on each product sold in the store. The product master database 531 stores data such as product ID, product name, price, and category name, with each product being one record. The product ID is a unique code assigned to each product to identify it individually.

[0054] The store member master database 532 stores data on customers who have registered as point members or other members, so-called members. The store member master database 532 stores data on each member, with one record per member, including, for example, a member ID. It may also include personal information such as the member's gender, age, name, address, and contact information. The member ID is a unique code assigned to each member to identify them individually. Members possess a recording medium on which their member ID is recorded. The recording medium may be, for example, a magnetic card, a contact IC (Integrated Circuit) card, a contactless IC card, or a smartphone. A purchaser can enjoy the benefits of being a member by entering their membership code into the checkout device at any time before making payment, i.e., settlement, at the checkout device. There are no particular limitations on the method for entering the membership code; for example, the shopper SC can read the code from a medium using the scanner 114, card reader 116, or reader / writer 126 of the self-service POS terminal 100.

[0055] The sales data database 533 stores sales data generated by each transaction, which is transmitted from each self-service POS terminal 100 upon completion of payment, i.e., upon completion of the transaction. The sales data database 533 stores, for each transaction as a record, transaction data describing the transaction details of the items to be paid for and payment data related to the payment of the transaction. The transaction data includes the product names (product codes) of the items to be paid for, their amounts, and the total amounts of each item. The transaction data is data stored in the transaction file 133 of the self-service POS terminal 100. In the case of cash payments, the payment data includes the deposit amount paid by the purchaser and the amount of change. In the case of cashless payments, the payment data includes information on the payment method. The sales data may also include elements such as a membership code, a company code (company name) indicating the company operating the store, a store code (store name), the store's telephone number, address, transaction date and time, transaction number (receipt number), cash register number, and the name of the person in charge. The elements included in the sales data are not limited to these examples and may include other elements, or elements such as the telephone number and address may be omitted.

[0056] The self-service POS terminal 100, for example, uses the scanner 114 to read a code symbol printed or affixed to a product to obtain a product code. Then, for the product identified by the product code, the self-service POS terminal 100 reads product data from a product data file stored in the self-service POS terminal 100 and registers the product data in the transaction data, thereby updating sales data including transaction data and payment data and storing the updated sales data in the transaction file 133. The product data file can be stored in the auxiliary storage device 130 of the self-service POS terminal 100 and may be a copy of the product master database 531. Furthermore, when a membership code is obtained from a recording medium using the scanner 114, the self-service POS terminal 100 checks whether the membership code is registered in the store membership data file stored in the self-service POS terminal 100. If registered, the self-service POS terminal 100 adds the membership code to the transaction data as a store membership code, thereby updating and storing the sales data. When the payment process is complete, i.e., when one transaction is finished, the self-service POS terminal 100 prints the sales data on paper to issue a paper receipt for the transaction and transmits the sales data for the transaction to the store server 5. The sales data database 533 stores the sales data thus transmitted from each self-service POS terminal 100.

[0057] The terminal status table 534 stores the current usage status of each self-service POS terminal 100. FIG. 9 is a schematic diagram showing the main data structure stored in this terminal status table 534. Note that the data structure shown in FIG. 9 is just an example. As long as the information necessary for the processor 51 can be obtained, the format is not particularly limited. For example, although the information is shown as a circle and a cross in FIG. 9, it may be represented as two values, 1 and 0.

[0058] As shown in FIG. 9, the terminal status table 534 stores, for example, an empty register detection status and an empty register determination status for each register number assigned to the self-checkout POS terminal 100.

[0059] The empty register detection status is the detection status of an empty register based on the human detection notification sent from the detection terminal 3. In this empty register detection status, a circle indicates that no one is in front of the self-service POS terminal 100, that is, that the terminal is vacant and not in use, and a cross indicates that the terminal is in use. Figure 9 shows the status of the checkout counter CE shown in Figure 6. That is, the example of the terminal status table 534 in Figure 9 shows the detection status where the self-service POS terminals 100 with register numbers R2, R3, R7, and R8 are in use, and the self-service POS terminals 100 with register numbers R1, R4, R5, and R6 are vacant.

[0060] The empty register determination status stores the current status of the self-service POS terminal 100 determined based on status information represented by the color pattern and light emission pattern of the patrol lamp 111 of the self-service POS terminal 100. In this empty register determination status, a circle indicates that the self-service POS terminal 100 is empty, and a cross indicates that the self-service POS terminal 100 is in use. The example of the terminal status table 534 in Fig. 9 shows a case where the self-service POS terminal 100 with register number R6 is in use based on the status information.

[0061] The temporary video storage unit 535 temporarily stores camera images taken by the checkout area camera 6 for a certain period of time.

[0062] Next, each unit implemented in the processor 51 of the store server 5 will be described. As shown in Fig. 8, the processor 51 implements, for example, a sales data receiving unit 511, a usage status acquisition unit 512, a terminal status determination unit 513, and a guidance unit 514. Each unit implemented in the processor 51 can also be referred to as each function. Each unit implemented in the processor 51 can also be referred to as being implemented in a control unit including the processor 51 and the main memory 52.

[0063] The sales data receiving unit 511 receives the sales data for one transaction transmitted from the self-service POS terminal 100 at the end of the transaction via the communication interface 55. The sales data receiving unit 511 stores the received sales data in the sales data database 533.

[0064] Usage status acquisition unit 512 acquires the usage status of each self-service POS terminal 100. For example, in this embodiment, as described above, detection terminal 3 is configured to transmit a human detection notification when a person is present within the operation range of self-service POS terminal 100. Therefore, usage status acquisition unit 512 receives this human detection notification via communication interface 55, and if it has received it, stores the fact that self-service POS terminal 100 is in use in the empty register detection status of terminal status table 534. For self-service POS terminals 100 that have not received a human detection notification, usage status acquisition unit 512 stores the fact that the register is empty in the empty register detection status of terminal status table 534. In this way, usage status acquisition unit 512 is an example of a receiving unit that receives, for each of multiple transaction processing devices 1, detection information indicating the presence of a person at a specified operation position relative to transaction processing device 1. Furthermore, multiple detection terminals 3 are an example of a detection device that detects the presence of a person at a specified operation position relative to each of multiple transaction processing devices and outputs detection information indicating the presence of a person.

[0065] Terminal status determination unit 513 determines the status of each self-service POS terminal 100. Specifically, terminal status determination unit 513 receives camera images from each checkout area camera 6 via communication interface 55 and stores the camera images for a period of time that enables determination of whether patrol lamp 111 is flashing or lit in temporary image storage unit 535. In this manner, terminal status determination unit 513 is an example of an acquisition unit that acquires image information that enables determination of the status of each of multiple transaction processing devices 1 at which a customer performs transaction-related operations. Then, terminal status determination unit 513 determines status information of each self-service POS terminal 100, represented by the color pattern and light emission pattern of patrol lamp 111, from the image of patrol lamp 111 of each self-service POS terminal 100 captured in the camera image. Based on the determined status information, terminal status determination unit 513 determines whether self-service POS terminal 100 is in use or vacant, and stores the determination result in the vacant register determination status in terminal status table 534. Thus, terminal status determining unit 513 is an example of a determining unit that determines, based on image information, whether each of a plurality of transaction processing devices 1 is in a state where a customer can start performing an operation.

[0066] Guidance unit 514 determines which self-service POS terminal 100 should be introduced as an empty register based on the empty register detection status and empty register determination status of each self-service POS terminal 100 stored in terminal status table 534. Specifically, guidance unit 514 determines that a self-service POS terminal 100 for which both the empty register detection status and the empty register determination status indicate an empty register is the self-service POS terminal 100 to be introduced as an empty register. Guidance unit 514 creates a guidance screen for informing the shopper SC of an empty register in accordance with the determined self-service POS terminal 100 to be introduced as an empty register, and transmits the guidance screen to display device 7 via communication interface 55. A specific example of this guidance screen will be described later. In this way, this is an example of an output unit that outputs guidance information for informing a waiting customer waiting to start an operation of a transaction processing device 1 among multiple transaction processing devices 1 that is ready for the customer to start operating, in accordance with the determination result by terminal status determination unit 513.

[0067] The store server 5 can be realized, for example, by using a general-purpose computer device for servers as hardware and writing the control program to the main memory 52 or auxiliary storage device 53. The control program may be stored in the main memory 52 or auxiliary storage device 53 when the store server 5 is transferred, or may be transferred separately from the general-purpose computer device. In the latter case, the control program is transferred by recording it on a removable recording medium such as a magnetic disk, magneto-optical disk, optical disk, or semiconductor memory, or via a network.

[0068] The operation of the guidance system having such a configuration will be explained below. The operations related to registration and settlement in the guidance system are the same as well-known operations, so explanations of these will be omitted. Therefore, here, we will explain the operations related to informing customers about available cash registers.

[0069] 10 and 11 are sequence diagrams showing an outline of the operation of the guidance system in providing guidance to vacant registers. Note that two of the eight detection terminals 3 are shown here as representatives. One detection terminal 3 will be referred to as the detection terminal 3 with register number Ra, and the other as the detection terminal 3 with register number Rb.

[0070] 10 and 11, the store server 5 receives human detection notifications from each detection terminal 3 at regular time intervals and performs a detection status update process to update the empty register detection status in the terminal status table 534 (step S1). As mentioned above, if no human is detected by the detection terminal 3, no human detection notification is sent. The store server 5 updates the empty register detection status in the terminal status table 534 to either empty or in use depending on whether or not a human detection notification has been received.

[0071] Following this detection status update process, the store server 5 acquires camera images from the checkout area camera 6 (step S2).The store server 5 then uses the camera images to perform a status determination process to determine the vacant register status of each self-service POS terminal (step S3).Based on the determination result, the store server 5 updates the vacant register determination status in the terminal status table 534 to vacant or in use.

[0072] The store server 5 then performs an empty register determination process to determine an empty terminal that is not in use based on the empty register detection status and empty register determination status in the terminal status table 534 (step S4). In this empty register determination process, the store server 5 determines, as an empty terminal, a self-service POS terminal 100 whose empty register detection status in the terminal status table 534 is empty and whose empty register determination status in the terminal status table 534 is also empty. For example, if no person is detected in either the detection terminal 3 with register number Ra or the detection terminal 3 with register number Rb, the guidance information determines the self-service POS terminals 100 with register numbers Ra and Rb as empty terminals. The store server 5 generates guidance information for guiding a waiting customer to the empty terminal thus determined, and transmits the guidance information to the display device 7 (step S5).

[0073] The display device 7 displays this guidance information (step S6).

[0074] For example, when a customer who will be the operator is detected at the detection terminal 3 with register number Ra (step S7), the detection terminal 3 transmits a human detection notification to the store server 5 (step S8).

[0075] The store server 5 receives this human detection notification in the detection status update process, which is performed at regular time intervals, and updates the empty register detection status in the terminal status table 534 (step S9). In this case, the register number Ra is updated to "in use." The store server 5 then acquires camera images from the checkout area camera 6 (step S10), determines the empty register status of each self-service POS terminal based on the camera images, and updates the empty register determination status in the terminal status table 534 based on the determination result (step S11). At this time, for a self-service POS terminal 100 of a register whose empty register detection status in the terminal status table 534 is "in use" based on the human detection signal from the detection terminal 3, the empty register status may not necessarily also be "in use." For example, even if the shopper SC is within the operation range of the self-service POS terminal 100, the patrol lamp 111 may display "idle" if the shopper SC has not yet started operation. For example, some self-POS terminals 100 update the patrol lamp 111 while in use in response to the detection output of a human sensor or a human detection notification from the detection terminal 3, while other models update the patrol lamp 111 while in use in response to the operator's touch on the touch panel 104.

[0076] Then, in the empty register determination process, the store server 5 determines an unused terminal based on the empty register detection status and empty register determination status in the terminal status table 534 (step S12). For example, if the detection terminal 3 with register number Ra is in use in both the empty register detection status and empty register determination status in the terminal status table 534, the detection terminal 3 with register number Ra will not be detected as an unused terminal. If no person is detected at the detection terminal 3 with register number Rb, the store server 5 determines the self-service POS terminal 100 with register number Rb as an unused terminal, generates guidance information for guiding the waiting customer to this determined unused terminal, and transmits it to the display device 7 (step S13). The display device 7 displays this guidance information (step S14).

[0077] Once a person is detected, the detection terminal 3 continues to send a person detection notification until the person is no longer detected (step S15). Here, for example, when a customer who will be the operator is detected at the detection terminal 3 with register number Rb (step S16), the detection terminal 3 also sends a person detection notification to the store server 5 (step S17).

[0078] The store server 5 receives these human detection notifications during the detection status update process, which is performed at regular intervals, and updates the empty register detection status in the terminal status table 534 (step S18). In this case, register numbers Ra and Rb are considered to be in use. The store server 5 then acquires camera images from the checkout area cameras 6 (step S19), determines the empty register status of each self-service POS terminal based on the camera images, and updates the empty register determination status in the terminal status table 534 based on the determination results (step S20). The store server 5 determines an unused, empty terminal based on the empty register detection status and empty register determination status in the terminal status table 534 (step S21), generates guidance information for guiding waiting customers to the determined empty terminal, and transmits it to the display device 7 (step S22). The display device 7 displays this guidance information (step S23).

[0079] Furthermore, for example, if the detection terminal 3 with register number Ra does not detect the customer who will be the operator (step S24), it ends sending the human detection notification. On the other hand, if the detection terminal 3 with register number Rb continues to detect a person, it continues sending the human detection notification (step S25).

[0080] The store server 5 updates the empty register detection status in the terminal status table 534 based on the human detection notification from each detection terminal 3 during a detection status update process that is performed at regular time intervals (step S26). For example, register number Ra is empty, and register number Rb is in use. The store server 5 then acquires camera footage from the checkout area camera 6 (step S27), determines the empty register status of each self-service POS terminal based on the camera footage, and updates the empty register determination status in the terminal status table 534 based on the determination result (step S28). For example, the detection terminal 3 with register number Ra indicating no operator is detected in step S24 may be caused by the shopper SC temporarily leaving the operation range of the self-service POS terminal 100. When the checkout process is completed and the shopper SC leaves the operation range of the self-service POS terminal 100, the status information displayed by the patrol lamp 111 generally changes to "idle" before the detection terminal 3 indicates no operator is detected due to the shopper SC leaving the operation range of the self-service POS terminal 100. Therefore, if the shopper SC temporarily leaves the operation range of the self-service POS terminal 100 before the payment process is completed, the patrol light 111 of the self-service POS terminal 100 continues to display "in use." Therefore, in such a case, the store server 5 changes the available register determination status in the terminal status table 534 to "in use." Furthermore, if the shopper SC leaves the operation range of the self-service POS terminal 100 after the payment process is completed, the patrol light 111 of the self-service POS terminal 100 displays "idle" before the detection terminal 3 detects no operator. Therefore, in such a case, the store server 5 changes the available register determination status in the terminal status table 534 to "available." The store server 5 determines an available terminal that is not in use based on the available register detection status and available register determination status in the terminal status table 534 (step S29), generates guidance information for guiding the waiting customer to the determined available terminal, and transmits the generated guidance information to the display device 7 (step S30). The display device 7 displays the guidance information (step S31).

[0081] The operations of the store server 5 in steps S1 to S5, steps S9 to S13, steps S18 to S22, and steps S26 to S30 will be described in detail below.

[0082] FIG. 12 is a flowchart showing the main steps of the information processing executed by the processor 51 of the store server 5. The processor 51 executes this processing at regular intervals, for example, every few seconds, based on a control program stored in the main memory 52 or the auxiliary storage device 53. Unless otherwise specified, the processing operation of the processor 51 transitions from ACTx (x is a natural number) to ACT(x+1). The steps shown in FIG. 12 are merely an example. There are no particular limitations on the steps as long as similar results can be obtained.

[0083] In ACT1, the usage status acquisition unit 512 implemented in the processor 51 receives, via the communication interface 55, a human detection notification transmitted from the detection terminal 3 of each cash register system RS.

[0084] In ACT2, the usage status acquisition unit 512 updates the empty register detection status in the terminal status table 534 based on the received human detection notification.

[0085] As ACT3, the terminal status determination unit 513 implemented in the processor 51 acquires camera video from the checkout area camera 6 via the communication interface 55. The terminal status determination unit 513 stores the acquired camera video in the video temporary storage unit 535.

[0086] In ACT4, the terminal status determination unit 513 initializes the value of an internal counter n to “1.” This value of the internal counter n is used to specify the register number in the terminal status table 534.

[0087] In ACT 5, the terminal status determination unit 513 determines whether the empty register detection status of the register number indicated by the value of internal counter n in the terminal status table 534 indicates an empty state. If it is not empty, that is, if it is in use, the terminal status determination unit 513 determines NO in ACT 5 and proceeds to ACT 6. If it is empty, the terminal status determination unit 513 determines YES in ACT 5 and proceeds to ACT 7.

[0088] In ACT6, the terminal status determination unit 513 determines that the self-checkout POS terminal 100 of the register system RS with that register number is in use. After that, the terminal status determination unit 513 proceeds to ACT11.

[0089] In ACT7, the terminal status determination unit 513 extracts the image corresponding to the register number indicated by the value of the internal counter n, i.e., the image of the part of the corresponding patrol lamp 111, from the camera images stored in the temporary image storage unit 535. Since the positional relationship between the checkout area camera 6 and the patrol lamp 111 of each self-service POS terminal 100 is fixed, it is known which pixel group in the camera image corresponds to which patrol lamp 111 image.

[0090] In ACT8, the terminal status determination unit 513 determines the display status of the patrol lamp 111 from the extracted video.

[0091] In ACT 9, the terminal status determination unit 513 determines whether the corresponding self-service POS terminal 100 is in a state where it can process the next customer, that is, whether it is in an idle state rather than in use, based on the display status of the determined patrol lamp 111, that is, the color pattern and the light emission pattern. If it is not in a state where it can process the next customer, that is, if it is in use, the terminal status determination unit 513 determines NO in ACT 8 and proceeds to ACT 6 above. If it is in a state where it can process the next customer, the terminal status determination unit 513 determines YES in ACT 8 and proceeds to ACT 10.

[0092] As in ACT5 and ACT7 to ACT9, the terminal status determination unit 513 determines the status only for the self POS terminal 100 that does not receive a human detection notification as the detection information.

[0093] In ACT10, the terminal status determination unit 513 determines that the self-checkout POS terminal 100 of the register system RS with that register number is in an empty register status.

[0094] In ACT11, the terminal status determination unit 513 stores the in-use status, which is the determination result of ACT6, or the empty register status, which is the determination result of ACT10, in the empty register determination status of the register number indicated by the value of the internal counter n in the terminal status table 534.

[0095] In ACT12, the terminal status determination unit 513 determines whether the value of the internal counter n is "8", that is, whether the empty register status has been determined for all register numbers in the terminal status table 534. If the value of the internal counter n is "8", the terminal status determination unit 513 determines YES in ACT12 and proceeds to ACT14. If the value of the internal counter n is not "8", that is, if determination has not yet been made for all register numbers, the terminal status determination unit 513 determines NO in ACT12 and proceeds to ACT13.

[0096] In ACT13, the terminal status determination unit 513 increments the value of the internal counter n by 1. Thereafter, the terminal status determination unit 513 proceeds to ACT5.

[0097] As ACT14, the guidance unit 514 implemented in the processor 51 creates display information for the display screen of the vacant register to be displayed on the display device 7. Specifically, the guidance unit 514 creates display information for the display screen including the register number of the self-service POS terminal 100 whose vacant register determination status in the terminal status table 534 is vacant.

[0098] In ACT15, the guiding unit 514 transmits the created display information to the display device 7 via the communication interface 55. Then, the processor 51 ends this process.

[0099] Fig. 13 is a diagram showing an example of a display on the display device 7. As shown in Fig. 13, a single vacant register number display 72 is displayed on the display surface 71 of the display device 7, displaying the register numbers of vacant self-service POS terminals 100. If there are multiple register numbers of self-service POS terminals 100 whose vacant register determination status in the terminal status table 534 is vacant, the guidance unit 514 selects one register number from the top according to a pre-specified priority order and creates display information for the display screen. The priority order can be set arbitrarily by the administrator of the store server 5, for example, by giving priority to an vacant self-service POS terminal that is close to the customer entrance of the checkout area CE, or by giving priority to a self-service POS terminal that has been used less frequently or for a shorter period of time by customers in a predetermined period of time.

[0100] Fig. 14 is a diagram showing another example of display on the display device 7. Fig. 14 shows an example in which all of the register numbers of available self-service POS terminals 100 are displayed. In this case, an available register number display 72 that displays the register numbers of available self-service POS terminals 100 is displayed on the display surface 71 of the display device 7. The register numbers of self-service POS terminals 100 that are in use and unavailable are displayed as unavailable register number displays 73 in a lighter color than the available register number displays 72. Of course, it is also possible not to display the register numbers of unavailable self-service POS terminals 100.

[0101] Fig. 15 is a diagram showing another example of display on the display device 7. Fig. 15 is an example of display when the empty register status in Fig. 14 has changed to an empty state after the settlement at the self-service POS terminal 100 with register number R6 has been completed. In this embodiment, if the shopper SC temporarily leaves the operating range of the self-service POS terminal 100 while the settlement at the self-service POS terminal 100 with register number R6 has not been completed, the display in Fig. 14 continues without transitioning to the display in Fig. 15.

[0102] As described above, the store server 5 as an information processing device according to the first embodiment acquires, via the terminal status determination unit 513, image information capable of identifying the status of each of the self-service POS terminals 100 as the multiple transaction processing devices 1 at which the shopper SC performs operations related to a transaction, and receives, via the usage status acquisition unit 512, detection information for each of the multiple self-service POS terminals 100 indicating the presence of a person at a specified operation position relative to the self-service POS terminal 100. Based on the acquired image information and detection information, the store server 5 determines whether each of the multiple self-service POS terminals 100 is ready for the shopper SC to start operating it. In accordance with the determination result, the store server 5 outputs, via the guidance unit 514, guidance information to the display device 7 to guide the shopper SC, who is a waiting customer waiting at the entrance of the checkout area CE, to a self-service POS terminal 100 that is ready for the shopper SC to start operating it. Therefore, the information processing device according to the first embodiment can determine and guide a transaction processing device 1 that is ready to begin operation, thereby enabling a customer using a checkout area CE that has multiple self-service transaction processing devices 1 to be guided to an appropriate transaction processing device 1. For example, even if a customer operating transaction processing device 1 leaves transaction processing device 1 before completing the checkout process to call a store clerk or to retrieve an item they forgot to buy, this prevents the transaction processing device from being determined to be an available device and being guided to another customer as an available device.

[0103] Furthermore, in the first embodiment, terminal status determination unit 513 determines whether or not a transaction processing device that does not receive detection information is in a state in which operation by the shopper SC can be started. Therefore, according to the information processing device in the first embodiment, it is not necessary to execute the determination process for all self-checkout POS terminals 100, and therefore the processing speed can be increased.

[0104] In addition, in this first embodiment, the terminal status determination unit 513 acquires, as image information, image information of a photograph of the patrol lamp 111, which is a display element provided on the self-service POS terminal 100 and indicates whether the self-service POS terminal 100 is in a state of waiting to be used or in use, and determines, based on the image of the patrol lamp 111 included in this image information, whether the self-service POS terminal 100 is in a state of waiting to be used, and determines that a self-service POS terminal 100 in a state of waiting to be used is in a state where the shopper SC can begin to perform operations. Therefore, according to the information processing device in the first embodiment, the state of the self-POS terminal 100 can be determined by capturing an image of the patrol lamp 111 that displays the state of the self-POS terminal 100.

[0105] The patrol lamp 111 indicates the state of the self-service POS terminal 100 by at least one of the color and state of light emitted. Therefore, according to the information processing device in the first embodiment, the state of the self POS terminal 100 can be easily determined simply by determining the light color and / or light emission state of the patrol lamp 111.

[0106] Furthermore, according to the guidance system of the first embodiment, the checkout area CE is provided with a plurality of self-service POS terminals 100 as transaction processing devices 1 at which customer shoppers SC perform operations related to transactions, and a checkout area camera 6 as a generation device that generates image information that can identify the status of each of the plurality of self-service POS terminals 100. Based on the image information generated by the checkout area camera 6, the store server 5 as an information processing device determines whether each of the plurality of self-service POS terminals 100 is in a state where the shopper SC can begin performing operations, and generates guidance information to guide the self-service POS terminals 100 that are in a state where the shopper SC can begin performing operations. The guidance information generated by the store server 5 is then presented to waiting shoppers who are waiting to begin performing operations by a display device 7 as a presentation device arranged at the entrance to the checkout area CE. Therefore, according to the guidance system of the first embodiment, it is possible to determine and guide to a transaction processing device 1 that is in a state where operations can be started, making it possible to guide customers using a checkout counter CE where multiple self-service transaction processing devices 1 are installed to an appropriate transaction processing device 1.

[0107] [Variations] In the first embodiment, the checkout area camera 6 photographs the patrol lamp 111 of each self-service POS terminal 100, and the camera 22 of the transaction camera 2 corresponding to each self-service POS terminal 100 photographs the shopper SC within the operation range.

[0108] Each detection terminal 3 may omit the transaction camera 2 by extracting and using an image of the operating range of the self-POS terminal 100 of the cash register system RS from the camera image captured by the checkout area camera 6.

[0109] In addition, by adjusting the installation position, direction, and posture of the camera 22 of the transaction camera 2, the camera 22 can be made to capture the operating range of the self-POS terminal 100 and the patrol lamp 111, so that the checkout area camera 6 can be omitted.

[0110] Furthermore, instead of using the checkout area camera 6 to photograph multiple patrol lights 111, each cash register system RS may be equipped with a camera that photographs the patrol lights 111 of the self-POS terminal 100 of that cash register system RS in addition to the transaction camera 2.

[0111] [Second embodiment] In the guidance system according to the first embodiment, the current status of the self-POS terminal 100 is determined based on the display state of the patrol lamp 111. This embodiment is an example in which the object used to determine the current status of the self-POS terminal 100 is something other than the patrol lamp 111. Specifically, in this embodiment, the display screen of the touch panel 104 of each self-POS terminal 100 is used as the object to be determined.

[0112] 16 is a diagram showing an example of an idle screen 1041 displayed on the touch panel 104 of the self-service POS terminal 100. When the self-service POS terminal 100 is available, a specified idle screen 1041 indicating this is displayed on the touch panel 104. For example, as shown in FIG. 16, the idle screen 1041 includes a display that shows the register number of the self-service POS terminal 100 to the shopper SC.

[0113] 17 is a diagram showing an example of a transaction start screen 1042 displayed on the touch panel 104 of the self-service POS terminal 100. For example, when the shopper SC touches the touch panel 104, the idle screen 1041 in FIG. 16 is switched to this transaction start screen 1042.

[0114] 18 is a diagram showing an example of a registration screen 1043 displayed on the touch panel 104 of the self-checkout POS terminal 100. The registration screen 1043 displays a list of registered products, prices, etc.

[0115] 19 is a diagram showing an example of a payment selection screen 1044 displayed on the touch panel 104 of the self-service POS terminal 100. When the "Proceed to Checkout" button included in the registration screen 1043 shown in FIG. 18 is touched, the screen switches to this payment selection screen 1044.

[0116] 20 is a diagram showing an example of a transaction completion screen 1045 displayed on the touch panel 104 of the self-service POS terminal 100. When the settlement at the self-service POS terminal 100 is completed, this transaction completion screen 1045 is displayed. After the transaction completion screen 1045 is displayed for a certain period of time, the screen returns to the idle screen 1041 shown in FIG.

[0117] Therefore, in this embodiment, the checkout area camera 6 captures an image of the touch panel 104 of each self-service POS terminal 100, and the camera 22 of the transaction camera 2 corresponding to each self-service POS terminal 100 captures an image of the shopper SC within the operation range. The store server 5 then extracts an image of the display screen of the touch panel 104 of each self-service POS terminal 100 from the camera image of the checkout area camera 6, and determines the current status of that self-service POS terminal 100 based on what screen is displayed.

[0118] Specifically, if the touch panel 104 displays an idle screen 1041, the store server 5 determines that the self-service POS terminal 100 is available. If the display on the touch panel 104 switches from the idle screen 1041 to a transaction start screen 1042, the store server 5 determines that the self-service POS terminal 100 is in use. If the display on the touch panel 104 is the registration screen 1043, the payment selection screen 1044, a checkout screen (not shown), or the like, the store server 5 determines that the self-service POS terminal 100 is in use. Even if the detection terminal 3 has stopped transmitting a human detection notification, if the touch panel 104 displays the registration screen 1043, the payment selection screen 1044, a checkout screen, or the like, the store server 5 determines that the self-service POS terminal 100 is in use. Furthermore, when the display on the touch panel 104 changes to the transaction completion screen 1045, the store server 5 may determine that the self-service POS terminal 100 has become available immediately, without waiting for the display to switch to the idle screen 1041, or after a certain amount of time has passed.

[0119] In this way, touch panel 104 is an example of a display member provided in transaction processing equipment that displays whether transaction processing equipment 1 is in a state of waiting to be started or in use. It can also be said that touch panel 104 is an example of a display device that displays whether transaction processing equipment 1 is in a state of waiting to be started or in use using at least one of characters and symbols.

[0120] Specifically, in ACT 7, the store server 5 extracts the display screen portion of the touch panel 104, not the patrol lamp 111, as the image corresponding to the register number indicated by the value of the internal counter n. Then, in ACT 8, the display status of the display screen of the touch panel 104 is determined. In ACT 9, based on the determined display status of the touch panel 104, such as the idle screen 1041 or the transaction start screen 1042, it is determined whether the corresponding self-service POS terminal 100 is in a state where it can process the next customer, that is, whether it is idle rather than in use. In this way, the terminal status determination unit 513 implemented in the processor 51 extracts, from the camera image stored in the temporary image storage unit 535, the image of the touch panel 104 corresponding to the register number indicated by the value of the internal counter n, and by determining the screen of the touch panel 104 from the extracted image, it becomes possible to determine the current status of the self-service POS terminal 100.

[0121] In the first embodiment, a certain amount of video was required to determine whether the patrol lamp 111 was flashing or lit, but in this embodiment, a single shot image may be sufficient.

[0122] As described above, even if the display screen of the touch panel 104 of each self-service POS terminal 100 is used as the judgment target, it is possible to determine and guide to a transaction processing device 1 that is in a state where operations can be started, just as in the first embodiment, so that it becomes possible to guide to an appropriate transaction processing device 1 for customers using a checkout counter CE where multiple self-service transaction processing devices 1 are installed.

[0123] Furthermore, in this second embodiment, the terminal status determination unit 513 acquires, as image information, image information obtained by photographing the touch panel 104, which is a display component provided on the self-service POS terminal 100 and indicates whether the self-service POS terminal 100 is in a state of waiting to be used or in use, and determines whether the self-service POS terminal 100 is in a state of waiting to be used based on the image of the screen of the touch panel 104 included in this image information, and determines that a self-service POS terminal 100 in a state of waiting to be used is in a state where the shopper SC can begin to perform operations. Therefore, according to the information processing device in the second embodiment, the state of the self-checkout POS terminal 100 can be determined by capturing an image of the touch panel 104 that displays the state of the self-checkout POS terminal 100.

[0124] The touch panel 104 displays the state of the self-checkout POS terminal 100 by at least one of characters and symbols such as buttons. Therefore, according to the information processing device of the second embodiment, the state of the self-checkout POS terminal 100 can be easily determined simply by determining the characters and / or symbols displayed on the screen of the touch panel 104.

[0125] [Variations] In the second embodiment, as in the modified example of the first embodiment, the checkout area camera 6 may be omitted by adjusting the installation position, direction, and posture of the camera 22 of the transaction camera 2 so that the camera 22 can capture the operation range of the self-service POS terminal 100 and the display contents of the touch panel 104.

[0126] Furthermore, instead of using the checkout area camera 6 to photograph the touch panels 104 of multiple self-service POS terminals 100, each cash register system RS may be equipped with a camera that photographs the screen of the touch panel 104 of the self-service POS terminal 100 of that cash register system RS in addition to the transaction camera 2.

[0127] [Third embodiment] In the guidance system of the second embodiment, the display screen of the touch panel 104 of each self-POS terminal 100 is the object of judgment, but in this embodiment, the display screen of the touch panel provided on the attendant terminal 4 is the object of judgment.

[0128] 21 is a schematic diagram showing an example of a checkout area CE to which the guidance system according to the third embodiment is applied. In this embodiment, the checkout area camera 6 is installed so that its imaging range 61 corresponds to the display screen of the attendant terminal 4.

[0129] 22 and 23 are diagrams showing an example of a monitoring screen 41 displayed on the touch panel of the attendant terminal 4. The monitoring screen 41 includes a terminal list area 42 that displays a list of self-service POS terminals 100 of the monitored cash register system RS as icons, and a terminal status area 43 that displays the display contents of the touch panel 104 of each self-service POS terminal 100. When an error occurs in any of the self-service POS terminals 100, a pop-up alert 44 is superimposed on the display contents of the touch panel 104 of each self-service POS terminal 100 that are displayed in the terminal status area 43 of the monitoring screen 41, as shown in FIG.

[0130] The attendant terminal 4 receives status information indicating the status of each self-service POS terminal 100 transmitted from the self-service POS terminal 100 and display information displayed on the touch panel 104. Based on the received status information, the attendant terminal 4 changes the color, density, or shape of the icon displayed in the terminal list area 42 to distinguishably display the current status of each self-service POS terminal 100. In the example of FIG. 23, the self-service POS terminals 100 of the register systems RS with register numbers R2, R3, R7, and R8 are displayed with an icon indicating that they are in use, i.e., being monitored, and the self-service POS terminals 100 of the register systems RS with register numbers R1, R4, R5, and R6 are displayed with an icon indicating that they are available, i.e., not being monitored. Also, in FIG. 23, the icon is changed to distinguishably display that an error has occurred in the self-service POS terminal 100 of the register system RS with register number R2.

[0131] Therefore, in this embodiment, the checkout area camera 6 captures an image of the monitoring screen 41 displayed on the touch panel 104 of the attendant terminal 4, and the camera 22 of the transaction camera 2 corresponding to each self-service POS terminal 100 captures an image of the shopper SC within its operation range. The store server 5 then extracts an image showing the status of the self-service POS terminal 100 of each cash register system RS from the image of the terminal list area 42, which is the camera image of the checkout area camera 6, and determines the current status of each self-service POS terminal 100 based on the image displayed. By fixing the positional relationship between the checkout area camera 6 and the monitoring screen 41 of the attendant terminal 4, it is possible to know which pixel in the camera image corresponds to the image of the icon of which self-service POS terminal 100. If the positional relationship is not fixed, the store server 5 can determine which pixel in the camera image corresponds to the image of the icon of which self-service POS terminal 100 by identifying the terminal list area 42 using a known image recognition process. Of course, the current status of each self-POS terminal 100 may be determined by using the image in the terminal status area 43 instead of the image in the terminal list area 42, or the accuracy of the determination may be improved by using both the image in the terminal list area 42 and the image in the terminal status area 43.

[0132] In this way, the attendant terminal 4 is an example of a monitoring device that communicates with each transaction processing device 1 and monitors the status of each transaction processing device 1, and the monitoring screen 41 of the attendant terminal 4 is an example of a display screen that displays the status of multiple transaction processing devices 1.

[0133] Specifically, in ACT7, the store server 5 extracts the icon of the self-service POS terminal 100 corresponding to the register number indicated by the value of the internal counter n from the monitoring screen 41 displayed on the touch panel of the attendant terminal 4 as the image corresponding to the register number indicated by the value of the internal counter n. Then, in ACT8, the display status of the icon is determined, and in ACT9, based on the display status of the icon, it is determined whether the corresponding self-service POS terminal 100 is in a state where it can process the next customer, that is, whether it is idle rather than in use. In this way, the terminal status determination unit 513 implemented in the processor 51 extracts, from the camera image stored in the temporary image storage unit 535, the icon image in the terminal list area 42 corresponding to the register number indicated by the value of the internal counter n, and determines what the extracted icon image looks like, thereby making it possible to determine the current status of the self-service POS terminal 100.

[0134] As described above, even if the display screen of the touch panel equipped on the attendant terminal 4 is used as the judgment target, as in the first embodiment, it is possible to determine and guide to a transaction processing device 1 that is in a state where operations can be started, making it possible to guide customers using a checkout counter CE where multiple self-service transaction processing devices 1 are installed to an appropriate transaction processing device 1.

[0135] In addition, in this third embodiment, the terminal status determination unit 513 acquires, as image information, image information obtained by photographing the monitoring screen 41, which is a display screen that displays the status of multiple self-POS terminals 100, on the attendant terminal 4, which acts as a monitoring device that communicates with each self-POS terminal 100 and monitors the status of each self-POS terminal 100, and determines whether the self-POS terminal 100 is in a state waiting to be used or not based on the status display image for the multiple self-POS terminals 100 included in this image information, for example, the icon image in the terminal list area 42, and determines that a self-POS terminal 100 that is in a state waiting to be used is in a state where it is possible for the shopper SC to start operating it. Therefore, according to the information processing device of the third embodiment, the status of the self-POS terminal 100 can be easily determined by photographing the monitoring screen 41 of the attendant terminal 4 that displays the status of the self-POS terminal 100.

[0136] [Fourth embodiment] In the guidance systems according to the first to third embodiments, which self-service POS terminals 100 are available are determined by combining the status of available register detection by the detection terminal 3 and the status of available register determination by the camera image of the checkout area camera 6. In this embodiment, which self-service POS terminals 100 are available are determined only by the status of available register determination by the camera image of the checkout area camera 6.

[0137] Therefore, the processor 51 of the store server 5 as an information processing device according to this embodiment does not include the usage status acquisition unit 512, and the terminal status table 534 does not need to store the empty register detection status.

[0138] Fig. 24 is a sequence diagram showing an outline of the operation involved in providing information about available registers in the guidance system according to the fourth embodiment. In this embodiment, as shown in Fig. 24, the store server 5 acquires camera images from the checkout area camera 6 at regular intervals (step S2). The store server 5 then performs a status determination process using the camera images to determine the available register status of each self-service POS terminal (step S3). Based on the determination result, the store server 5 updates the available register determination status in the terminal status table 534 to available or in use.

[0139] Then, the store server 5 performs an available register determination process to determine an available terminal that is not in use based on the available register detection status and available register determination status in the terminal status table 534 (step S101). In this available register determination process, in this embodiment, the store server 5 determines, as an available terminal, a self-service POS terminal 100 whose available register determination status in the terminal status table 534 is "available." The store server 5 generates guidance information for guiding a waiting customer to the available terminal thus determined, and transmits the guidance information to the display device 7 (step S5). The display device 7 displays the guidance information (step S6).

[0140] Thereafter, these steps are repeated.

[0141] 25 is a flowchart showing the main steps of information processing executed by the processor 51 of the store server 5 as an information processing device according to the fourth embodiment. In this embodiment, when execution of this processing starts, first, in ACT 3, the terminal status determination unit 513 implemented in the processor 51 acquires camera video from the checkout area camera 6 via the communication interface 55 and stores the camera video in the video temporary storage unit 535. Then, in ACT 4, the terminal status determination unit 513 initializes the value of an internal counter n to "1." After that, in this embodiment, the terminal status determination unit 513 proceeds to ACT 7.

[0142] The processing in ACT6 to ACT15 is as explained in the first embodiment.

[0143] In this way, even if the available transaction processing device 1 is determined solely based on the available register status determined by the camera image from the checkout area camera 6, it is possible to guide shoppers SC, who are customers using a checkout area CE where multiple transaction processing devices 1 are installed, to the appropriate transaction processing device 1.

[0144] Furthermore, according to the information processing device of the fourth embodiment, the status of each transaction processing device 1 is determined based on an image, eliminating the need to communicate with transaction processing device 1 to obtain the status. Therefore, the information processing device can be realized using a computer that is not connected to the communications network NW. A guidance system can be constructed using the information communication device and checkout area camera 6 and display device 7, which are also not connected to the communications network NW. In particular, in a store where a store system including a transaction system TS, attendant terminal, and store server 5 is in operation, an available transaction processing device 1 can be guided without linking with the store system, enabling inexpensive and rapid implementation.

[0145] Although the embodiments of the guidance system and the information processing device have been described above, the embodiments are not limited to these.

[0146] For example, the conditions under which the transaction processing device is determined to be vacant based on the camera image from the checkout area camera 6 may not be limited to the conditions described in the embodiment, but may be set arbitrarily by the administrator of the store server 5 as an information processing device.

[0147] Furthermore, the information processing device is not limited to the store server 5, and its functions may be provided in a computer constituting the detection terminal 3 or the attendant terminal 4. Furthermore, a dedicated computer connected to the communication network NW may be used. Alternatively, by connecting a device for connecting to the Internet to the communication network NW, a server computer provided on the cloud may be used as the information processing device.

[0148] Alternatively, a store clerk may be stationed at the entrance to the checkout area CE, and the store clerk may orally guide customers to the checkout devices. In this case, the display device 7 may be installed in a position where it can guide the store clerk, not the customer, to an available register (available device).

[0149] In addition, instead of using the transaction camera 2, it is also possible to detect whether a shopper SC is within the operating range of the transaction processing device 1 by laying pressure detection mats, which are sensors that detect pressure such as the weight of people or objects present on the floor surface corresponding to the operating range of each transaction processing device 1 in the checkout area CE.

[0150] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0151] 1...transaction processing device, 2...transaction camera, 3...detection terminal, 4...attendant terminal, 5...store server, 6...checkout area camera, 7...display device, 21...camera pole, 22...camera, 41...monitoring screen, 42...terminal list area, 43...terminal status area, 44...pop-up alert, 51...processor, 52...main memory, 53...auxiliary storage device, 54...input / output device, 55...communication interface, 56...system transmission path, 61...imaging range, 71...display surface, 72...register number display, 73...unavailable register number display, 100...self-service POS terminal, 103...display pole, 104...touch panel, 111...patrol lamp, 112...first light-emitting unit, 113...second light-emitting unit, 221, 223...camera-captured image, 222...operation range, 511...Sales data receiving unit, 512...Usage status acquisition unit, 513...Terminal status determination unit, 514...Information unit, 531...Product master database, 532...Store member master database, 533...Sales data database, 534...Terminal status table, 535...Temporary video storage unit, 1041...Idle screen, 1042...Transaction start screen, 1043...Registration screen, 1044...Payment selection screen, 1045...Transaction completion screen, AL...Entry lane, CE...Checkout area, EL...Exit lane, NW...Communication network, RS...Cash register system, SC...Shopper, SP...Store clerk, TS...Transaction system.

Claims

1. an acquisition unit that acquires image information that allows identification of the status of each of a plurality of transaction processing devices on which a customer performs operations related to a transaction; a receiving unit for receiving, for each of the plurality of transaction processing devices, detection information indicating the presence of a person at a specified operating position relative to the transaction processing device; a determination unit that determines whether each of the plurality of transaction processing devices is in a state where the customer can start performing the operation based on the image information and the detection information; an output unit that outputs guidance information to guide a waiting customer who is waiting to start performing the operation to a transaction processing device among the plurality of transaction processing devices that is in a state where the customer can start performing the operation, according to a determination result by the determination unit; An information processing device comprising:

2. The information processing device according to claim 1 , wherein the determination unit determines, for the transaction processing device that does not receive the detection information, whether the customer can start performing the operation based on the image information.

3. the acquisition unit acquires, as the image information, image information obtained by capturing an image of a display member provided in the transaction processing device that displays whether the transaction processing device is in a waiting state or in use; The information processing device described in claim 1 or 2, wherein the judgment unit determines whether the transaction processing device is in the state of waiting to start use based on the image of the display member included in the image information, and judges the transaction processing device in the state of waiting to start use to be in a state where the customer can start performing the operation.

4. The information processing device described in claim 3, wherein the image of the display element included in the image information includes an image of a patrol lamp that indicates the state by at least one of an illuminating color and an illuminating state, or an image of a display screen of a display device that displays the state by at least one of letters and symbols.

5. the acquisition unit acquires, as the image information, image information obtained by capturing an image of a display screen displaying the status of the plurality of transaction processing devices in a monitoring device that communicates with each of the transaction processing devices and monitors the status of each of the transaction processing devices; The information processing device described in claim 1 or 2, wherein the determination unit determines whether the transaction processing device is in a state waiting to be used based on an image of a status display for the multiple transaction processing devices included in the image information, and determines that the transaction processing device in the state waiting to be used is in a state where the customer can start performing the operation.

6. a plurality of transaction processing devices, each of which allows a customer to perform a transaction-related operation; a generating device that generates image information that allows a state of each of the plurality of transaction processing devices to be identified; a detection device for detecting the presence of a person at a predetermined operating position relative to each of the transaction processing devices and outputting detection information indicating the presence of the person; an information processing device that determines whether each of the plurality of transaction processing devices is in a state where the customer can start performing the operation based on the image information generated by the generation device and the detection information output by the detection device, and generates guidance information that guides the customer to transaction processing devices that are in a state where the customer can start performing the operation; a presentation device that presents the guidance information generated by the information processing device to a waiting customer who is waiting to start performing the operation; A guidance system comprising:

7. a computer of an information processing device having a processor and a memory, which controls a guidance device that guides a customer to available transaction processing devices; a function of acquiring image information that enables identification of the status of each of a plurality of transaction processing devices on which the customer performs transaction-related operations; receiving, for each of the plurality of transaction processing devices, detection information indicating the presence of a person at a predetermined operating position relative to the transaction processing device; a function of determining whether each of the plurality of transaction processing devices is in a state in which the customer can start performing the operation based on the image information and the detection information; a function of causing the guidance device to output guidance information that guides a waiting customer who is waiting to start performing the operation to a transaction processing device among the plurality of transaction processing devices that is in a state where the customer can start performing the operation, according to the result of the determination; and A program to achieve this.

Images