Information processing server, information processing system, and program

Abstract

To provide an information processing server that outputs accounting guidance information that contributes to improving the operational efficiency of accounting machines. [Solution] The information processing server according to the embodiment comprises an input interface, a processor, and an output interface. The input interface receives image data from a camera that photographs an area including each row where users are lined up according to their accounting method. The processor detects the type of each row and the order in which users are lined up in the image data based on column management information that assigns a type to each row in the image data, and selects a predetermined accounting machine corresponding to the type of a predetermined row where predetermined users are lined up in a predetermined order, based on accounting machine management information that manages the type and availability of each accounting machine. The output interface outputs accounting guidance information to guide users to the predetermined accounting machine.

Description

Technical Field

[0001] Embodiments of the present invention relate to an information processing server, an information processing system, and a program.

Background Art

[0002] In recent years, in mass retailers such as supermarkets, self-type accounting machines that allow customers to perform accounting operations for purchased goods by themselves have become widespread. Normally, a plurality of accounting machines are installed together in the in-store accounting space, and customers enter the accounting space to operate the accounting machines. In addition, there are various models of accounting machines according to the accounting methods of customers, and there are cases where these various models of accounting machines are installed mixed in the accounting space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Depending on the layout of the accounting machines in the accounting space, it may be difficult to know which accounting machine is available. Also, during congestion, there may be a waiting line for accounting even though there are available accounting machines. Furthermore, in a case where multiple models of accounting machines are installed mixed in the accounting space, customers need to search for an accounting machine of a model corresponding to their accounting method and perform accounting operations on the searched accounting machine. For this reason, an accounting machine of a model that does not correspond to the accounting method of a customer who first tries to enter the accounting space may be left empty for a while, and there is a concern about a decrease in the operating efficiency of the entire accounting machine.

[0005] The problem to be solved by the present invention is to provide an information processing server, an information processing system, and a program that output accounting guidance information contributing to improvement of the operating efficiency of accounting machines. [Means for solving the problem]

[0006] The information processing server according to the embodiment includes an input interface, a processor, and an output interface. The input interface receives image data from a camera that photographs an area including each row where users are lined up according to their accounting method. The processor detects the type of each row and the order in which users are lined up in the image data based on column management information that assigns a type to each row in the image data, and selects a predetermined accounting machine corresponding to the type of a predetermined row where predetermined users are lined up in a predetermined order, based on accounting machine management information that manages the type and availability of each accounting machine. The output interface outputs accounting guidance information to guide users to the predetermined accounting machine. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is a diagram illustrating the configuration of a store system according to one embodiment. [Figure 2] Figure 2 shows the positional relationship between the self-service POS terminal and the first camera. [Figure 3] Figure 3 is a sequence diagram showing the correspondence between the screen transitions displayed on the touch panel of the self-service POS terminal, the actions taken by the payer, and the terminal status of the self-service POS terminal. [Figure 4] Figure 4 is a block diagram showing the main circuit configuration of the monitoring device. [Figure 5] Figure 5 is a schematic diagram showing the main functional configuration of the monitoring device's processor. [Figure 6] Figure 6 is a schematic diagram showing the data structure of the judgment table. [Figure 7] Figure 7 is a flowchart showing the main steps of the information processing performed by the monitoring device's processor according to the terminal monitoring program. [Figure 8] Figure 8 is a flowchart showing the main steps of the information processing performed by the monitoring device's processor according to the terminal monitoring program. [Figure 9]Figure 9 is a flowchart showing the main steps of the information processing performed by the monitoring device's processor according to the terminal monitoring program. [Figure 10] Figure 10 shows an example of an image displayed on a monitor. [Figure 11] Figure 11 shows an example of an image displayed on a monitor. [Figure 12] Figure 12 shows an example of an image displayed on the monitor. [Figure 13] Figure 13 is a schematic diagram showing the main functional configuration of the processor of the monitoring device in the second embodiment. [Figure 14] Figure 14 is a flowchart showing the main steps of information processing performed by the monitoring device's processor in accordance with the terminal monitoring program in the second embodiment. [Figure 15] Figure 15 is a schematic diagram showing the main functional configuration of the monitoring device's processor. [Figure 16] Figure 16 shows an example of column management information. [Figure 17] Figure 17 shows an example of terminal management information. [Figure 18] Figure 18 shows an example of output management information. [Figure 19] Figure 19 is a flowchart showing an example of accounting guidance information output by a monitoring device. [Figure 20] Figure 20 is the first transition diagram illustrating the arrangement of the queues and the guidance to the self-service POS terminals. [Figure 21] Figure 21 is a second transition diagram illustrating the arrangement of the queues and the guidance to the self-service POS terminals. [Figure 22] Figure 22 is a third transition diagram illustrating the arrangement of the queues and the guidance to the self-service POS terminals. [Figure 23] Figure 23 is a fourth transition diagram illustrating the arrangement of the queues and guidance to the self-service POS terminals. [Figure 24] Figure 24 is a fifth transition diagram illustrating the arrangement of the queues and guidance to the self-service POS terminals. [Figure 25]FIG. 25 is a sixth transition diagram for explaining the arrangement of columns and guidance to the self-POS terminal.

Embodiments for Carrying Out the Invention

[0008] Hereinafter, each embodiment will be described with reference to the drawings. Note that the scales of each part in the drawings used in the following description of each embodiment are appropriately changed. Also, in each of the drawings used in the following description of each embodiment, some components are appropriately omitted or the arrangement of some components is appropriately changed.

[0009] This embodiment discloses a monitoring device for a full-self type payment terminal, so-called self-POS (Point Of Sales) terminal, in which a customer himself / herself performs accounting operations from registration of purchased goods to settlement.

[0010] <First Embodiment> [Description of Store System] FIG. 1 is a configuration diagram of a store system constructed in a store such as a supermarket where self-POS terminals are introduced. This store system includes a self-POS system 100 and a terminal monitoring system 200.

[0011] The self-POS system 100 includes a plurality of self-POS terminals 11, a POS server 12, a display control device 13, an attendant terminal 14, and a communication network 15. The self-POS system 100 connects the plurality of self-POS terminals 11, the POS server 12, and the display control device 13 to the communication network 15 respectively. Also, the self-POS system 100 connects the attendant terminal 14 to the display control device 13. The communication network 15 is typically a LAN (Local Area Network). The LAN may be a wired LAN or a wireless LAN.

[0012] The self-service POS terminal 11 is a fully self-service payment terminal that allows customers to perform operations from registering purchased items to payment themselves. The customer can be rephrased as the payer. Multiple self-service POS terminals 11 are installed in a checkout space P, which is separated from the sales floor where the products are displayed. A payer who has gathered their purchased items in the sales floor can enter checkout space P and complete the process from registering purchased items to payment by operating an available self-service POS terminal 11 themselves.

[0013] The POS server 12 is a server computer that collects and aggregates data on each product registered for sale via self-service POS terminals 11, etc., in order to manage store sales, inventory, etc. To achieve this management, the POS server 12 has a product master and a sales master. The product master is a database that associates each product with a product code that identifies it individually, and stores preset item data such as the unit price and product name of the product identified by that product code. The sales master is a database that associates each product with a product code and aggregates item data such as the quantity received, quantity sold, and sales amount of the product identified by that product code, for example, on a per-business-day basis.

[0014] The display control device 13 is a controller that generates an image for the attendant for each self-service POS terminal 11 based on the data signals output from each self-service POS terminal 11, and displays it on the display of the attendant terminal 14. The attendant terminal 14 is a terminal used by store employees, referred to as attendants, to check the status of each self-service POS terminal 11. The attendant terminal 14 is equipped with a display such as an LCD display or an OLED display. The attendant terminal 14 divides the display screen into multiple sections and displays a different image of the self-service POS terminal 11 in each section.

[0015] The terminal monitoring system 200 comprises multiple first cameras 21, one or more second cameras 22, a monitoring device 23, and multiple monitors 30. The multiple first cameras 21 are installed in the accounting space P so that each corresponds one-to-one with the same number of self-service POS terminals 11. The first cameras 21 photograph the person making the payment operating the corresponding self-service POS terminal 11.

[0016] The second camera 22 is installed in the waiting area Q where customers waiting to pay who cannot enter the checkout area P wait. The second camera 22 photographs the customers waiting in the waiting area Q.

[0017] The monitoring device 23 is a device that monitors the availability of the self-service POS terminals 11 based on the terminal status STa output via the display control device 13 and image data CIa captured by each first camera 21. Based on the image data CIb captured by the second camera 22, the monitoring device 23 generates image data MI indicating the availability of the self-service POS terminals 11 and outputs it to the monitor 30 installed in the waiting space Q.

[0018] The terminal status STa is status data indicating whether the self-service POS terminal 11 is in an idle state before accepting operation input from the payer, or in an operational state after accepting said operation input. Each self-service POS terminal 11 stores the terminal status STa in its internal memory. The display control device 13 retrieves the respective terminal status STa from each self-service POS terminal 11 and provides it to the monitoring device 23. The monitoring device 23 is an example of a payment terminal monitoring device.

[0019] The multiple monitors 30 include a main monitor 30M that displays overall information, and multiple sub-monitors 30S that are installed corresponding to each lane where users line up according to their payment method. Alternatively, the display area of ​​one sub-monitor 30S may be divided into multiple display areas, so that the information displayed on multiple sub-monitors 30S is displayed in the multiple display areas of one sub-monitor 30S.

[0020] [Explanation of the self-service POS terminal and the first camera] Figure 2 shows the positional relationship between the self-service POS terminal 11 and the first camera 21. First, the external configuration of the self-service POS terminal 11 will be described. Although there are various models of self-service POS terminals 11, Figure 2 shows an example of the external configuration of one such model.

[0021] The self-service POS terminal 11 comprises a main unit 40 installed on the floor and a bagging table 50 installed next to the main unit 40. The main unit 40 has a touch panel 41 attached to its top. The touch panel 41 consists of a display and a touch sensor. The display is a device for showing various screens to the operator operating the self-service POS terminal 11. The touch sensor is a device for detecting touch input on the screen by the operator. In the self-service POS terminal 11, the operator is usually the customer who makes the payment.

[0022] The main unit 40 has a basket stand 60 in the center of its side opposite to the side where the bagging table 50 is installed. The basket stand 60 is for the customer who has come from the sales floor to place a basket containing the purchased items. The customer stands in the operating area R on the front side of the main unit 40 in Figure 2 so that they can see the screen of the touch panel 41. Therefore, from the perspective of the customer standing in the operating area R, the basket stand 60 is on the right side of the main unit 40, and the bagging table 50 is on the left side. In the following explanation, the side with the operating area R will be referred to as the front of the main unit 40, the side where the bagging table 50 is installed will be referred to as the left side of the main unit 40, and the side where the basket stand 60 is installed will be referred to as the right side of the main unit 40.

[0023] The main unit 40 has a scanner reading window 42, a card slot 43, a receipt printing slot 44, a coin slot 45, a coin dispensing slot 46, a banknote slot 47, and a banknote dispensing slot 48 on its front. A communication cable 61 extends from the right side of the main unit 40 to the outside, and a reader / writer 62 for electronic money media is connected to the end of this communication cable 61. The reader / writer 62 is placed on a stand 63 located on the upper right side of the main unit 40.

[0024] The main unit 40 has a display pole 64 attached to its top surface. The display pole 64 is equipped with a warning light 65 at its tip that selectively emits light in, for example, green and red. The display pole 64 displays the status of the self-service POS terminal 11, such as standby, operating, calling, error, etc., depending on the color of the warning light 65.

[0025] The bagging platform 50 has a structure in which a bag holder 52 is attached to the top of the housing 51. The bag holder 52 is equipped with a pair of holding arms 53, which hold the shopping bags provided by the store or the shopping bags brought by the customer, so-called reusable bags, etc.

[0026] For a self-service POS terminal 11 with such an external configuration, the first camera 21 is mounted in a position that allows it to photograph the person making the payment from above as they stand in the operating area R of the self-service POS terminal 11 and face the main unit 40, bagging table 50, basket table 60, and other components.

[0027] Incidentally, the payer standing in the operating area R first places the basket containing the purchased items on the basket stand 60 on the right, and has the holding arm 53 on the left hold a shopping bag or reusable bag. Next, the payer follows the guidance displayed on the touch panel 41 and operates the touch panel 41 to declare that they are starting to use the self-service POS terminal 11.

[0028] Afterward, the payer picks up the purchased items one by one from the baskets placed on the basket stand 60. If the purchased items have barcodes, the payer registers the items by holding the barcodes up to the reading window 42 and having them scanned. If the purchased items do not have barcodes, the payer registers the items by operating the touch panel 41 and selecting the purchased items from the list of items without barcodes. The payer then places the registered purchased items into a shopping bag or reusable bag.

[0029] After registering all purchased items, the payer operates the touch panel 41 to close the transaction and then selects a payment method. For example, if cash payment is selected, the payer inserts banknotes or coins into the banknote slot 47 or coin slot 45 and takes the change dispensed from the banknote dispenser 48 or coin dispenser 46. For example, if electronic money payment, one of the cashless payment methods, is selected, the payer holds the electronic money medium over the reader / writer 62. For example, if credit card payment, another cashless payment method, is selected, the payer inserts the credit card into the card slot 43. After completing the payment through these operations, the payer receives the receipt issued from the receipt dispenser 44 and leaves the store with the shopping bag or reusable bag removed from the holding arm 53. The first camera 21 is mounted in a position to capture the payer's actions at such a self-service POS terminal 11.

[0030] [Explanation of Status Data] Figure 3 is a sequence diagram showing the correspondence between the screen transitions displayed on the touch panel 41 of the self-service POS terminal 11, the actions of the payer, and the status data of the self-service POS terminal 11, also known as the terminal status STa. When the terminal status STa is "0," that is, when the self-service POS terminal 11 is in an idle state before accepting input from the payer, the standby screen SCa is displayed on the touch panel 41. The standby screen SCa is a screen that is waiting to accept input from the payer.

[0031] In this state, when the payer performs the start operation OPa on the self-service POS terminal 11, the screen of the touch panel 41 switches to the registration screen SCb. The registration screen SCb is a screen for displaying data such as the product name and price of the purchased items that have been registered for sale. At this time, the state of the self-service POS terminal 11 transitions from an idle state before accepting operation input from the payer to an operational state after accepting said operation input. That is, the terminal status STa transitions from "0" to "1".

[0032] Subsequently, the payer performs the purchase item registration operation OPb on the self-service POS terminal 11. After completing the registration of all purchased items, the payer performs the closing operation OPc. Upon receiving this closing operation OPc, the touch panel 41 screen transitions to the payment screen SCc. The payment screen is where payment is accepted. The payer then performs the payment operation OPd on the self-service POS terminal 11.

[0033] Once payment is complete, the touch panel 41 screen transitions to the completion screen SCd. The completion screen SCd informs the payer that the payment has been completed. At this time, the state of the self-POS terminal 11 returns from the operational state to the idle state. That is, the terminal status STa transitions from "1" to "0". After a predetermined time has elapsed, the touch panel 41 screen returns to the standby screen SCa. The self-POS terminal 11 then waits for the start operation OPa from the next payer.

[0034] As described above, the terminal status STa is "0" until the start operation OPa is performed by the payer and the touch panel 41 screen transitions to the registration screen SCb. When the screen transitions to the registration screen SCb, the terminal status STa becomes "1", and the terminal status STa remains "1" until the payment operation OPd is performed by the payer and the touch panel 41 screen transitions to the completion screen SCd. When the screen transitions to the completion screen SCd, the terminal status STa becomes "0". In other words, the self-POS terminal 11 is in an idle state before accepting operation input from the payer until the touch panel 41 screen transitions from the standby screen SCa to the registration screen SCb. The self-POS terminal 11 is in an operational state after accepting operation input from the payer until the touch panel 41 screen transitions from the registration screen SCb to the completion screen SCd.

[0035] [Explanation of the monitoring device configuration] Figure 4 is a block diagram showing the main circuit configuration of the monitoring device 23. The monitoring device 23 comprises circuit components such as a processor 231, main memory 232, auxiliary storage device 233, clock 234, communication interface 235, first camera interface 236, second camera interface 237, and monitor interface 238, as well as a system transmission line 239. The system transmission line 239 includes an address bus, data bus, control signal lines, etc. The monitoring device 23 constitutes a computer by connecting each circuit component to the system transmission line 239.

[0036] The processor 231 corresponds to the central part of the computer. The processor 231 controls various parts to realize various functions as a monitoring device 23 according to the operating system or application program (application software). The processor 231 is, for example, a CPU (Central Processing Unit). The processor 231 may also be, for example, an MPU (Micro Processing Unit), SoC (System on a Chip), DSP (Digital Signal Processor), GPU (Graphics Processing Unit), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), or FPGA (Field-Programmable Gate Array). Alternatively, the processor 231 may be a combination of several of these.

[0037] Main memory 232 corresponds to the main memory portion of the computer described above. Main memory 232 includes non-volatile memory areas and volatile memory areas. In the non-volatile memory area, main memory 232 stores the operating system or application programs. Main memory 232 may also store data necessary for the processor 231 to perform processing to control each part in non-volatile or volatile memory areas. Main memory 232 uses the volatile memory area as a work area where data is rewritten as needed by the processor 231. The non-volatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).

[0038] The auxiliary storage device 233 corresponds to the auxiliary storage portion of the computer described above. For example, EEPROM (Electric Erasable Programmable Read-Only Memory), HDD (Hard Disk Drive), or SSD (Solid State Drive) can be auxiliary storage devices 233. The auxiliary storage device 233 stores data used by the processor 231 in performing various processes, or data created by the processing performed by the processor 231. The auxiliary storage device 233 may also store the application programs described above.

[0039] Clock 234 measures the date and time. Monitoring device 23 acquires the date and time measured by clock 234 as the current date and time.

[0040] The communication interface 235 connects to the display control device 13. The communication interface 235 acquires the terminal status STa of each self-service POS terminal 11 from the display control device 13. The first camera interface 236 connects to multiple first cameras 21. The first camera interface 236 acquires image data CIa captured by each first camera 21. The second camera interface 237 connects to the second camera 22. The second camera interface 237 acquires image data CIb captured by the second camera 22. The monitor interface 238 connects to the monitor 30. The monitor interface 238 outputs image data MI generated by the monitoring device 23 to the monitor 30.

[0041] The monitor 30 includes an input interface 301 and a display 302. The input interface 301 receives the video signal output from the monitor interface 238. The display 302 displays the video based on the video signal input from the input interface 301.

[0042] [Explanation of monitoring device functions] Figure 5 is a schematic diagram showing the main functional configuration of the processor 231 of the monitoring device 23. The processor 231 has the functions of an acquisition means 71, a detection means 72, a recognition means 73, a confirmation means 74, and a guidance means 75.

[0043] The monitoring device 23 also includes a determination table 80. As shown in Figure 6, the determination table 80 is a data table having a first column Ca, a second column Cb, a third column Cc, a fourth column Cd, and a fifth column Ce. The determination table 80 is stored, for example, in an auxiliary storage device 233.

[0044] The first column Ca contains the terminal number No. The terminal number No. is a sequential number starting from "1" that is assigned to each self-POS terminal 11 in order to individually identify each self-POS terminal 11. Incidentally, Figure 6 illustrates a judgment table 80 for a self-POS system 100 equipped with eight self-POS terminals 11, each assigned a terminal number No. from "1" to "8".

[0045] The second column Cb contains the terminal status STa. Terminal status STa is status data obtained from the self-POS terminal 11 identified by the corresponding terminal number No. Terminal status STa indicates whether the self-POS terminal 11 is idle or operational. In this embodiment, terminal status STa is set to "0" when the self-POS terminal 11 is idle, and terminal status STa is set to "1" when the self-POS terminal 11 is operational.

[0046] The third column Cc contains the person status STb. The person status STb is data that identifies whether or not a person is present in the operation area R of the self-service POS terminal 11, which is identified by the corresponding terminal number No. In this embodiment, the person status STb is set to "0" when there is no person in the operation area R. The person status STb is set to "1" when there is a person in the operation area R.

[0047] The fourth column Cd contains the availability status STc. The availability status STc is data indicating the availability of the self-service POS terminal 11, which is identified by the corresponding terminal number No. In this embodiment, the availability status STc is set to "0" when the self-service POS terminal 11 is available. The availability status STc is set to "1" when the self-service POS terminal 11 is not available.

[0048] The fifth column, Ce, contains the guidance flag F. The guidance flag F is a 1-bit data that identifies whether or not the payer was guided to the self-POS terminal 11 identified by the corresponding terminal number No. In this embodiment, the guidance flag F is set to "0" to indicate that the customer was not guided, and to "1" to indicate that the customer was guided.

[0049] Let's return to the explanation of Figure 5. The acquisition means 71 is a function that acquires status data indicating whether the self-POS terminal 11 is in an idle state before accepting operation input from a payer, or in an operational state after accepting said operation input. As mentioned above, the status data of each self-POS terminal 11, i.e., the terminal status STa, is provided from the display control device 13 to the monitoring device 23. The acquisition means 71 acquires the terminal status STa of each self-POS terminal 11 from the display control device 13 via the communication interface 235. The acquisition means 71 then updates the terminal status STa in the determination table 80. Specifically, for a self-POS terminal 11 in an idle state, the terminal status STa corresponding to the terminal number No. of the self-POS terminal 11 is set to "0". For a self-POS terminal 11 in an operational state, the terminal status STa corresponding to the terminal number No. of the self-POS terminal 11 is set to "1".

[0050] The detection means 72 has the function of detecting a person who is in the area for the payer to operate the self-POS terminal 11. The detection means 72 analyzes the image data CIa captured by the first camera 21 to determine whether a person is captured. If a person is captured, the detection means 72 recognizes that a person is in the operating area R of the self-POS terminal 11 corresponding to the first camera 21. Based on the detection result, the detection means 72 updates the person status STb in the judgment table 80. That is, for a self-POS terminal 11 in which it is detected that there is no person in the operating area R, the person status STb corresponding to the terminal number No. of the self-POS terminal 11 is set to "0". For a self-POS terminal 11 in which it is detected that there is a person in the operating area R, the person status STb corresponding to the terminal number No. of the self-POS terminal 11 is set to "1".

[0051] The recognition means 73 has the function of recognizing that the self-POS terminal 11 is available when the acquisition means 71 acquires status data indicating that it is in an idle state and the detection means 72 has not detected a person. In other words, the recognition means 73 recognizes a self-POS terminal 11 identified in the determination table 80 by a terminal number No. where the terminal status STa is "0" and the person status STb is "0" as an available terminal. The recognition means 73 recognizes a self-POS terminal 11 identified in the determination table 80 by a terminal number No. where the terminal status STa is "1" or the person status STb is "1" as an unavailable terminal. The recognition means 73 sets the availability status STc corresponding to the terminal number No. of the self-POS terminal 11 recognized as available to "0". The recognition means 73 sets the availability status STc corresponding to the terminal number No. of the self-POS terminal 11 recognized as unavailable to "1".

[0052] The verification means 74 is a function that checks whether there are any customers waiting to use the self-service POS terminal 11. The verification means 74 analyzes the image data CIb of the waiting space Q captured by the second camera 22 to determine if any people are visible. If one or more people are visible, the verification means 74 determines that there are customers waiting to use the self-service POS terminal 11. If no people are visible, the verification means 74 determines that there are no customers waiting to use the self-service POS terminal 11.

[0053] The guidance means 75 is a function that guides the payer to an available self-service POS terminal 11 based on the recognition result by the recognition means 73. Specifically, the guidance means 75 provides guidance by displaying information on the monitor 30 to guide the payer to an available self-service POS terminal 11. The guidance means 75 displays different guidance information on the monitor 30 depending on whether the confirmation means 74 confirms that there is a payer waiting to use the self-service POS terminal 11 or not.

[0054] The functions of the acquisition means 71, detection means 72, recognition means 73, confirmation means 74, and guidance means 75 described above are all realized by information processing performed by the processor 231 in accordance with the terminal monitoring program.

[0055] The terminal monitoring program is a type of application program stored in the main memory 232 or the auxiliary storage device 233. The method of installing the terminal monitoring program in the main memory 232 or auxiliary storage device 233 is not particularly limited. The terminal monitoring program can be installed in the main memory 232 or auxiliary storage device 233 by recording it on a removable recording medium or by distributing it via network communication. The recording medium can take any form as long as it can store a program and is readable by the device, such as a CD-ROM or memory card.

[0056] [Operation description of the monitoring device] Figures 7 to 9 are flowcharts showing the main steps of the information processing performed by the processor 231 of the monitoring device 23 according to the terminal monitoring program. The main operations of the monitoring device 23 will be explained below using each figure. Note that the operations described below are examples. The procedures and processing content can be modified as appropriate if similar effects can be achieved.

[0057] The processor 231 of the monitoring device 23 starts processing information according to the procedure shown in the flowcharts in Figures 7 to 9, for example, when the store opens. First, the processor 231 clears the determination table 80 as ACT1 in Figure 7. As a result of this process, the data described in the second column Cb, third column Cc, fourth column Cd, and fifth column Ce of the determination table 80, namely terminal status STa, person status STb, availability status STc, and guidance flag F, all become "0".

[0058] Having cleared the judgment table 80, the processor 231 proceeds to ACT2. As ACT2, the processor 231 resets the add counter n to "0". Next, as ACT3, the processor 231 increments the add counter n by "1". Then, as ACT4, the processor 231 checks whether the add counter n has exceeded the threshold N. The threshold N is the number of self-POS terminals 11 provided by the self-POS system 100. That is, if the monitoring device 23 of the self-POS system 100 is equipped with eight self-POS terminals 11, each assigned a terminal number from "1" to "8", then the threshold N is "8".

[0059] If the summation counter n does not exceed the threshold N, the processor 231 proceeds to ACT5. As ACT5, the processor 231 obtains the terminal status STa of the self-POS terminal 11 with terminal number n from the display control device 13. The "n" in terminal number n is the count value of the summation counter n. As ACT6, the processor 231 writes the terminal status STa of the self-POS terminal 11 obtained from the display control device 13 to the second column Cb of the judgment table 80 corresponding to terminal number n.

[0060] After completing ACT5 and ACT6, processor 231 proceeds to ACT7. As ACT7, processor 231 selects the first camera 21 installed for the self-service POS terminal 11 with terminal number n. Then, as ACT8, processor 231 acquires and analyzes the image data CIa captured by the selected first camera 21. As ACT9, processor 231 checks whether or not a person is detected in the image data CIa.

[0061] If no person is detected, processor 231 proceeds to ACT10. Processor 231 sets the person status STb to "0" for ACT10. Conversely, if a person is detected, processor 231 proceeds to ACT11. Processor 231 sets the person status STb to "1" for ACT11.

[0062] After completing the processing of ACT10 or ACT11, the processor 231 proceeds to ACT12. As ACT12, the processor 231 writes the person status STb obtained in the processing of ACT10 or ACT11 to the third column Cc of the judgment table 80, which corresponds to the terminal number n.

[0063] Processor 231, having entered the person status STb into the judgment table 80, proceeds to ACT21 in Figure 8. Processor 231 checks the terminal status STa of terminal number n as ACT21. If terminal status STa is "0", processor 231 proceeds to ACT22. Processor 231 checks the person status STb of terminal number n as ACT22. If person status STb is also "0", processor 231 proceeds to ACT23. Processor 231 sets the availability status STc to "0" as ACT23.

[0064] In contrast, if the terminal status STa is "1" in ACT21, or if the person status STb is "1" in ACT22, the processor 231 proceeds to ACT24. The processor 231 sets the availability status STc to "1" in ACT24.

[0065] After completing the processing of ACT23 or ACT24, the processor 231 proceeds to ACT25. As ACT25, the processor 231 writes the availability status STc obtained during the processing of ACT23 or ACT24 to the column Cc corresponding to the terminal number n in the determination table 80.

[0066] Thus, for self-POS terminals 11 identified by terminal number No. where both terminal status STa and person status STb are "0", the processor 231 sets the availability status STc to "0". In other words, the processor 231 recognizes that the self-POS terminal 11 is available. Conversely, for self-POS terminals 11 identified by terminal number No. where at least one of terminal status STa or person status STb is "1", the processor 231 sets the availability status STc to "1". In other words, the processor 231 recognizes that the self-POS terminal 11 is not available.

[0067] After completing the processing of ACT25, the processor 231 returns to ACT3 in Figure 7. The processor 231 then executes the processing from ACT3 onward in the same manner as described above. Specifically, each time the increment counter n is incremented by "1", the processor 231 obtains the terminal status STa identified by the self-POS terminal 11 with terminal number n and writes it to the judgment table 80. The processor 231 also analyzes the image data CIa from the first camera 21 corresponding to the self-POS terminal 11 with terminal number n to determine whether a person is captured in the image, obtains the person status STb, and writes it to the judgment table 80. The processor 231 then determines the availability status STc based on the relationship between the terminal status STa and the person status STb and writes it to the judgment table 80. The processor 231 repeatedly executes the above processing until the increment counter n exceeds the threshold N.

[0068] In ACT4, once it is confirmed that the addition counter n has exceeded the threshold N, the processor 231 proceeds to ACT31 in Figure 9. In ACT31, the processor 231 searches the judgment table 80 to obtain the number of available status STc that is "0", and sets this number as the initial value of the subtraction counter k. That is, the value of the subtraction counter k is the number of self-POS terminals 11 that are recognized as available based on the relationship between terminal status STa and person status STb.

[0069] Processor 231 determines, as ACT32, whether the subtraction counter k is greater than "0". If the subtraction counter k is "0", that is, if the number of self-service POS terminals 11 recognized as available is 0, processor 231 skips the processing of ACT33 to ACT40 and proceeds to ACT41. As ACT41, processor 231 generates image data MIa indicating that there are no available self-service POS terminals 11 and outputs it to monitor 30.

[0070] In response to this, in ACT32, if the subtraction counter k is greater than "0", that is, if it is recognized that one or more self-service POS terminals 11 are available, the processor 231 proceeds to ACT33. In ACT33, the processor 231 acquires and analyzes the image data CIb from the second camera 22. In ACT34, the processor 231 checks whether or not a person is detected from the image data CIb, that is, whether or not there are customers waiting to pay in the waiting space Q.

[0071] If no person is detected from the image data CIb, i.e., if there are no customers waiting to pay in the waiting space Q, the processor 231 proceeds to ACT35. As ACT35, the processor 231 generates image data MIb, which is a list that can identify available and unavailable self-POS terminals 11, and outputs it to the monitor 30.

[0072] On the other hand, if a person is detected from the image data CIb in ACT34, that is, if there is a customer waiting to pay in the waiting space Q, the processor 231 proceeds to ACT36. For ACT36, the processor 231 selects terminal number No.X where the availability status STc is "0" and the guidance flag F is "0". For ACT37, the processor 231 creates image data MIc to guide the customer waiting to pay to the self-service POS terminal 11 identified by terminal number No.X, and outputs it to the monitor 30.

[0073] Subsequently, processor 231 sets the guidance flag F corresponding to terminal number No.X in the determination table 80 to "1" as ACT38. Processor 231 also counts down the subtraction counter k by "1" as ACT39. Then, processor 231 checks as ACT40 whether the subtraction counter k has become "0".

[0074] If the subtraction counter k is greater than "0", the processor 231 returns to ACT33. The processor 231 then executes the processing from ACT33 onward in the same manner as described above. That is, the processor 231 checks from the image data CIb of the second camera 22 whether there are customers waiting to pay in the waiting space Q. If there are customers waiting to pay, it selects terminal number No.X whose availability status STc is "0" and guidance flag F is "0", and outputs image data MIc to the monitor 30 to guide the customer waiting to pay to the self-service POS terminal 11 identified by terminal number No.X.

[0075] Processor 231 repeatedly executes the processes of ACT33 to ACT40 until it is confirmed that there are no customers waiting to pay in waiting space Q or until the subtraction counter k becomes "0". If it is determined in ACT34 that there are no customers waiting to pay in waiting space Q before the subtraction counter k becomes "0", processor 231 proceeds to ACT35. That is, processor 231 generates image data MIb of a list that can identify available self-POS terminals 11 and occupied self-POS terminals 11, and outputs it to monitor 30.

[0076] On the other hand, if there are customers waiting to pay in the waiting space Q and the subtraction counter k becomes "0", the processor 231 proceeds to ACT41. That is, the processor 231 generates image data MIa indicating that there are no available self-service POS terminals 11 and outputs it to the monitor 30.

[0077] When the processor 231 outputs image data MIb or image data MIc to the monitor 30 in ACT35, it temporarily terminates the information processing procedure shown in the flowcharts in Figures 7 to 9. After that, the processor 231 resumes the information processing procedure shown in the flowcharts in Figures 7 to 9 from ACT1.

[0078] Here, the processor 231 realizes the function of an acquisition means 71 by executing the processing of ACT3 to ACT6. The processor 231 realizes the function of a detection means 72 by executing the processing of ACT7 to ACT12. The processor 231 realizes the function of a recognition means 73 by executing the processing of ACT21 to ACT25. The processor 231 realizes the function of a confirmation means 74 by executing the processing of ACT33 and ACT34. The processor 231 realizes the function of a guidance means 75 by executing the processing of ACT35 to ACT41.

[0079] Figure 10 shows an example of an image 31 displayed on the monitor 30 based on image data MIa. In this way, the monitor 30, upon receiving the image data MIa, displays information indicating that there are no available self-service POS terminals 11. Therefore, customers can learn from the information on the monitor 30 that there are no available self-service POS terminals 11.

[0080] Figure 11 shows an example of an image 32 displayed on the monitor 30 based on the image data MIb. In this way, the monitor 30, upon receiving the image data MIb, displays a list that can identify which self-service POS terminals 11 are available and which are not. Therefore, customers near the waiting space Q can easily find out from the information on the monitor 30 how many self-service POS terminals 11 are currently available or unavailable.

[0081] Figure 12 shows an example of an image 33 displayed on the monitor 30 based on the image data MIc. In this way, the monitor 30, upon receiving the image data MIc, displays information guiding customers waiting to pay at one of the available self-service POS terminals 11. Therefore, the first customer in line in the waiting space Q should use the information on the monitor 30 to proceed to the location of the self-service POS terminal 11 with the specified terminal number in the checkout space P and complete the payment.

[0082] [Explanation of the operation of the monitoring device] As detailed above, the monitoring device 23 has the functions of an acquisition means 71, a detection means 72, and a recognition means 73. Through these functions, the monitoring device 23 recognizes a self-POS terminal 11 that is idle and has no person in the operation area R as available, and recognizes a self-POS terminal 11 that is operational or has a person in the operation area R as unavailable. Therefore, for example, even if the payer temporarily leaves the self-POS terminal 11 in the middle of an accounting operation, the terminal status STa of the self-POS terminal 11 will be "1", indicating an operational state, so the monitoring device 23 will not mistakenly recognize the self-POS terminal 11 as available. Thus, it is possible to provide a monitoring device 23 that can accurately monitor the availability status of the self-POS terminal 11.

[0083] Furthermore, the monitoring device 23 also functions as a guidance means 75. This function allows the monitoring device 23 to use the monitor 30 located in the waiting space Q to guide customers waiting to pay to an available self-service POS terminal 11. Therefore, customers waiting to pay can enter the checkout space P according to the information displayed on the monitor 30, and pay for their purchases by operating an available self-service POS terminal 11 themselves.

[0084] Furthermore, the monitoring device 23 also functions as a confirmation means 74, and provides different information depending on whether or not there is a customer in the waiting space Q. Specifically, if there is no customer in the waiting space Q, the monitoring device 23 displays an image 32 as shown in Figure 11 on the monitor 30, and if there is a customer in the waiting space Q, it displays an image 33 as shown in Figure 12 on the monitor 30. If there are no available self-service POS terminals 11, the monitoring device 23 displays an image 31 as shown in Figure 10 on the monitor 30, regardless of whether or not there is a customer in the waiting space Q.

[0085] Therefore, customers waiting in line in waiting space Q can recognize that there are no available self-service POS terminals 11 when image 31 is displayed on monitor 30. Subsequently, when one self-service POS terminal 11 becomes available, the image on monitor 30 transitions from image 31 to image 33. Therefore, the customer who was at the front of the line in waiting space Q can know that the self-service POS terminal 11 shown in image 33 has become available. The customer can then enter the operation area R of the self-service POS terminal 11 shown in image 33 and complete the payment for their purchased items.

[0086] At this time, if another self-service POS terminal 11 also becomes available almost simultaneously, the image displayed on the monitor 30 will differ depending on whether or not there are customers in the waiting space Q. Specifically, if there are customers, an image 33 guiding the customer to the available self-service POS terminal 11 will be displayed on the monitor 30. Conversely, if there are no customers in the waiting space Q, an image 32 will be displayed on the monitor 30. Therefore, if there are customers in the waiting space Q, the image 33 guiding them to an available self-service POS terminal 11 can be displayed to them as well. On the other hand, if there are customers in the waiting space Q, a list that distinguishes between available and unavailable self-service POS terminals 11 can be displayed on the monitor 30.

[0087] <Second Embodiment> Next, a second embodiment in which some functions are added to the monitoring device 23 will be described using Figures 13 and 14.

[0088] Figure 13 is a schematic diagram showing the main functional configuration of the processor 231 of the monitoring device 23 in the second embodiment. In addition to the acquisition means 71, detection means 72, recognition means 73, confirmation means 74, and guidance means 75 similar to those in the first embodiment, the processor 231 also has the function of an output means 76.

[0089] The output means 76 has the function of outputting the recognition result from the recognition means 73. Specifically, the output means 76 outputs a first warning light control signal to the self-POS terminal 11 that the recognition means 73 has recognized as available. The output means 76 outputs a second warning light control signal to the self-POS terminal 11 that the recognition means 73 has recognized as available. The first warning light control signal is, for example, a signal to turn the warning light 65 green or make it flash. The second warning light control signal is, for example, a signal to turn the warning light 65 red or make it flash.

[0090] Figure 14 is a flowchart showing the main steps of information processing performed by the processor 231 in accordance with the terminal monitoring program in the second embodiment. Figure 14 corresponds to the processing procedure described using Figure 8 in the first embodiment. That is, in the second embodiment, the procedure after the processing of ACT25 in Figure 8 is different from that of the first embodiment. The processing of ACT1 to ACT12 in Figure 7, the processing of ACT21 to ACT25 in Figure 8, and the processing of ACT31 to ACT41 in Figure 9 are the same in the second embodiment, so their explanation is omitted here.

[0091] In ACT12 of Figure 7, the processor 231, which has entered the person status STb into the determination table 80, proceeds to ACT21 of Figure 14. Then, as ACT21 to ACT25, the processor 231 executes the same process as ACT21 to ACT25 explained using Figure 8. That is, for each self-POS terminal 11 identified by terminal number No., the processor 231 checks the terminal status STa and person status STb entered into the determination table 80. The processor 231 then recognizes that self-POS terminals 11 identified by terminal number No. where both terminal status STa and person status STb are "0" are available. The processor 231 enters "0" as the availability status STc into the determination table 80. Conversely, the processor 231 recognizes that self-POS terminals 11 identified by terminal number No. where at least one of terminal status STa or person status STb is "1" are not available. The processor 231 writes "1" as the availability status STc in the determination table 80.

[0092] Thus, when the processor 231 sets the availability status STc of the self-service POS terminal 11 identified by terminal number No.X to "0" or "1", it proceeds to ACT51 in Figure 14. The processor 231 checks whether the availability status STc of the self-service POS terminal 11 identified by terminal number No.X is "0" or not as ACT51.

[0093] If the availability status STc is "0", the processor 231 proceeds to ACT52. As ACT52, the processor 231 outputs a first warning light control signal (first control signal) to the self-POS terminal 11 identified by terminal number No.X. Conversely, if the availability status STc is "1", the processor 231 proceeds to ACT53. As ACT53, the processor 231 outputs a second warning light control signal (second control signal) to the self-POS terminal 11 identified by terminal number No.X.

[0094] The processor 231, having output the first or second warning light control signal, returns to ACT3 in Figure 7. The processor 231 then executes the processing from ACT3 onward in the same manner as described above.

[0095] Here, the processor 231 realizes its function as an output means 76 by executing the processing of ACT51 to ACT53.

[0096] In this second embodiment, the first warning light control signal is output by the output means 76 to a self-service POS terminal 11 that is recognized as available by the recognition means 73. As a result, the warning light 65 on the self-service POS terminal 11 lights up or flashes green. On the other hand, the second warning light control signal is output by the output means 76 to a self-service POS terminal 11 that is recognized as available by the recognition means 73. As a result, the warning light 65 on the self-service POS terminal 11 lights up or flashes red.

[0097] Therefore, according to the second embodiment, the payer and the store staff can easily identify whether a self-POS terminal 11 is available or not by the color of the warning light emitted by each self-POS terminal 11.

[0098] [Other embodiments] In the second embodiment, the output means 76 is shown as outputting the recognition result from the recognition means 73 as a warning light control signal to the self-service POS terminal 11. In another embodiment, the output means 76 outputs image data of an icon indicating the recognition result to the attendant terminal 14. By doing so, the attendant can easily distinguish between available and unavailable self-service POS terminals 11 from the icons displayed on the attendant terminal 14's display.

[0099] In each of the embodiments described above, a self-service POS terminal 11 was given as an example of a payment terminal monitored by the monitoring device 23. Some store systems have separate terminals for product registration and payment. For example, some systems allow customers to register products themselves using a smartphone they carry or a tablet terminal attached to their shopping cart, and after registering their purchased items, they operate a dedicated payment terminal to pay for the purchased items. Other store systems allow store staff to register purchased items using a dedicated registration machine, while customers make payments themselves using a dedicated payment terminal. The monitoring device of this embodiment can also be applied to payment terminals in such store systems.

[0100] In the above embodiment, an example was given in which the display control device 13 acquires the terminal status STa from each self-service POS terminal 11 and provides it to the monitoring device 23. In this regard, the attendant terminal 14 may acquire the terminal status STa from each self-service POS terminal 11 and provide it to the monitoring device 23. Alternatively, the monitoring device 23 may directly acquire the terminal status STa from each self-service POS terminal 11.

[0101] In each of the above embodiments, the first camera 21 is provided in a one-to-one correspondence with the self-service POS terminal 11. However, it is not necessary to provide the first camera 21 in a one-to-one correspondence with the self-service POS terminal 11. For example, one first camera may be capable of photographing two adjacent self-service POS terminals 11, and it may be possible to determine from the images captured by the first camera 21 whether a person is in the operating area R of one of the self-service POS terminals 11, or whether a person is in the operating area R of both self-service POS terminals 11.

[0102] Furthermore, it is possible to detect a person in the operating area R without using the image captured by the first camera 21. For example, a person in the operating area R can be detected by using a human presence sensor such as an infrared sensor or a weight sensor. The same applies to the second camera 22, which detects a person in the standby space Q. In other words, a person in the standby space Q can be detected by using a human presence sensor or a weight sensor instead of the second camera 22.

[0103] <Third Embodiment> [Output of accounting guidance information by accounting method] The terminal monitoring system 200 is an example of an information processing system, the monitoring device 23 is an example of an information processing server, the self-service POS terminal 11 is an example of an accounting machine, and the sub-monitor 30S is an example of an information output device. In the third embodiment, an example of the output of accounting guidance information by the monitoring device 23 of the terminal monitoring system 200 will be described. The third embodiment will be implemented by combining the first or second embodiment as appropriate, and the basic hardware configuration of the third embodiment is as shown in Figures 1, 2, and 4, and a detailed explanation will be omitted.

[0104] The self-service POS system 100 is equipped with multiple self-service POS terminals 11 of different models. There are various models of self-service POS terminals 11 for different accounting methods, including self-service POS terminals 11 that support a single accounting method, and self-service POS terminals 11 that support two or more accounting methods.

[0105] The following models exist for the self-service POS terminal 11. • Self-service POS terminals 11AX, 11BX, and 11CX that support product registration at checkout: Product registration at checkout is the process of registering products by reading product codes and other information from products using a scanner or similar device during checkout at the POS terminal 11. For example, the self-service POS terminal 11AX supports product registration at checkout and cash payments. The self-service POS terminal 11BX supports product registration at checkout and cashless payments. The self-service POS terminal 11CX supports product registration at checkout, cash payments, and cashless payments. • Self-service POS terminals 11AY, 11BY, and 11CY that support pre-checkout product registration: Pre-checkout product registration is the process of registering products before payment at the POS terminal 11 by reading product codes, etc., from products using a communication terminal attached to the cart, a communication terminal placed in the store, or the customer's communication terminal. Pre-checkout product registration may also be referred to as using a communication terminal such as a cart. For example, the self-service POS terminal 11AY supports pre-checkout product registration and cash payment. The self-service POS terminal 11BY supports pre-checkout product registration and cashless payment. The self-service POS terminal 11CY supports pre-checkout product registration, cash payment, and cashless payment. These self-service POS terminals 11AY, 11BY, and 11CY are examples of payment-only terminals. • Self-service POS terminal 11CZ that supports product registration at checkout and product registration before checkout: The 11CZ self-service POS terminal supports product registration and cash / cashless payment at checkout, as well as product registration and cash / cashless payment before checkout.

[0106] Businesses intending to install a checkout space with a mix of models will select and install two or more models from the various models described above. Furthermore, the models of the self-service POS terminal 11 applicable to the third embodiment are not limited to those described above.

[0107] Figure 15 is a schematic diagram showing the main functional configuration of the processor 231 of the monitoring device 23.

[0108] The processor 231 includes a detection unit 2312, a selection unit 2313, a generation unit 2314, and an output unit 2315.

[0109] The detection unit 2312 detects the type of each column in the image data and the order in which the users are arranged, based on column management information that assigns a type to each column in the image data input by the second camera interface 237. Note that "user" may be read as "customer".

[0110] The selection unit 2313 selects a self-service POS terminal 11 corresponding to the type of a predetermined row where predetermined users are lined up in a predetermined order, based on terminal management information that manages the identification information, type, priority, and availability of each self-service POS terminal 11. The selection unit 2313 also selects a sub-monitor 30S corresponding to a predetermined row, based on guidance management information that manages multiple sub-monitors 30S installed in each row.

[0111] The generation unit 2314 generates accounting guidance information to guide the selected self-service POS terminal 11. For example, the accounting guidance information includes identification information of the selected self-service POS terminal 11.

[0112] The output unit 2315 outputs the generated accounting information.

[0113] Figure 16 shows an example of column management information.

[0114] The main memory 232 or auxiliary storage device 233 stores column management information. Column management information is information for identifying the type corresponding to each column included in the image data. Column management information includes partition area information that identifies partition areas, column identification information that identifies columns, and type information according to the accounting method. The detection unit 2312 detects multiple partition areas from the image areas included in the image data based on the partition area information. The detection unit 2312 detects columns from each partition area through image recognition processing, identifies columns based on the column identification information, and identifies the type corresponding to the column based on the type information.

[0115] For example, the second camera 22 captures an area that includes each row where users are lined up according to their payment method. The second camera interface 237 receives image data from the second camera 22. The image area included in the image data contains each row where users are lined up according to their payment method. For example, if there are three rows of users lined up according to three payment methods—cash payment, cashless payment, and pre-payment product registration—coordinate values ​​specifying the three division areas are set as division area information so that each row is included in one division area. For example, an attendant sets the coordinate values ​​specifying the three division areas as division area information while looking at the image from the second camera 22.

[0116] The detection unit 2312 detects three segmented regions from the image region included in the image data based on segmented region information, identifies three columns included in each of the three segmented regions based on column identification information, and identifies the first column as cash payment, the second column as cashless payment, and the third column as pre-payment product registration based on type information.

[0117] Alternatively, a second camera 22 may be installed for each column, and the column management information may be managed by associating the second camera 22 with the type of transaction. For example, the column management information may associate the second camera 22 (image data from it) installed for the first column with cash payments, the second camera 22 (image data from it) installed for the second column with cashless payments, and the second camera 22 (image data from it) installed for the third column with pre-payment product registration.

[0118] Figure 17 shows an example of terminal management information.

[0119] The main memory 232 or auxiliary storage device 233 stores terminal management information. The terminal management information includes POS terminal identification information, type, priority, and availability status for each self-service POS terminal 11. The POS terminal identification information is an identification number unique to each self-service POS terminal 11. The type is a type indicating the accounting method, etc. The priority is the rank assigned according to the accounting method. The availability status indicates whether the self-service POS terminal 11 is available or not. Whether the self-service POS terminal 11 is available or not is detected by the method described in the first and second embodiments.

[0120] Figure 18 shows an example of output management information.

[0121] The main memory 232 or auxiliary storage device 233 stores output management information. For example, multiple sub-monitors 30S are installed corresponding to each column. The output management information manages the output of information to these sub-monitors 30S. The output management information includes a combination of monitor identification information that identifies the sub-monitors 30S and column identification information that identifies the column. For example, based on the output management information, a sub-monitor 30S installed corresponding to a predetermined column is selected as the output destination for information for a predetermined column.

[0122] Alternatively, one sub-monitor 30S may be installed for each column, and the display area of ​​one sub-monitor 30S may be divided into multiple partitioned display areas, with the sub-monitor 30S displaying information corresponding to each column in each partitioned display area. In this case, the output management information manages the information displayed in each partitioned display area. By replacing the monitor identification information shown in Figure 18 with partitioned display area identification information, the output management information can be used to associate partitioned display areas with columns, and the information displayed in the partitioned display areas can be managed.

[0123] Figure 19 is a flowchart showing an example of accounting guidance information output by the monitoring device 23.

[0124] As shown in Figure 19, the second camera interface 237 of the monitoring device 23 receives image data from the second camera 22. The second camera interface 237 is an example of an input interface. The second camera 22 captures areas including each lane where users line up according to their payment method.

[0125] The detection unit 2312 detects the type of each column in the image data and the order in which the users are arranged, based on column management information that assigns a type to each column in the image data input by the second camera interface 237 (ACT101).

[0126] The selection unit 2313 selects a self-service POS terminal 11 that corresponds to the type of a predetermined row where predetermined users are lined up in a predetermined order, based on terminal management information that manages the identification information, type, priority, and availability of each self-service POS terminal 11 (ACT102).

[0127] The generation unit 2314 generates accounting guidance information to guide the user to a selected predetermined self-service POS terminal 11 (ACT103). The accounting guidance information includes POS terminal identification information of the selected self-service POS terminal 11.

[0128] The output unit 2315 outputs the generated accounting guidance information (ACT104).

[0129] For example, if the selection unit 2313 determines that the predetermined queue for the first-ranked predetermined user (for example, the first predetermined user to queue across all queues) corresponds to a cash payment type, it selects the self-service POS terminal 11 with the highest priority among the available cash payment type machines. The generation unit 2314 generates accounting guidance information to guide the user to the selected self-service POS terminal 11. The selection unit 2131 also selects a sub-monitor 30S corresponding to the predetermined queue based on the output management information. The monitor interface 238 outputs a video signal related to the accounting guidance information to the sub-monitor 30S corresponding to the predetermined queue. The monitor interface 238 is an example of an output interface.

[0130] Furthermore, the selection unit 2313 selects the self-service POS terminal 11 with the highest priority among the available cashless payment machines of the type that accepts cashless payments if the predetermined queue of a predetermined user in the first queue corresponds to a cashless payment type. The generation unit 2314 generates accounting guidance information to guide the user to the selected self-service POS terminal 11. The selection unit 2131 also selects a sub-monitor 30S corresponding to the predetermined queue based on the output management information. The monitor interface 238 outputs a video signal related to the accounting guidance information to the sub-monitor 30S corresponding to the predetermined queue.

[0131] Furthermore, the selection unit 2313 selects the highest priority self-POS terminal 11 among the available accounting machines of the type corresponding to the first sorting order of a predetermined user if the predetermined row corresponds to the type of product registration at checkout. The generation unit 2314 generates accounting guidance information to guide the user to the selected self-POS terminal 11. The selection unit 2131 also selects a sub-monitor 30S corresponding to the predetermined row based on the output management information. The monitor interface 238 outputs a video signal related to the accounting guidance information to the sub-monitor 30S corresponding to the predetermined row.

[0132] Furthermore, the selection unit 2313 selects the highest priority self-POS terminal 11 among the available accounting machines of the type corresponding to the pre-payment product registration if the predetermined row of a predetermined user in the first sorting order corresponds to the type of pre-payment product registration. The generation unit 2314 generates accounting guidance information to guide the user to the selected self-POS terminal 11. The selection unit 2131 also selects a sub-monitor 30S corresponding to the predetermined row based on the output management information. The monitor interface 238 outputs a video signal related to the accounting guidance information to the sub-monitor 30S corresponding to the predetermined row.

[0133] The input interface 301 of the sub-monitor 30S receives video signals related to accounting guidance information, and the display 302 displays the accounting guidance information based on the video signals.

[0134] Figures 20 to 25 are transition diagrams illustrating the arrangement of lines and guidance to self-service POS terminals. Figures 20 to 25 assume a scenario where customers line up in three lines, each representing one of three payment methods: cash payment, cashless payment, and pre-payment product registration. Customers lined up in the three lines move sequentially to the self-service POS terminal 11 according to the payment guidance information displayed on the sub-monitor 30S. As customers move, the arrangement of the lines transitions as shown in Figures 20 to 25.

[0135] As shown in Figure 20, the detection unit 2312 detects the type of each column and the order in which users are lined up in the image data based on the column management information. For example, the detection unit 2312 detects, from left to right, the first column for cash payment, the second column for cashless payment, and the third column for pre-payment product registration. The detection unit 2312 also detects the first rank W1 to the ninth rank W9. The first rank W1 indicates that the user was the first to line up for payment across all three columns. The ninth rank W9 indicates that the user was the last to line up for payment across all three columns.

[0136] For example, the detection unit 2312 detects the first rank W1, the fifth rank W5, and the ninth rank W9 in order from the beginning of the first column for cash payments. The detection unit 2312 also detects the second rank W2, the sixth rank W6, and the eighth rank W8 in order from the beginning of the second column for cashless payments. The detection unit 2312 also detects the third rank W3, the fourth rank W4, and the seventh rank W7 in order from the beginning of the third column for pre-accounting product registration.

[0137] Furthermore, the self-service POS terminals 11 are referred to as registers R1 through R6. The terminal identification information, type, priority, and availability of registers R1 through R6 are managed by the terminal management information. For example, registers R1, R2, and R4 support product registration at checkout and cashless payment. Registers R3, R5, and R6 support product registration at checkout, cash payment, and cashless payment, as well as product registration before checkout, cash payment, and cashless payment.

[0138] Furthermore, under the conditions of product registration at checkout and cash payment, register R3 is assigned the first priority P1, register R6 the second priority P2, and register R5 the third priority P3. Under the conditions of product registration at checkout and cashless payment, register R1 is assigned the first priority P1, register R2 the second priority P2, register R5 the third priority P3, register R3 the fourth priority P4, register R4 the fifth priority P5, and register R6 the sixth priority P. Under the conditions of product registration before checkout and cash payment and cashless payment, register R5 is assigned the first priority P1, register R3 the second priority P2, and register R6 the third priority P3.

[0139] The selection unit 2313 selects a self-service POS terminal 11 corresponding to the type of a predetermined column where predetermined users of a predetermined ranking are lined up, based on terminal management information. For example, the selection unit 2313 selects registers R3, R5, and R6 corresponding to the type of cash payment in the first column where users with the first ranking W1 are lined up. Furthermore, the selection unit 2313 selects the available registers R3, R5, and R6 from the selected registers, and then selects the register with the highest priority from the selected registers, R3.

[0140] The generation unit 2314 generates accounting guidance information to guide customers to the selected register R3. The accounting guidance information includes the POS terminal identification information (e.g., terminal number) of the selected register R3. The accounting guidance information may also be information to guide customers waiting in line to the register where they should be processed, or information for store staff to guide customers waiting in line. The accounting guidance information may include a layout of multiple registers, and the layout may include the POS terminal identification information of the selected register R3. The selection unit 2131 selects a sub-monitor 30S corresponding to the first column based on the output management information.

[0141] The output unit 2315 outputs the generated accounting information to the sub-monitor 30S corresponding to the first column. The sub-monitor 30S corresponding to the first column displays the accounting information.

[0142] The user with the highest priority, W1, proceeds to register R3 following the instructions to register R3 included in the accounting guidance information displayed on sub-monitor 30S, and completes the accounting process at register R3. The order of the columns transitions from Figure 20 to Figure 21.

[0143] Next, as shown in Figure 21, the selection unit 2313 selects registers R1 to R6 corresponding to the types of cashless payments in the second column where the second-ranked W2 users are lined up. Furthermore, the selection unit 2313 selects an available register from among the selected registers R1 to R6, and then selects the register with the highest priority from among the selected registers, R1.

[0144] The generation unit 2314 generates accounting guidance information to guide the user to the selected register R1. The selection unit 2131 selects the sub-monitor 30S corresponding to the second column based on the output management information.

[0145] The output unit 2315 outputs the generated accounting information to the sub-monitor 30S corresponding to the second column. The sub-monitor 30S corresponding to the second column displays the accounting information.

[0146] The user in the second-highest priority group, W2, proceeds to register R1 following the instructions to register R1 included in the accounting guidance information displayed on sub-monitor 30S, and completes the accounting process at register R1. The order of the columns transitions from Figure 21 to Figure 22.

[0147] Next, as shown in Figure 22, the selection unit 2313 selects registers R3, R5, and R6 that correspond to the types of pre-checkout product registrations where the third-ranked user W3 is located. Furthermore, the selection unit 2313 selects available registers R5 through R6 from the selected registers, and then selects register R5, which has the highest priority among the selected registers.

[0148] The generation unit 2314 generates accounting guidance information to guide the user to the selected register R5. The selection unit 2131 selects the sub-monitor 30S corresponding to the third column based on the output management information.

[0149] The output unit 2315 outputs the generated accounting information to the sub-monitor 30S corresponding to the third column. The sub-monitor 30S corresponding to the third column displays the accounting information.

[0150] The third-ranked user, W3, proceeds to register R5 following the instructions displayed in the accounting guidance information on sub-monitor 30S, and completes the accounting process at register R5. The order of the columns transitions from Figure 22 to Figure 23.

[0151] Next, as shown in Figure 23, the selection unit 2313 selects registers R3, R5, and R6, which correspond to the types of pre-checkout product registrations in the third column where the fourth-ranked user W4 is located. Furthermore, the selection unit 2313 selects the available register R6 from the selected registers. In this case, since there is only one available register, priority is not considered.

[0152] The generation unit 2314 generates accounting guidance information to guide the user to the selected register R6. The selection unit 2131 selects the sub-monitor 30S corresponding to the third column based on the output management information.

[0153] The output unit 2315 outputs the generated accounting information to the sub-monitor 30S corresponding to the third column. The sub-monitor 30S corresponding to the third column displays the accounting information.

[0154] The user in the fourth rank, W4, proceeds to register R6 following the instructions to register R6 included in the accounting guidance information displayed on sub-monitor 30S, and completes the accounting process at register R6. The order of the columns transitions from Figure 23 to Figure 24.

[0155] Next, as shown in Figure 24, the selection unit 2313 selects registers R3, R5, and R6 corresponding to the types of cash payments in the first column where users with the fifth priority W5 are lined up. However, there are no available registers among the selected registers R3, R5, and R6. Therefore, the selection unit 2313 selects registers R1 to R6 corresponding to the types of cashless payments in the second column where users with the sixth priority W6 are lined up. Furthermore, the selection unit 2313 selects the available registers R2 and R4 from the selected registers, and then selects the register with the highest priority, R2, from the selected registers.

[0156] The generation unit 2314 generates accounting guidance information to guide the selected register R2. The selection unit 2131 selects the sub-monitor 30S corresponding to the second column based on the output management information.

[0157] The output unit 2315 outputs the generated accounting information to the sub-monitor 30S corresponding to the second column. The sub-monitor 30S corresponding to the second column displays the accounting information.

[0158] The user in sixth place, W6, proceeds to register R1 following the instructions to register R1 included in the accounting guidance information displayed on sub-monitor 30S, and completes the accounting process at register R1. The order of the columns transitions from Figure 24 to Figure 25.

[0159] Next, as shown in Figure 25, the selection unit 2313 selects registers R3, R5, and R6 corresponding to the types of pre-payment product registrations in the third column where the 7th ranked user W7 is located. However, there are no available registers among the selected registers R3, R5, and R6. Therefore, the selection unit 2313 selects registers R1 to R6 corresponding to the types of cashless payments in the second column where the 8th ranked user W8 is located. Furthermore, the selection unit 2313 selects R4, which is available, from among the selected registers.

[0160] The generation unit 2314 generates accounting guidance information to guide the user to the selected register R4. The selection unit 2131 selects the sub-monitor 30S corresponding to the second column based on the output management information.

[0161] The output unit 2315 outputs the generated accounting information to the sub-monitor 30S corresponding to the second column. The sub-monitor 30S corresponding to the second column displays the accounting information.

[0162] The user in the 8th position, W8, will proceed to register R4 following the instructions to register R1 included in the accounting guidance information displayed on sub-monitor 30S, and will complete the accounting process at register R4.

[0163] In addition to the registers R1 through R6 described above, a register R7 may be added that supports pre-payment product registration and cash and cashless payments, but does not support product registration at checkout. Such a register R7 is an example of a payment-only terminal. The selection unit 2312 prioritizes selecting register R7 for users in the third line. If register R7 is not available, the selection unit 2312 selects registers R3, R5, and R6, which have lower priority than register R7. Register R7, a payment-only terminal, is assigned to users who register products before checkout, but not to users who register products at checkout. Therefore, it is possible to efficiently handle users who register products before checkout, contributing to a reduction in checkout waiting times.

[0164] In the above explanation, we described a case where accounting guidance information is output to the user, but it is also possible to output accounting guidance information to the store staff. In this case, the monitoring and control device 23 changes the output destination of the accounting guidance information from the sub-monitor 30S to the attendant terminal 14 and outputs the accounting guidance information to the attendant terminal 14.

[0165] The monitor of the attendant terminal 14 includes a section area corresponding to each queue, and instead of a sub-monitor 30S installed for each queue, the section area corresponding to each queue displays accounting guidance information. For example, the first section area corresponding to the first queue includes accounting guidance information for the customers in the first queue, and the staff member looks at the accounting guidance information in the first section area and guides the customers in the first queue to the designated self-service POS terminal 11. In this way, the monitoring and control device 23 can output accounting guidance information for staff members and support staff members in guiding customers to the self-service POS terminal 11.

[0166] The third embodiment is summarized below. (1) The monitoring device 23, which is an information processing server, detects the type of each column and the order in which users are lined up in the image data based on the column management information. The monitoring device 23 also selects a predetermined self-service POS terminal 11 that corresponds to the type of column in which predetermined users are lined up in a predetermined order, based on the accounting machine management information. The monitoring device 23 also generates accounting guidance information to guide users to the predetermined self-service POS terminal 11. The monitoring device 23 also outputs the generated accounting guidance information to the monitor 30, etc.

[0167] The accounting guidance information is generated based on accounting machine management information that manages the type, priority, and availability of each self-service POS terminal 11, and can output accounting guidance information that contributes to improving the operational efficiency of multiple self-service POS terminals 11.

[0168] (2) If the designated queue of a designated user in the first queue corresponds to a type of cash payment, the monitoring device 23 selects the designated self-POS terminal 11 with the highest priority among the available self-POS terminals 11 that accept cash payments. Also, if the designated queue of a designated user in the first queue corresponds to a type of cashless payment, the monitoring device 23 selects the designated self-POS terminal 11 with the highest priority among the available self-POS terminals 11 that accept cashless payments.

[0169] This allows the system to guide the designated user to a self-service POS terminal 11 that is suitable for the payment method (cash payment or cashless payment) of the designated user in the first position in the queue.

[0170] (3) If the predetermined queue of a predetermined user in the first queue corresponds to the type of product registration at checkout, the monitoring device 23 selects the predetermined self-POS terminal 11 with the highest priority from among the available self-POS terminals 11 of the type corresponding to product registration at checkout. Also, if the predetermined queue of a predetermined user in the first queue corresponds to the type of product registration before checkout, the monitoring device 23 selects the predetermined self-POS terminal 11 with the highest priority from among the available cashier machines of the type corresponding to product registration before checkout.

[0171] This allows the system to guide the designated user to a self-service POS terminal 11 that is suitable for the designated user's accounting method (product registration at checkout or product registration before checkout) in the first position in the queue.

[0172] (4) The monitoring device 23 selects a predetermined sub-monitor 30S corresponding to a predetermined column based on output management information that manages multiple sub-monitors 30S installed in relation to each row, and outputs accounting guidance information to the predetermined sub-monitor 30S. The accounting guidance information includes identification information of a predetermined self-service POS terminal 11.

[0173] As a result, users queuing in a designated line can see the identification information of a designated self-service POS terminal 11 (the terminal number of the designated self-service POS terminal 11) included in the accounting guidance information displayed on a designated sub-monitor 30S installed in the designated line, and smoothly perform accounting operations at the designated self-service POS terminal 11.

[0174] The program according to this embodiment may be transferred while stored in an electronic device constituting an information processing system, or it may be transferred without being stored in an electronic device. In the latter case, the program may be transferred via a network, or it may be transferred while stored in a storage medium. The storage medium is a non-temporary tangible medium. The storage medium is a computer-readable medium. The storage medium can be any medium that is capable of storing a program and is readable by a computer, such as an optical disc or memory card, and its form is not limited. The electronic device downloads the program transferred (provided) via a network and installs it into memory, or reads the program from the storage medium and installs it into memory.

[0175] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of Symbols]

[0176] 11… Terminal 12… Server 13…Display control device 14... Attendant terminal 15…Communication Networks 21... Camera 1 22...Second camera 23...Monitoring device 30…Monitor 30M…Main monitor 30S…Sub-monitor 30S…Sub-monitor corresponding to the third row 30S…Sub-monitor corresponding to the second row 30S…Sub-monitor corresponding to the first row 40...Main unit 41…Touch panel 42... Scanner reading window 43...Card slot 44…Receipt dispenser 45... Coin slot 46... Coin Dispensing Slot 47…Banknote slot 48...Banknote dispensing slot 50...Bagging stand 51… Housing 52...Bag holder 53…Holding arm 60...basket stand 61... Communication cable 62… Leader / Writer 63… Stand 64... Display pole 65... Police light 80... Judgment Table 100... System 200… Terminal monitoring system 231… Processor 232... Main memory 233... Auxiliary storage devices 234... Clock 235…Communication Interface 236...First camera interface 237...Second camera interface 238… Monitor Interface 239... System transmission line 301…Input Interface 302…Display 2131...Selection section 2312...Selection section 2312...Detection unit 2313...Selection section 2314...Generation section 2315...and output section 2315...Output section

Claims

1. An input interface that receives image data from a camera that photographs the area including each lane where users line up according to their payment method, Based on the column management information that assigns a type to each column in the image data, the type of each column in the image data and the order in which the users are sorted are detected. A processor that selects a predetermined accounting machine corresponding to the type of a predetermined column where predetermined users are lined up in a predetermined order, based on accounting machine management information that manages the type and availability of each accounting machine, An output interface that outputs accounting guidance information to guide users to the designated accounting machine, An information processing server equipped with the following features.

2. The aforementioned accounting machine management information includes the priority of each accounting machine, The aforementioned processor, If the predetermined queue of the predetermined user in the first sorting order corresponds to the type of cash payment, select the predetermined accounting machine with the highest priority among the available accounting machines that accept cash payments. If the predetermined queue of the predetermined user in the first sorting order corresponds to a type of cashless payment, the predetermined accounting machine with the highest priority among the available accounting machines that accept cashless payments is selected. The information processing server according to claim 1.

3. The aforementioned processor, If the predetermined row of the predetermined user in the first sorting order corresponds to the type of product registration at checkout, then the predetermined accounting machine with the highest priority among the available accounting machines of the type corresponding to the product registration at checkout is selected. If the predetermined row of the predetermined user in the first sorting order corresponds to the type of pre-payment product registration, the predetermined accounting machine with the highest priority among the available accounting machines of the type corresponding to the pre-payment product registration is selected. The information processing server according to claim 1.

4. The aforementioned accounting guidance information includes the identification information of the designated accounting machine, The processor selects a predetermined information output device corresponding to a predetermined column based on output management information that manages a plurality of information output devices installed in each column, The output interface outputs the accounting guidance information to the predetermined information output device. The information processing server according to claim 1.

5. In an information processing system comprising an information processing server and multiple information output devices installed corresponding to each column, The aforementioned information processing server is A first input interface that receives image data from a camera that photographs an area including each line where users line up according to their payment method, Based on the column management information that assigns a type to each column in the image data, the type of each column in the image data and the order in which the users are sorted are detected. A processor that selects a predetermined accounting machine corresponding to the type of a predetermined column where predetermined users are lined up in a predetermined order, based on accounting machine management information that manages the type and availability of each accounting machine, An output interface that outputs accounting guidance information to guide users to the designated accounting machine, Equipped with, The aforementioned accounting guidance information includes the identification information of the designated accounting machine, The processor selects a predetermined information output device corresponding to a predetermined column based on output management information that manages a plurality of information output devices installed in each column, The output interface outputs the accounting guidance information to the predetermined information output device. The predetermined information output device is A second input interface for inputting the aforementioned accounting guidance information, A display that shows the aforementioned accounting information, An information processing system equipped with the following features.

6. On the computer, Based on the column management information included in the image data from the camera, which assigns a category to each column where users are lined up according to their payment method, the category of each column and the order in which users are lined up in the image data are detected. Based on accounting machine management information that manages the type and availability of each accounting machine, the system selects a designated accounting machine corresponding to the type of the designated row in which designated users are lined up in a designated order. To output accounting guidance information to guide the user to the designated accounting machine, A program to execute.

Images