Guidance system, guidance information processing apparatus, and program therefor

Abstract

To properly guide a customer who has not completed payment to a vacant self-serve register terminal in response to degree of congestion of the self-serve register terminal.SOLUTION: A guidance information processing apparatus has recognition means, determination means, and output means. The recognition means recognizes a vacancy state of a plurality of self-serve register terminals. The determination means determines a degree of congestion of the self-serve register terminals based on the recognition result by the recognition means. The output means outputs guidance information to a customer who has not completed payment in a different mode depending on the degree of congestion.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] Embodiments of the present invention relate to a guidance system, a guidance information processing device incorporated in this system, and a program therefor.

Background Art

[0002] In recent years, in mass retailers such as supermarkets, full-self-type accounting machines, so-called self-checkout machines, in which customers themselves perform accounting operations from registration of purchased goods to settlement, have become widespread. Usually, multiple self-checkout machines are installed together in an accounting space secured in a part of the store, and customers enter the accounting space to perform accounting operations. However, depending on the layout of the accounting space, it may be difficult to tell which self-checkout machine is available, and during congestion, there may be a queue of customers waiting for accounting even though there are available self-checkout machines. There is a store employee called an attendant waiting in the accounting space, and the attendant calls out to guide unaccounted customers (unaccounted persons) to an available self-checkout machine. However, when dealing with errors of the self-checkout machine etc., the attendant cannot call out, and this is not a sufficient countermeasure.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the embodiments of the present invention is to provide a guidance information processing device that can appropriately guide unaccounted persons to an available self-terminal according to the congestion level of the self-terminals, and a guidance system including the device.

Means for Solving the Problems

[0005] In one embodiment, the guidance information processing apparatus includes a recognition unit, a determination unit, and an output unit. The recognition unit recognizes the availability status of a plurality of self-service terminals. The determination unit determines the congestion level of the self-service terminals based on the recognition result by the recognition unit. The output unit outputs guidance information for unaccounted customers in different forms according to the congestion level.

Brief Description of the Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Mode for Carrying Out the Invention

[0007] Hereinafter, an embodiment of a guidance system that can appropriately guide unaccounted customers to an available self-service terminal according to the congestion level of the self-service terminal will be described with reference to the drawings. In this embodiment, a full self-type self-checkout machine having a registration function and a checkout function will be described as an example of a self-service terminal. However, the self-service terminal may be, for example, a self-checkout machine that does not have a registration function but only has a checkout function. Alternatively, it may be a self-registration machine that only has a registration function.

[0008] [Explanation of the Configuration of the Store System] FIG. 1 is a configuration diagram of a store system according to an embodiment. The store system is constructed in a mass merchandiser such as a supermarket. The store system includes a self-checkout system 100 and a guidance system 200.

[0009] The self-checkout system 100 includes a plurality of self-checkout machines 10 and a store server 20. The self-checkout system 100 connects each self-checkout machine 10 and the store server 20 via a communication network 30 such as a LAN (Local Area Network). The store server 20 provides various services related to this self-checkout system 100 to each self-checkout machine 10 connected via the communication network 30. Such a self-checkout system 100 can be also referred to as a POS (Point Of Sales) system.

[0010] The plurality of self-checkout machines 10 are each installed in an accounting space separated from the sales floor where the store's products are displayed. The self-checkout machine 10 is operated by a customer who has finished shopping on the sales floor, that is, a non-accounted customer. The customer who has put the purchased goods in a shopping basket or the like and moved from the sales floor to the accounting space performs accounting operations from the registration of the purchased goods to the settlement on the self-checkout machine 10 by themselves. The self-checkout machine 10 is an example of a settlement device. The self-checkout machine 10 can be also referred to as a settlement terminal, an accounting device, an accounting terminal, a product registration device, a product registration terminal, etc.

[0011] The guidance system 200 includes a camera 40 as an imaging device, a camera controller 50, a guidance information server 60, and a guidance device 70. The guidance system 200 provides one camera 40 for each of the plurality of self-checkout machines 10. Although details will be described later, the guidance system 200 mounts each camera 40 at a position where the appearance of the corresponding self-checkout machine 10, particularly the front, can be photographed.

[0012] The camera controller 50 controls the photographing operation of each camera 40. Then, the camera controller 50 captures the image data photographed by each camera 40 and outputs it to the guidance information server 60.

[0013] The guidance information server 60 recognizes the availability of a plurality of self-checkout machines 10 from the images captured by each camera 40, and determines the congestion level of the self-checkout machines 10 based on the recognition result. The congestion level may also be referred to as the congestion level of the accounting space. The guidance information server 60 controls the guidance device 70 so that guidance information for non-accounted customers is output in different forms according to the congestion level. Specifically, when the congestion level is lower than the reference value, the guidance information server 60 controls the guidance device 70 so that the first guidance information that allows non-accounted customers to select an available self-checkout machine 10 is output. When the congestion level is higher than the reference value, the guidance information server 60 controls the guidance device 70 so that the second guidance information that guides non-accounted customers to a specific available self-checkout machine 10 is output. When the congestion level is 100%, that is, when there is no available self-checkout machine 10, the guidance information server 60 controls the guidance device 70 so that the third guidance information or the fourth guidance information that makes non-accounted customers wait in front of the accounting space is output. Details of the first guidance information, the second guidance information, the third guidance information, and the fourth guidance information will be described later.

[0014] The congestion level is set to 100% when all the self-checkout machines 10 are in use, and 0% when all the self-checkout machines 10 are available. Therefore, for example, if the number of self-checkout machines 10 is 10, the congestion level is 90% when only 1 is available, and 80% when 2 are available. The reference value is arbitrary, but it is preferably set to a value at which the self-checkout machines 10 are determined to be congested, for example, a value of 80% or more.

[0015] The guidance device 70 is a device equipped with an output device capable of outputting guidance information under the control of the guidance information server 60. The guidance device 70 includes a display 71 and a speaker 72 as output devices. The display 71 is a display device for a monitor. The guidance device 70, for example, installs the display 71 at the entrance where an unaccounted person enters the accounting space, and arranges the speaker 72 nearby. The guidance device 70 displays an image of the guidance information on the display 71. Further, the guidance device 70 outputs the guidance information as voice from the speaker 72. Note that the output devices implemented by the guidance device 70 are not limited to the display 71 and the speaker 72. The guidance device 70 may be equipped with other output devices. Alternatively, the guidance device 70 may be equipped with only the display 71.

[0016] [Explanation of the positional relationship between the self-checkout machine and the camera] FIG. 2 is a perspective view showing the external configuration of the self-checkout machine 10. The self-checkout machine 10 includes a main body 101, and a first product placement table 102 and a second product placement table 103 arranged on the left and right of the main body 101. The first product placement table 102 arranged on the right side toward the main body 101 is a place for a customer who is an accountant to place the purchased products before registration. The purchased products before registration are usually placed in a shopping basket and placed on the first product placement table 102. The purchased products before registration may be arranged above the first product placement table 102 while being placed in a shopping cart.

[0017] The second product placement table 103 arranged on the left side facing the main body 101 is a place for the accountant to place the purchased products after registration. The purchased products after registration are put into, for example, a container placed on the second product placement table 103, such as a shopping basket, a plastic bag for the cash register, or a personal bag. The purchased products after registration may be directly placed on the second product placement table 103. In FIG. 2, the second product placement table 103 is provided with a temporary placement table 104 via a support column at its upper part. The temporary placement table 104 is, for example, a table for temporarily placing products before putting them into a plastic bag or the like. Two holding arms 105 are provided on the temporary placement table 104 at intervals left and right. The accountant can use these holding arms 105 to place a plastic bag, a personal bag, etc. on the second product placement table 103 in an open state.

[0018] The main body 101 is provided with a touch panel 11, a card reader 12, a printer 13, a scanner 14, a hand scanner 15, a cash processor 16, a speaker 17, a pat lamp 18, etc. as input / output devices.

[0019] The touch panel 11 includes a display as a display device and a touch sensor as an input device. The display displays various screen information such as a settlement start screen, a product registration screen, a payment method selection screen, and an accounting screen. The settlement start screen is a screen for accepting the start of a transaction settlement. A start key for instructing the start of a transaction settlement is arranged on the settlement start screen. The accountant who starts registering the purchased products touches the start key. When the touch sensor detects that the start key has been touched, the controller of the self-checkout machine 10 switches the screen of the display from the settlement start screen to the product registration screen.

[0020] The merchandise registration screen is a screen that displays detailed information such as the name, price, and total amount of the purchased merchandise that has been registered. On the merchandise registration screen, an accounting key for instructing the transition to the payment of the purchased merchandise is arranged. The accountant who has finished registering the purchased merchandise touches the payment key. When the touch sensor detects that the accounting key has been touched, the controller of the self-checkout machine 10 switches the screen of the display from the merchandise registration screen to the payment method selection screen.

[0021] The payment method selection screen is a screen that accepts the selection input of payment methods such as cash payment, credit card payment, and electronic money payment. On the payment method selection screen, a cash key for instructing cash payment, a credit key for instructing credit card payment, an electronic money key for instructing electronic money payment, etc. are arranged. For example, an accountant who wishes to pay in cash touches the cash key. When the touch sensor detects that the cash key has been touched, the controller of the self-checkout machine 10 switches the screen of the display from the payment method selection screen to the accounting screen. The accounting screen is a screen that displays the total amount of the transaction, the amount of cash deposited, the change amount, etc.

[0022] The card reader 12 is a device that reads data recorded on a card medium such as a credit card, an electronic money card, or a point card. When the card medium is a magnetic card, the card reader 12 is a magnetic card reader. When the card medium is an IC card, the card reader 12 is an IC card reader. The self-checkout machine 10 may be provided with either a magnetic card reader or an IC card reader as the card reader 12, or may be provided with both. The card reader 12 may be a card reader / writer having a data writing function to the card. In the example of FIG. 2, the card reader is shown as being built into the self-checkout machine body, but it may also be configured to be connected to an external payment terminal.

[0023] The printer 13 is a device that prints data related to purchase receipts, credit card slips, etc. on receipt paper. The receipt paper on which various data is printed by the printer 13 is cut by a cutter and issued from the receipt issuing port. The printer 13 is realized by, for example, a thermal printer or a dot impact printer, etc.

[0024] The scanner 14 and the hand scanner 15 read barcodes attached to products as information for identifying products, or codes for code settlement displayed on a smartphone held by a consumer, etc. The scanner 14 optically reads the barcode of a product that is covered over the reading window (glass window) so that the barcode attached to the product faces it. The hand scanner 15 is operated manually by an accountant and optically reads the barcode by approaching the barcode attached to the product. Note that the scanner 14 and the hand scanner 15 only need to read information for recognizing products, and may read information other than barcodes, such as two-dimensional codes, etc.

[0025] The cash processor 16 processes cash. The cash processor 16 has a banknote insertion slot 161, a banknote ejection slot 162, a coin insertion slot 163, and a coin ejection slot 164. The cash processor 16 processes the banknotes inserted into the banknote insertion slot 161. The cash processor 16 ejects banknotes as change from the banknote ejection slot 162. The cash processor 16 accepts and processes the coins inserted into the coin insertion slot 163. The cash processor 16 ejects coins as change from the coin ejection slot 164.

[0026] The speaker 17 outputs sounds such as warning sounds for alerting or voices as messages.

[0027] The pat lamp 18 is for displaying the state of the self-checkout machine 10 and is attached to the tip of a pole extending in the vertical direction. The pat lamp 18 includes a light-emitting member and a cylinder. The light-emitting member is rotatably attached coaxially with the cylinder inside the cylinder. When the pat lamp 18 operates, it can rotate while making the light-emitting member emit light. For example, when registering a product, the pat lamp 18 makes the light-emitting member emit blue light, and when an error occurs, it makes the light-emitting member emit red light to notify an employee in the accounting space called an attendant of the state of the self-checkout machine 10.

[0028] The cameras 40 of the guidance system 200 are respectively attached above the main bodies of the self-checkout machines 10. As shown in FIG. 2, the self-checkout machine 10 has a display of the touch panel 11, a card insertion slot of the card reader 12, a receipt issuing port of the printer 13, a reading window of the scanner 14, and a banknote insertion port 161, a banknote ejection port 162, a coin insertion port 163, and a coin ejection port 164 of the cash processor 16 arranged on one surface (hereinafter referred to as the front) of the main body 101. Therefore, the accountant stands facing the front of the main body 101 and operates the self-checkout machine 10. The camera 40 is attached at a position where it can photograph almost the entire body of the accountant from above.

[0029] FIG. 3 is a schematic diagram showing an example of the photographing area AL by the camera 40. As described above, the camera 40 photographs the front side of the self-checkout machine 10 from above. Therefore, since the accountant CA operating the self-checkout machine 10 stands in the front, he / she is shown in the photographed image of the camera 40. Also, when the shopping basket BA is placed on the first product placement table 102, not only the accountant CA but also the shopping basket BA or the products stored in the shopping basket BA are shown in the photographed image. Similarly, when a product ME is placed on the second product placement table 103, for example, the product ME is also shown in the photographed image.

[0030] [Explanation of the Configuration of the Guidance Information Server] FIG. 4 is a block diagram showing the main circuit configuration of the guidance information server 60. The guidance information server 60 is an example of a guidance information processing device. The guidance information server 60 includes a processor 61, a main memory 62, an auxiliary storage device 63, a clock 64, a camera interface 65, an image processing unit 66, a guidance device interface 67, a system transmission path 68, and the like. The system transmission path 68 includes an address bus, a data bus, control signal lines, and the like. The system transmission path 68 connects the processor 61 to the other units and transmits data signals exchanged therebetween.

[0031] The guidance information server 60 constitutes a computer by connecting the processor 61, the main memory 62, the auxiliary storage device 63, the clock 64, the camera interface 65, the image processing unit 66, and the guidance device interface 67 with the system transmission path 68.

[0032] The processor 61 corresponds to the central part of the above computer. The processor 61 controls each unit in order to realize various functions as the guidance information server 60 according to an operating system or an application program. The processor 61 is, for example, a CPU (Central Processing Unit). The processor 61 includes a plurality of processor cores and is a multi-core processor capable of executing a plurality of processes in parallel.

[0033] The main memory 62 corresponds to the main storage part of the above computer. The main memory 62 includes a non-volatile memory area and a volatile memory area. In the non-volatile memory area, the main memory 62 stores an operating system or an application program. The main memory 62 may store, in the non-volatile or volatile memory area, data necessary for the processor 61 to execute processes for controlling each part. The main memory 62 uses the volatile memory area as a work area where data is appropriately rewritten by the processor 61. The non-volatile memory area is, for example, a ROM (Read Only Memory). The volatile memory area is, for example, a RAM (Random Access Memory).

[0034] The auxiliary storage device 63 corresponds to the auxiliary storage part of the above computer. For example, an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disk Drive), or an SSD (Solid State Drive) etc. can be the auxiliary storage device 63. The auxiliary storage device 63 stores data used by the processor 61 to perform various processes, data created by the processes in the processor 61, and the like. The auxiliary storage device 63 may store the above application program.

[0035] The clock 64 measures the date and time. The processor 61 processes the date and time measured by the clock 64 as the current date and time.

[0036] The camera interface 65 connects to the camera controller 50. The camera interface 65 outputs to the camera controller 50 a control signal for controlling the driving of each camera 40. The camera controller 50 outputs a control signal to each camera 40 respectively. Each camera 40 performs a shooting operation according to the respective control signal. The images captured by each camera 40 are output to the guidance information server 60 via the camera controller 50. The camera interface 65 captures the captured images output from the camera controller 50 and supplies them to the image processing unit 66.

[0037] The image processing unit 66 analyzes the images captured by each camera 40 by using, for example, an image processing technique using AI (Artificial Intelligence), and classifies each captured image according to predetermined elements. For example, the image processing unit 66 classifies an image in which a person is captured and an image in which a person is not captured. Alternatively, the image processing unit 66 classifies an image in which a product is placed on the first product placement table 102 and an image in which no product is placed. The image processing unit 66 classifies an image in which a product is placed on the second product placement table 103 but no product is placed on the first product placement table 102 and other images.

[0038] The guidance device interface 67 connects to the guidance device 70. The guidance device interface 67 outputs the guidance information generated under the control of the processor 61 to the guidance device 70.

[0039] [Function description of the guidance information server] As shown in FIG. 5, the guidance information server 60 having such a configuration has functions as a recognition means 81, a determination means 82, a decision means 83, and an output means 84 by the processor 61. Further, a part of the volatile memory area of the main memory 62 is used as areas for a state table 85, a use counter 86, and a mode memory 87.

[0040] FIG. 6 is a schematic diagram showing the data structure of the status table 85. The status table 85 consists of a column Ca for camera ID, a column Cb for the accounting machine number, and a column Cc for status ST. Each camera 40 is set with a unique camera ID. Also, a series of accounting machine numbers are assigned to the self-checkout machine 10. The status table 85 describes the camera ID of each camera 40 in column Ca. The status table 85 describes, in column Cb, the accounting machine number of the self-checkout machine 10 photographed by the camera 40 specified by the camera ID described in column Ca. The status table 85 describes, in column Cc, a status ST representing the status of the self-checkout machine 10 specified by the accounting machine number described in column Cb.

[0041] The status of the self-checkout machine 10 has three patterns: standby, in use, and ended. Standby means a state where no accounting operation is being performed. In use means a state where an accounting operation is being performed. Ended means a state where it is assumed that the accounting operation has ended. Standby is an idle state. However, in use and ended are not idle states. In this embodiment, the status ST indicating standby is set to "0", the status ST indicating in use is set to "1", and the status ST indicating ended is set to "2".

[0042] Return to the description of FIG. 5. The in-use counter 86 counts the number n of status STs indicating in use or ended described in column Cc of the status table 85. The mode memory 87 stores the guidance mode M. The guidance mode M will be described later.

[0043] The recognition means 81 is a function for recognizing the states of a plurality of self-checkout machines 10. The recognition means 81 recognizes the states of the self-checkout machines 10 based on the information of the images processed by the image processing unit 66. Specifically, the recognition means 81 recognizes that the state of the self-checkout machine 10 in which an image in which no person is captured by the camera 40 is taken is in a standby state. Also, among the self-checkout machines 10 in which an image in which a person is captured by the camera 40 is taken, the recognition means 81 recognizes that the state of the self-checkout machine 10 in which an image in which a product is placed on the first product placement table 102 is taken is in use, and recognizes that the state of the self-checkout machine 10 in which an image in which no product is placed on the first product placement table 102 is taken is in the process of ending. The recognition means 81 may recognize that the state of the self-checkout machine 10 in which an image in which a product is placed on the second product placement table 103 but no product is placed on the first product placement table 102 is taken is in the process of ending. The recognition means 81 rewrites the status ST of the status table 85 based on the state recognition result of the self-checkout machine 10.

[0044] The determination means 82 is a function for determining the congestion level of the self-checkout machine 10 based on the state recognition result by the recognition means 81. The determination means 82 determines the congestion level of the self-checkout machine 10 based on the count value n of the in-use counter 86. Specifically, the determination means 82 determines the ratio of the count value n to the total number of self-checkout machines 10 installed in the accounting space as the congestion level. For example, assuming that the total number of self-checkout machines 10 is 10, the congestion level when the count value n is "0" is 0%, and the congestion level when the count value n is "1" is 10%. Thereafter, similarly, the congestion level when the count value n is "9" is 90%, and the congestion level when the count value n is "10" is 100%.

[0045] The determination means 83 has a function of determining a guidance mode based on the congestion level determined by the determination means 82. The guidance modes include a first guidance mode MA, a second guidance mode MB, and a third guidance mode MC. The first guidance mode MA is the guidance mode when the congestion level of the self-checkout machine 10 is lower than the reference value. The second guidance mode MB is the guidance mode when the congestion level of the self-checkout machine 10 is higher than the reference value. The third guidance mode MC is the guidance mode when the congestion level of the self-checkout machine 10 is 100%. As described above, the reference value is arbitrary, but it is preferable to set a value at which it is determined that the self-checkout machine 10 is congested, for example, a value of 80% or more. In this embodiment, the reference value is set to 80%. Therefore, the determination means 83 sets the guidance mode to the first guidance mode MA when the congestion level is less than 80%, sets the guidance mode to the second guidance mode MB when the congestion level is less than 100% and 80% or more, and sets the guidance mode to the third guidance mode MC when the congestion level is 100%. Then, the determination means 83 rewrites the guidance mode M in the mode memory 87.

[0046] The output means 84 has a function of outputting guidance information for non-accounted persons to the guidance device 70 in different forms according to the guidance mode M determined by the determination means 83. When the congestion level is lower than the reference value, that is, in the first guidance mode MA, the output means 84 outputs first guidance information that allows non-accounted persons to select an available self-checkout machine 10 as the main body. When the congestion level is higher than the reference value, that is, in the second guidance mode, the output means 84 outputs second guidance information that guides non-accounted persons to a specific available self-checkout machine 10. When the congestion level is 100%, that is, in the third guidance mode, the output means 84 outputs third guidance information or fourth guidance information that makes non-accounted persons wait in front of the accounting space.

[0047] FIG. 7 is an example of a first guidance image CSa displayed on a display 71 of a guidance device 70 that has input first guidance information. As shown in the figure, the first guidance image CSa is an image showing the layout of each self-checkout machine 10 arranged in the checkout space. Incidentally, a trapezoidal figure with a round number attached thereto indicates the self-checkout machine 10. And the round number is the checkout machine number of the self-checkout machine 10. The first guidance image CSa shows the self-checkout machines 10 in a standby state, that is, the self-checkout machines 10 in an idle state, with a solid-line figure, and shows the self-checkout machines 10 in use or in the end state with a dashed-line figure.

[0048] Therefore, an unaccounted person who has confirmed the first guidance image CSa can easily recognize which self-checkout machine 10 installed at which location is idle. And the unaccounted person will select a convenient self-checkout machine 10 from the idle self-checkout machines 10, go to that location, and perform a checkout operation. For example, when the first guidance image CSa in FIG. 7 is being displayed, an unaccounted person who desires a self-checkout machine 10 close to the exit may select the self-checkout machine 10 with a checkout machine number of 10 and perform a checkout operation. An unaccounted person who desires a self-checkout machine 10 close to the entrance may select the self-checkout machine 10 with a checkout machine number of 1 or 4 and perform a checkout operation.

[0049] FIG. 8 is an example of a second guidance image CSb displayed on a display 71 of a guidance device 70 that has input second guidance information. As shown in the figure, the second guidance image CSb includes a first-pattern guidance image CSba and a second-pattern guidance image CSbb.

[0050] The first-pattern guidance image CSba is an image that can guide an unaccounted person to a specific idle self-checkout machine 10. For example, the guidance image CSba shown in FIG. 8 is an image that can guide an unaccounted person to the self-checkout machine 10 with a checkout machine number of 10.

[0051] The guidance image CSbb of the second pattern is an image that shows the layout of each self-checkout machine 10 arranged in the accounting space, similar to the first guidance image CSa. And the guidance image CSbb shows the movement route from the entrance of the accounting space to a specific available self-checkout machine 10.

[0052] On the display 71 of the guidance device 70 that has input the second guidance information, the guidance image CSba of the first pattern and the guidance image CSbb of the second pattern are alternately displayed at regular time intervals, for example, at one-second intervals. Therefore, an unaccounted person who has confirmed the second guidance image CSb can quickly reach in front of an available self-checkout machine 10 following the guidance and start the accounting operation by moving to the accounting space.

[0053] Regarding the second guidance image CSb, it is not necessary to alternately display the guidance image CSba of the first pattern and the guidance image CSbb of the second pattern. For example, the screen of the display 71 can be divided into two parts, left and right, and the guidance image CSba of the first pattern can be displayed on one side, and the guidance image CSbb of the second pattern can be displayed on the other side. Also, by displaying a map indicating the positions of the self-checkout machines 10 at the entrance of the accounting space, the second guidance image CSb can be set as only the guidance image CSba of the first pattern.

[0054] FIG. 9 is an example of a third guidance image CSc displayed on the display 71 of the guidance device 70 that has input the third guidance information. FIG. 10 is an example of a fourth guidance image CSd displayed on the display 71 of the guidance device 70 that has input the fourth guidance information. As shown in FIG. 9, the third guidance image CSc is an image that can notify an unaccounted person that there is no available self-checkout machine 10. As shown in FIG. 10, the fourth guidance image CSd is an image that can notify an unaccounted person that the self-checkout machine 10 will be available soon. Therefore, an unaccounted person who has confirmed the third guidance image CSc or the fourth guidance image CSd can easily recognize that the self-checkout machine 10 is not available. The unaccounted person waits at the entrance until the self-checkout machine 10 becomes available. The unaccounted person can know that the self-checkout machine 10 will be available soon when the image on the display 71 switches from the third guidance image CSc to the fourth guidance image CSd, so the unaccounted person can wait for the self-checkout machine 10 to become available without experiencing the stress of waiting in line for accounting.

[0055] Note that the guidance device 70 not only displays the guidance images shown in FIGS. 7 to 10 on the display 71 but also outputs guidance information by voice from the speaker 72. For example, when the first guidance image CSa in FIG. 7 is being displayed, the guidance device 70 outputs a voice saying "Please proceed to the available cash register" from the speaker 72. For example, when the second guidance image CSb in FIG. 8 is being displayed, the guidance device 70 outputs a voice saying "Please proceed to cash register No. 10" from the speaker 72. For example, when the third guidance image CSc in FIG. 9 is being displayed, the guidance device 70 outputs a voice saying "Please wait a moment" from the speaker 72. For example, when the fourth guidance image CSd in FIG. 10 is being displayed, the guidance device 70 outputs a voice saying "The cash register will be available soon" from the speaker 72. Incidentally, the term "cash register" refers to a self-checkout machine.

[0056] [Explanation of the Operation of the Guidance Information Server] The functions as the above-described recognition means 81, determination means 82, decision means 83, and output means 84 are realized by information processing executed by the processor 61 in accordance with a business program. The business program is a type of application program stored in the main memory 62 or the auxiliary storage device 63. The method of installing the business program in the main memory 62 or the auxiliary storage device 63 is not particularly limited. The business program can be recorded on a removable recording medium, or distributed by communication via a network and installed in the main memory 62 or the auxiliary storage device 63. The form of the recording medium is not limited as long as it can store a program and can be read by the device, such as a CD-ROM, a memory card, etc.

[0057] FIG. 11 is a flowchart showing the main information processing procedure of the processor 61 functioning as the recognition means 81. The processor 61 resets the unit counter C to “0” as ACT1. The unit counter C counts the number of cameras 40 provided in the guidance system 200. The processor 61 increments the unit counter C by “1” as ACT2. Then the processor 61 checks whether the unit counter C is less than or equal to the comparison value N as ACT3. The comparison value N is the total number of cameras 40 provided in the guidance system 200. In the present embodiment, since the total number of cameras 40 is equal to the number of self-checkout machines 10 installed in the accounting space, the comparison value N is the number of self-checkout machines 10. For example, when the number of self-checkout machines 10 is 10, the comparison value N is “10”.

[0058] When the unit counter C is less than or equal to the comparison value N, the processor 61 proceeds to ACT4. The processor 61 acquires, as ACT4, an image captured by the camera 40 corresponding to the unit counter C via the camera controller 50. At this point, the unit counter C is “1”. Therefore, the processor 61 captures and imports the captured image of the camera 40 with the camera ID “0001”, that is, the camera 40 that photographs the self-checkout machine 10 with the accounting machine number “1”.

[0059] The processor 61 that has captured the photographed image proceeds to ACT5. The processor 61 supplies the photographed image to the image processing unit 66 as ACT5 and causes the image processing to be performed. Then, the processor 61 requests the result of the image processing. From the image processing unit 66, information on whether a person could be recognized from the photographed image is obtained as the image processing result. Also, when a person could be recognized, information on whether there is an unregistered product, that is, whether a product is placed on the first product placement table 102, is obtained as the image processing result.

[0060] The processor 61 determines whether a person could be recognized from the photographed image as ACT6. If a person is not recognized, the processor 61 proceeds to ACT7. The processor 61 rewrites the status STc described in column Cc in the same row as column Ca with the camera ID "0001" in the status table 85 to the value "0" indicating standby as ACT7.

[0061] On the other hand, when a person could be recognized, the processor 61 proceeds to ACT8. The processor 61 determines whether there is an unregistered product as ACT8. If an unregistered product exists, the processor 61 proceeds to ACT9. The processor 61 rewrites the same status STc in the status table 85 to the value "1" indicating in use as ACT9. In contrast, if no unregistered product exists, the processor 61 proceeds to ACT10. The processor 61 rewrites the same status STc in the status table 85 to the value "2" indicating in the process of ending as ACT10.

[0062] The processor 61 that has rewritten the status STc returns to ACT2. That is, the processor 61 further increments the unit counter C by "1". Then the processor 61 executes the processing after ACT3 in the same manner as described above. Therefore, based on the processing results of the image processing unit 66 for the images captured by each camera 40, the processor 61 sets the status ST corresponding to the camera ID of each camera 40 to a value corresponding to the state of the self-checkout machine 10 photographed by that camera 40. For example, the status ST corresponding to the camera ID of the camera 40 that has captured an image in which a person cannot be recognized is set to the value "0" indicating standby. The status ST corresponding to the camera ID of the camera 40 that has captured an image in which a person can be recognized and there are unregistered products is set to the value "1" indicating in use. The status ST corresponding to the camera ID of the camera 40 that has captured an image in which a person can be recognized but there are no unregistered products is set to the value "2" indicating in the process of ending.

[0063] In ACT3, when the unit counter C exceeds the comparison value N, the processor 61 ends the information processing as the recognition means 81.

[0064] Figure 12 is a flowchart showing the main information processing procedure of the processor 61 functioning as the determination means 82. The processor 61 resets the in-use counter 86 to "0" as ACT11. Also, the processor 61 resets the unit counter C to "0" as ACT12. The processor 61 increments the unit counter C by "1" as ACT13. Then the processor 61 checks whether the unit counter C is less than or equal to the comparison value N as ACT14.

[0065] If the unit counter C is less than or equal to the comparison value N, the processor 61 proceeds to ACT15. The processor 61 searches the status table 85 as ACT15 to obtain the status STc corresponding to the unit counter C. At this point, the unit counter C is "1". Therefore, the processor 61 obtains the status STc described in the column Cc in the same row as the column Ca with the camera ID "0001".

[0066] The processor 61 that has acquired the status STc proceeds to ACT16. The processor 61 determines whether the value of the status STc is "0" indicating unused as ACT16. If the value of the status STc is not "0" indicating unused, that is, if the value of the status STc is "1" indicating in use or "2" indicating in the process of ending, the processor 61 proceeds to ACT17. The processor 61 increments the in-use counter n by "1" as ACT17.

[0067] The processor 61 either increments the in-use counter n in ACT17 or returns to ACT13 if the value of the status STc is "0" indicating unused in ACT16. That is, the processor 61 further increments the unit counter C by "1". Then the processor 61 executes the processes after ACT14 in the same manner as described above. Therefore, when the value of the status STc described in the column Cc of the status table 85 is "1" indicating in use or "2" indicating in the process of ending, the processor 61 increments the in-use counter n by "1" each time.

[0068] When the unit counter C exceeds the comparison value N in ACT14, the processor 61 proceeds to ACT18. The processor 61 calculates the congestion level P by the following arithmetic expression (1) as ACT18. P=(n / N)*100 …(1) Thus, the processor 61 ends the information processing as the determination means 82.

[0069] FIG. 13 is a flowchart showing the main information processing procedure of the processor 61 functioning as the determination means 83. The processor 61 checks whether the congestion level P is less than the reference value L as ACT21. The reference value L is a value at which the self-checkout machine 10 should be determined to be congested as described above, and is 80% in this embodiment.

[0070] When the congestion level P is less than the reference value L, the processor 61 proceeds to ACT22. The processor 61 rewrites the guidance mode M of the mode memory 87 to the first guidance mode MA as ACT22.

[0071] In ACT21, when the congestion level P is greater than or equal to the reference value L, the processor 61 proceeds to ACT23. The processor 61 checks whether the congestion level P is 100% as ACT23. If the congestion level P is not 100%, that is, when the congestion level is greater than or equal to the reference value L and less than 100%, the processor 61 proceeds to ACT24. The processor 61 rewrites the guidance mode M of the mode memory 87 to the second guidance mode MB as ACT24.

[0072] In ACT23, when the congestion level P is 100%, the processor 61 proceeds to ACT25. The processor 61 rewrites the guidance mode M of the mode memory 87 to the third guidance mode MC as ACT25. The above is the end of the information processing of the processor 61 as the decision means 83.

[0073] Figure 14 is a flowchart showing the main information processing procedure of the processor 61 functioning as the output means 84. The processor 61 discriminates the guidance mode M described in the mode memory 87 as ACT31. The processor 61 checks whether the guidance mode M is the first guidance mode MA as ACT32. When the guidance mode M is the first guidance mode MA, the processor 61 proceeds to ACT33. The processor 61 obtains the status ST indicating the status of each self-checkout machine 10 from the status table 85 as ACT33. Next, the processor 61 edits the first guidance image CSa as ACT34. That is, the processor 61 edits the first guidance image CSa with the figure indicating the self-checkout machine 10 with the status ST of "0" as a solid line and the figure indicating the self-checkout machine 10 with the status ST of "1" or "2" as a dashed line.

[0074] In ACT32, when the guidance mode M is not the first guidance mode MA, the processor 61 checks, as ACT35, whether the guidance mode M is the second guidance mode MB. If the guidance mode M is the second guidance mode MB, the processor 61 proceeds to ACT36. The processor 61, as ACT36, acquires from the state table 85 the status ST indicating the state of each self-checkout machine 10. Then, the processor 61 determines, as ACT37, the guidance checkout machine.

[0075] The guidance checkout machine is the self-checkout machine 10 that guides unaccounted customers. The self-checkout machine 10 that guides unaccounted customers is a self-checkout machine 10 in an idle state. That is, it is a self-checkout machine with the status ST being "0". When the guidance mode M is the second guidance mode MB, there is one or about two to three self-checkout machines 10 with the status ST being "0". The processor 61 selects any one of the self-checkout machines 10 with the status ST being "0" and determines it as the guidance checkout machine.

[0076] The processor 61 that has determined the guidance checkout machine proceeds to ACT38. The processor 61 edits, as ACT38, the second guidance image CSb. That is, the processor 61 edits the first pattern guidance image CSba that can guide unaccounted customers to a specific idle self-checkout machine 10 and the second pattern guidance image CSbb indicating the route to that self-checkout machine 10.

[0077] In ACT35, when the guidance mode M is not the second guidance mode MB either, the processor 61 searches, as ACT39, the state table 85. Then, the processor 61 checks, as ACT40, whether the value "2" exists among the statuses ST described in the column Cc.

[0078] If the status ST with the value "2" does not exist, the processor 61 proceeds to ACT41. The processor 61 edits the third guidance image CSc as ACT41. On the other hand, if there is even one status ST with the value "2", the processor 61 proceeds to ACT42. The processor 61 edits the fourth guidance image CSd as ACT42.

[0079] In this way, the processor 61 that has edited the first guidance image CSa, the second guidance image CSb, the third guidance image CSc, or the fourth guidance image CSd proceeds to ACT42. The processor 61 controls the guidance device interface 67 to output the guidance image to the guidance device 70 as ACT42. By this control, the data of the first guidance image CSa, the second guidance image CSb, the third guidance image CSc, or the fourth guidance image CSd is output to the guidance device 70.

[0080] As a result, when the data of the first guidance image CSa is output to the guidance device 70, the first guidance image CSa as shown in FIG. 7 is displayed on the display 71. Therefore, the unaccounted person who has confirmed the first guidance image CSa can select a self-checkout machine 10 convenient for himself / herself and perform the accounting operation. Thus, the unaccounted person can select the self-checkout machine 10 that can perform the accounting operation without stress.

[0081] On the other hand, when the data of the second guidance image CSb is output to the guidance device 70, the second guidance image CSb as shown in FIG. 8 is displayed on the display 71. That is, the first pattern guidance image CSba and the second pattern guidance image CSbb are alternately displayed. Therefore, the unaccounted person who has confirmed the second guidance image CSb can move to the self-checkout machine 10 according to the guidance and perform the accounting operation. Thus, even if it is difficult to know which self-checkout machine 10 is vacant due to the layout of the accounting space, the customer can quickly move to the vacant self-checkout machine 10 and perform the accounting operation. As a result, it is impossible for a queue of customers waiting for accounting to form even though the self-checkout machine 10 is vacant.

[0082] Also, when the data of the third guidance image CSc is output to the guidance device 70, the third guidance image CSc as shown in FIG. 9 is displayed on the display 71. After that, when the data of the fourth guidance image CSd is output to the guidance device 70, the guidance image displayed on the display 71 switches from the third guidance image CSc to the fourth guidance image CSd as shown in FIG. 10. Therefore, when there is no available self-checkout machine 10, a queue of customers waiting for checkout is formed, but since the guidance image switches when it seems that an available self-checkout machine 10 will soon become available, the stress on the customers waiting for checkout is also reduced.

[0083] [Second Embodiment] In the above embodiment, the recognition means 81 recognizes that the self-checkout machine 10 in a state where an image in which a person is not captured is photographed by the camera 40 is in a standby state, and recognizes the self-checkout machine 10 in which an image in which a person is captured is being used. The recognition means 81 is not limited to this. For example, the state of the self-checkout machine 10 can also be recognized by the pat lamp 18. Therefore, next, a second embodiment of the recognition means 89 for recognizing the state of the self-checkout machine 10 by the pat lamp 18 will be described with reference to FIGS. 15 to 17.

[0084] As shown in FIG. 15, in the second embodiment, a state setting memory 88 is added to a part of the volatile memory area in the main memory 62. As shown in FIG. 16, the state setting memory 88 is a memory in which the status of the self-checkout machine 10 specified by the presence or absence of the cashier operating the self-checkout machine 10 and the pat lamp 18 is preset.

[0085] The pat lamp 18 has a state of lighting blue, i.e., lighting in blue, a state of flashing blue, i.e., flashing in blue, a state of lighting red, i.e., lighting in red, and a state of flashing red, i.e., flashing in red.

[0086] When the pat lamp 18 lights blue when there is a cashier, the self-checkout machine 10 is in a state before the accounting operation by the cashier is started. Therefore, the state setting memory 88 sets the value "1" in use as the status ST.

[0087] When the accountant is present and the Trump 18 blinks blue, the self-accounting machine 10 is in the state where the accountant is performing operations. Therefore, the status setting memory 88 sets the value "1" being used as the status ST.

[0088] When the accountant is present and the Trump 18 lights up red, the self-accounting machine 10 is in the state of calling the clerk. Therefore, the status setting memory 88 sets the value "1" being used as the status ST.

[0089] When the accountant is present and the Trump 18 blinks red, the self-accounting machine 10 is in the state of calling the clerk or an error has occurred. Therefore, the status setting memory 88 sets the value "1" being used as the status ST.

[0090] When the accountant is absent and the Trump 18 lights up blue, the self-accounting machine 10 is in the standby state. Therefore, the status setting memory 88 sets the standby value "0" as the status ST.

[0091] When the accountant is absent and the Trump 18 blinks blue, the self-accounting machine 10 is in the state where the accountant has left during the accounting operation. Usually, such an event cannot occur, but if it does occur, the attendant will handle it and make it possible for the next customer to use it. Therefore, the status setting memory 88 sets the value "2" being ended as the status ST.

[0092] When the accountant is absent and the Trump 18 lights up red or blinks red, the self-accounting machine 10 is in the state where the accountant has left even though it is in the state of calling the clerk or an error has occurred. Such an event usually cannot occur either, but if it does occur, the attendant will handle it and make it possible for the next customer to use it. Therefore, the status setting memory 88 sets the value "2" being ended as the status ST.

[0093] Now, in the second embodiment, the camera 40 of the guidance system 200 is attached at a position where not only the front side of the self-checkout machine 10 but also the pattern lamp 18 can be photographed. Further, the image processing unit 66 not only classifies the images in which a person is captured and the images in which a person is not captured, but also identifies the color and the lit or blinking state of the pattern lamp 18 captured in the images.

[0094] FIG. 17 is a flowchart showing the main information processing procedure of the processor 61 that functions as the recognition means 89. Note that the same reference numerals are given to the parts common to the procedure shown in FIG. 11. That is, the processor 61 resets the unit counter C to “0” as ACT1. Next, the processor 61 counts up the unit counter C by “1” as ACT2. Then, the processor 61 checks whether the unit counter C is less than or equal to the comparison value N as ACT3. When the unit counter C is less than or equal to the comparison value N, the processor 61 acquires, as ACT4, the image captured by the camera 40 corresponding to the unit counter C via the camera controller 50. Then, the processor 61 supplies the captured image to the image processing unit 66 as ACT5 to cause image processing to be performed, and requests the result of the image processing.

[0095] The processor 61 acquires a person recognition result as ACT51 as a result of the image processing. Further, the processor 61 acquires a pattern lamp recognition result as ACT52. Then, the processor 61 searches the status setting memory 88 as ACT53 and acquires the status corresponding to the person recognition result and the pattern lamp recognition result. The processor 61 describes the status in the column Cc of the status table 85 as ACT54.

[0096] Thereafter, the processor 61 returns to ACT2. The processor 61 repeatedly executes the processing after ACT3 until the unit counter C exceeds the comparison value N.

[0097] Thus, in the column Cc of the status table 85 corresponding to the accounting machine number of the self-checkout machine 10 where the person recognition result is "present" and the Trump recognition result is "blue lit", "1" is described as the status ST. Similarly, in the column Cc of the status table 85 corresponding to the accounting machine numbers of the self-checkout machines 10 where the person recognition result is "present" and the Trump recognition result is "blue flashing", the self-checkout machines 10 where the person recognition result is "present" and the Trump recognition result is "red lit", and the self-checkout machines 10 where the person recognition result is "present" and the Trump recognition result is "red flashing", "1" is also described as the status ST.

[0098] On the other hand, in the column Cc of the status table 85 corresponding to the accounting machine number of the self-checkout machine 10 where the person recognition result is "absent" and the Trump recognition result is "blue lit", "0" is described as the status ST. Also, in the column Cc of the status table 85 corresponding to the accounting machine numbers of the self-checkout machines 10 where the person recognition result is "absent" and the Trump recognition result is "blue flashing", the self-checkout machines 10 where the person recognition result is "absent" and the Trump recognition result is "red lit", and the self-checkout machines 10 where the person recognition result is "absent" and the Trump recognition result is "red flashing", "2" is described as the status ST.

[0099] Needless to say, in the second embodiment having such a configuration, it is possible to appropriately guide non-accounted customers to an available self-checkout machine 10 according to the congestion level of the self-checkout machine 10. In the second embodiment, as shown in FIG. 16, in the status setting memory 88, the status of the self-checkout machine 10 specified by the presence or absence of the accountant operating the self-checkout machine 10 and the color and display status of the Trump 18 is preset. Needless to say, the color and display status of the Trump 18 are not limited to those shown in FIG. 16. Also, if the status of the self-checkout machine 10 can be identified by the emission color or display status of a light emitter other than the Trump, that light emitter may be applied instead of the Trump.

[0100] [Other Embodiments] The image processing unit 66 may not only simply classify an image in which a person is captured and an image in which a person is not captured, but also acquire detailed information such as for how many seconds a person is captured or for how many seconds a person is not captured. Based on such information, the output means 84 may determine the self-checkout machine 10 to be preferentially guided and edit the guidance information.

[0101] The mounting location of the display 71 is not limited to the entrance of the accounting space. Also, the guidance device may include a plurality of displays 71. In that case, one is provided at the entrance of the accounting space, and the rest are provided in the sales floor where products are displayed. Then, the display 71 at the entrance may display guidance information according to the degree of congestion, and the other displays 71 may display the first guidance information regardless of the degree of congestion.

[0102] The in-use counter 86 may count the number n of status STs indicating in-use or completed described in the column Cc of the status table 85, but may also count the number n of status STs in standby. In this case, the degree of congestion P is calculated by the following arithmetic expression (2). P = 100 - {(n / N) * 100} …(2) It is not necessary to provide a camera 40 for each self-checkout machine 10. For example, by attaching a camera with a wide-angle lens to the ceiling of the accounting space, a plurality of self-checkout machines 10 may be photographed with one camera.

[0103] If the status of the self-checkout machine 10 is set to two states, standby and in-use, a human sensor using infrared rays or the like may be adopted instead of the camera 40. In this case, since the image processing unit 66 becomes unnecessary, the processing load on the guidance information server 60 can be reduced.

[0104] The store server 20 may have a function as the guidance information server 60. That is, the store server 20 may also be used as the guidance information processing device. In this case, since the signal from the self-checkout machine 10 can be used to identify whether the self-checkout machine 10 is in the standby state or in the use state, cameras 40, human sensors, etc. are not required. Therefore, the cost of the guidance system 200 can be reduced.

[0105] In addition, although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope of the invention and are included in the invention described in the claims and its equivalent scope.

Explanation of Reference Numerals

[0106] 10... Self-checkout machine, 18... Pat lamp, 20... Store server, 40... Camera, 50... Camera controller, 60... Guidance information server, 61... Processor, 62... Main memory, 63... Auxiliary storage device, 64... Clock, 65... Camera interface, 66... Image processing unit, 67... Guidance device interface, 70... Guidance device, 71... Display, 72... Speaker, 81, 89... Recognition means, 82... Determination means, 83... Decision means, 84... Output means, 85... Status table, 86... Usage counter, 87... Mode memory, 88... Status setting memory, 100... Self-checkout system, 102... First product placement table, 103... Second product placement table, 200... Guidance system, CSa... First guidance image, CSb... Second guidance image, CSc... Third guidance image, CSd... Fourth guidance image.

Claims

1. Recognition means for recognizing the availability status of a plurality of self-service terminals, Determination means for determining the congestion level of the self-service terminals based on the recognition result by the recognition means, Output means for outputting guidance information to unaccounted persons in different forms according to the congestion level, A guidance information processing device comprising the above.

2. The recognition means recognizes the availability status of the plurality of self-service terminals from images of cameras that have respectively photographed the plurality of self-service terminals. The guidance information processing device according to Claim 1.

3. The image is an image that has photographed a person operating the self-service terminal. The guidance information processing device according to Claim 2.

4. The image is an image that has photographed a pat lamp provided on the self-service terminal. The guidance information processing device according to Claim 2.

5. When the congestion level is lower than a reference value, the output means outputs guidance information that can select an available self-service terminal mainly for the unaccounted person. When the congestion level is higher than the reference value, the output means outputs guidance information that can guide the unaccounted person to a specific available self-service terminal. The guidance information processing device according to Claim 1.

6. A program for causing a computer of a guidance information processing device to function as Recognition means for recognizing the availability status of a plurality of self-service terminals, Determination means for determining the congestion level of the self-service terminals based on the recognition result by the recognition means, and Output means for outputting guidance information to unaccounted persons in different forms according to the congestion level.

7. Cameras for respectively photographing a plurality of self-service terminals, A server that recognizes the availability status of the plurality of self-service terminals from the images photographed by the cameras and determines the congestion level of the self-service terminals based on the recognition result, and A guidance device that guides unaccounted persons in different forms according to the congestion level, A guidance system comprising the above. ​

Images