Self-aligning device

Abstract

To provide a self-checkout device capable of reducing an operation mistake to improve convenience of a user.SOLUTION: A self-checkout device 1 includes a monitor 3 horizontally provided, and a motion sensor 9 for detecting an operation with respect to an operation guide G displayed on the monitor 3. The operation guide G for a customer U is displayed on the monitor 3.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a self-checkout device for a customer to settle the payment for the products purchased by the customer himself / herself.

Background Art

[0002] Conventionally, in order for a customer to settle the payment for the products purchased by the customer himself / herself, a self-checkout device equipped with a scanner for the customer to scan product information is known.

[0003] For example, Patent Document 1 describes an invention of a self-checkout terminal as follows. The self-checkout terminal described in Patent Document 1 is equipped with a display, a barcode scanner, etc. And it is described that a table for temporarily placing products and a shopping basket placement stand are provided. Also, it is described that a coin insertion slot, a bill inlet / outlet, a coin refund slot, and a coin payout slot are provided at the lower part of the table.

[0004] In the self-checkout terminal described in Patent Document 1, for a product with a barcode attached, the customer operates a barcode scanner or the like by himself / herself to perform registration, and the self-checkout terminal performs accounting registration of the product as an item to be settled based on the read information.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] In the self-checkout terminal described in Patent Document 1, the display is provided so as to face the customer (user) directly, and further, a table, a coin insertion slot, etc. are provided below the display. Therefore, when the customer performs the settlement operation, the line-of-sight movement between the display on which the settlement method is displayed and the table, coin insertion slot, etc. where product scanning, cash insertion, etc. are performed becomes large, and operation errors may occur.

[0007] The present invention aims to solve the above problems, and an object thereof is to provide a self-checkout device that can reduce operation errors and improve the convenience for users.

Means for Solving the Problems

[0008] The invention described in claim 1 made to solve the above problems includes a first display surface provided horizontally, and a detection unit provided outside the display area of the first display surface for detecting an operation on an operation unit displayed on the first display surface. An operation guide for the user is displayed on the first display surface. The self-checkout device is characterized by this.

Effects of the Invention

[0009] As described above, according to the present invention, an operation guide for the user is displayed on the first display surface provided horizontally, and the detection unit for detecting an operation on the operation unit displayed on the first display surface is provided outside the display area of the first display surface. Therefore, it becomes possible to use the horizontal first display surface as a table for placing products, etc., and by displaying the operation guide on that table, the operation guide can be visually recognized with the line of sight directed at the product, and almost no movement of the line of sight occurs. Therefore, operation errors are reduced and the convenience for users is improved.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Mode for Carrying Out the Invention

[0011] The self-checkout device according to an embodiment of the present invention will be described with reference to FIGS. 1 to 5. FIG. 1 is a schematic configuration diagram seen from the side of the self-checkout device 1 according to an embodiment of the present invention. Further, FIG. 2 is a schematic configuration diagram seen from the top surface of the self-checkout device 1.

[0012] The self-checkout device 1 includes a housing 2, monitors 3 and 4, a face recognition camera 5, a video camera 6, a scanner 7, a printer 8, a motion sensor 9, a projector 10, a payment terminal 11, a coin dispenser 12, a PC 13, and a SUBPC 14.

[0013] The housing 2 is composed of a box-shaped first housing part 2a and a flat plate-shaped second housing part 2b erected from the top surface of the first housing part. In the first housing part 2a, the monitor 3 and the payment terminal 11 are provided on the upper surface part 2a1. Further, on the upper surface part 2a1, a bill insertion slot 12a1, a bill payout slot 12a2, a coin insertion slot 12b1, a coin payout slot 12b2, a coin return slot 12b3, etc. (see FIGS. 4 and 5) provided in the coin dispenser 12 are provided.

[0014] The monitor 3 is provided on the upper surface portion 2a1 of the housing 2. That is, the monitor 3 functions as a first display surface provided horizontally. In this embodiment, the monitor 3 is configured as a screen of the projector 10. Further, as will be described later, the monitor 3 has a strength that enables it to be used as a table or the like that is a display surface and is used during precision operations such as scanning products. Therefore, since the monitor 3 is used as a table or the like, there is a risk of malfunction due to placed products or the like, and thus it does not have a function as a touch panel. The function that replaces the touch panel is realized using the motion sensor 9 as will be described later.

[0015] In addition, an operation guide for using the self-checkout device 1 is displayed on the monitor 3. The operation guide will be described later.

[0016] The settlement terminal 11 is a terminal device that controls settlement functions such as credit cards and electronic money.

[0017] In addition, an automatic change machine 12, a PC 13, and a SUBPC 14 are provided in the first housing portion 2a.

[0018] The automatic change machine 12 consists of a bill handling device 12a and a coin handling device 12b (see FIG. 2), and performs cash settlement under the control of the PC 13. Further, as shown in FIGS. 4 and 5 to be described later, the automatic change machine 12 includes a bill insertion slot 12a1, a bill payout slot 12a2, a coin insertion slot 12b1, a coin payout slot 12b2, a coin return slot 12b3, and the like. That is, the automatic change machine 12 is provided with a cash input port and a change discharge port.

[0019] The PC 13 is configured as a small computer and performs all settlement processes related to product purchases. That is, the PC 13 can function as a cash register having a POS function by means of a built-in POS (Point of Sale) application program or the like.

[0020] SUBPC14 is configured as a small computer and performs processes such as automatic customer recognition, automatic operation analysis, and voice recognition. SUBPC14 is configured as a PC (computer) separate from PC13, but it may also be integrated into one PC. Separating PC13 and SUBPC14 makes it easier to add processes such as automatic customer recognition, automatic operation analysis, and voice recognition to an existing system.

[0021] Automatic customer recognition identifies the gender and age of customers from face images captured by the face recognition camera 5 using well-known methods. Automatic operation analysis recognizes the operations (such as the direction of the face and hand movements) of customers (users) captured by the video camera 6 using well-known methods. Voice recognition recognizes the voices uttered by customers. These automatic customer recognition, automatic operation analysis, and voice recognition each send their respective processing results to the robot assistant processing unit 22 described later.

[0022] The second housing part 2b is provided with the monitor 4, the face recognition camera 5, the video camera 6, the scanner 7, the printer 8, the motion sensor 9, and the projector 10 (see also FIG. 2). That is, these devices are provided outside the display area of the monitor 3.

[0023] The monitor 4 is provided substantially vertically so that the display surface faces the customer U directly (face to face). That is, the monitor 4 is provided above the monitor 3 (the first display surface) and facing the customer U (user). In this embodiment, the monitor 4 is configured as a liquid crystal display. Also, the monitor 4 does not have the function as a touch panel. Also, a life-sized or CG (Computer Graphics) etc. human image (humanoid guidance image) serving as a robot assistant is displayed on the monitor 4. The specific content displayed on the monitor 4 will be described later.

[0024] The face recognition camera 5 is a camera for capturing a face image of customer U to recognize gender and age, and is a camera module having a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

[0025] The video camera 6 has a video camera for recognizing the actions of customer U and a microphone for recognizing the voice uttered by customer U. The video camera 6 is not limited to being integrally configured with the video camera and the microphone, and may be separate.

[0026] The scanner 7 irradiates a product with a laser scanning line or reads various codes such as barcodes attached to the product by a CCD scanner or the like. Further, the scanner 7 can scan any card with a barcode or the like attached thereto, such as a membership card or a point card.

[0027] The printer 8 prints a receipt on which information such as the name of the purchased product, the unit price of the product, the deposited amount, and the change amount is described.

[0028] The motion sensor 9 detects the shape and moving direction of the customer's finger. In the present embodiment, the motion sensor 9 is configured by a camera, and detects the movement by analyzing the captured finger image. That is, the motion sensor 9 functions as a detection unit that detects an operation on a button or the like (operation unit) displayed on the monitor 3 (first display surface).

[0029] In the SUBPC 14, based on the detection result of the motion sensor 9, it is determined which image among the images of the buttons or the like (operation unit) displayed (projected) on the monitor 3 has been operated. Then, based on the determination result, the PC 13 is caused to execute processing (such as settlement) corresponding to the operation, or the image displayed on the monitor 3 is changed or the video displayed on the monitor 4 is changed.

[0030] Also, in the present embodiment, in the PC 13, when it is determined that the fingertip has approached within 3 cm from the surface of the monitor 3, for example, based on the specified position of the fingertip, a mark is displayed at the position on the monitor 3 that is estimated to be pointed at by the fingertip. And when it is determined that the fingertip has approached within 1 cm from the surface of the monitor 3, for example, the PC 13 determines that the button at that position has been touched (operated). These determinations such as the distance can be made based on the identification result of the motion sensor 9.

[0031] That is, when the fingertip approaches within 3 cm (within a second distance that is longer than the first distance) from the surface of the monitor 3 (the first display surface), the PC 13 (the determination unit) displays a mark at the position on the operation guide that is estimated to be pointed at by the fingertip. Also, when the fingertip approaches within 1 cm (within the first distance) from the surface of the monitor 3 (the first display surface), the PC 13 (the determination unit) determines the operation of the operation guide.

[0032] The projector 10 projects an operation guide onto the monitor 3 under the control from the PC 13. That is, the projector 10 functions as a projection unit that projects an operation guide onto the monitor 3 (the first display surface). Note that the scanner 7, the printer 8, the motion sensor 9, and the projector 10 are not limited to being installed in the second housing portion 2b, and may be installed in the first housing portion 2a (however, excluding the projection portion of the upper surface portion 2a1).

[0033] The cloud service 20 is composed of a server device or the like connected to the self-checkout device 1 via a network such as the Internet. That is, the self-checkout device 1 (the PC 13 and the SUB PC 14) has a communication function. The cloud service 20 has a POS DATA 21 and a robot assistant processing unit 22.

[0034] The POS DATA 21 stores sales data and the like collected by a plurality of POS terminals including the self-checkout device 1.

[0035] The robot assistant processing unit 22 predicts the next action of customer U from the learned scenarios based on the results of customer layer automatic recognition, motion automatic analysis, and voice recognition transmitted from the SUBPC 14, and transmits it to the SUBPC 14. The SUBPC 14 causes the monitor 4 to display an image based on the received predicted action.

[0036] Next, the operation guide displayed on the monitor 3 and the robot assistant image displayed on the monitor 4 will be described with reference to FIGS. 3 to 5. FIG. 3 is a diagram showing an image of using the self-checkout device 1. In FIG. 3, among the devices shown in FIGS. 1 and 2, some devices such as the scanner 7 and the printer 8 are not shown.

[0037] As shown in FIG. 3, when customer U purchases a product P such as a book, a robot assistant image R is displayed on the monitor 4. Also, an operation guide G is displayed on the monitor 3. Customer U can perform the checkout operation according to the operation guide G displayed on the monitor 3 and receive assistance from the robot assistant image R as needed.

[0038] FIGS. 4 and 5 show the changes in the operation guide G during the purchase operation. First, in the standby state, the SUBPC 14 detects that customer U approaches the self-checkout device 1 using the face recognition camera 5 or the like, and the PC 13 displays texts, images, etc. such as greetings and guidance for scanning the product P on the monitor 3 in response to the detection result of the SUBPC 14.

[0039] Next, in the product scanning state, the PC 13 causes the monitor 3 to display a screen explaining the scanning method. At this time, when shifting to payment, a button indicating payment or the like is displayed, and a touch operation on the button is enabled. The touch operation is performed by detecting the position of the finger or the like by the motion sensor 9 as described above. Therefore, products or the like may be placed on parts other than the button on the monitor 3.

[0040] Next, as a payment method selection, PC13 causes monitor 3 to display a screen explaining the payment method. In FIG. 4, there are a plurality of options as the payment method. However, for example, if there is no option such as only cash, this display may be omitted and the process may proceed to the next screen.

[0041] Next, when cash is selected as the payment method, a screen explaining the method of inserting cash is displayed on monitor 3 (FIG. 5). In the payment screen of FIG. 5, as the operation guide G, an arrow and character information are used to indicate the positions of the actual coin insertion slot 12b1 and bill insertion slot 12a1. The coin insertion slot 12b1 and the bill insertion slot 12a1 are located on the same plane as monitor 3 when viewed from above (located at the peripheral part of monitor 3). That is, the operation guide G displays an indication showing the positions of the devices to be operated by the arrow and character information. The operation of the devices in the present embodiment includes actions such that the target device, such as inserting coins, performs some operation.

[0042] Next, upon completion of the settlement operation, an arrow is used as the operation guide G to indicate the positions of the actual receipt printer (printer 8), bill payout slot 12a2, and coin payout slot 12b2. The receipt printer and scanner 7 are also located on the same plane as monitor 3 when viewed from above (located at the end of monitor 3).

[0043] The robot assistant image R can be, for example, a real - life portrait of a person (although it may be a CG, a real - life portrait is preferred as it gives a greater sense of familiarity). A plurality of types of these portrait images are pre - recorded according to response patterns. Then, the robot assistant image R can be switched to a portrait corresponding to the customer U recognized from the image captured by the face recognition camera 5 (gender, age). Further, based on the actions of the customer U recognized from the image captured by the video camera 6 and the speech content of the customer U recognized from the voice acquired by the microphone of the video camera 6, the robot assistant image R assists the customer U to perform a smooth settlement operation.

[0044] Specifically, for example, when the operation of customer U is too fast, guidance such as "Please operate slowly" can be provided. Also, for example, when it takes a long time to select a payment method, guidance such as "Do you pay in cash?" can be provided. When customer U gives an affirmative response such as "Yes", guidance such as "Please touch the part where cash is displayed" can be provided. Or when the operation is taking time, guidance such as "Shall I call an operator?" can be provided. And when customer U gives an affirmative response such as "Yes", the video on monitor 4 may be switched to the operator. Thereafter, communication can be carried out with the operator who actually exists as a videophone.

[0045] According to the present embodiment described above, the self-checkout device 1 includes a horizontally provided monitor 3 and a motion sensor 9 provided outside the display area of the monitor 3 for detecting an operation on the operation guide G displayed on the monitor 3. An operation guide G for customer U is displayed on the monitor 3. By doing so, since the operation guide G for customer U is displayed on the horizontally provided monitor 3, it becomes possible to use the horizontal monitor 3 as a table for placing the product P or the like, and by displaying the operation guide G on the table, the operation guide G can be visually recognized while the line of sight is directed at the product P, and almost no movement of the line of sight occurs. Therefore, operation errors are reduced and the convenience for the user is improved.

[0046] In addition, the operation guide G uses arrows and character information to display the positions of devices to be used (operated) such as the coin insertion slot 12b1 and the bill insertion slot 12a1, so that it is possible to intuitively understand where to use them, improving convenience.

[0047] Also, as the devices to be used (operated), it includes a scanner 7 for reading product information from the purchased product, a printer 8, a banknote insertion slot 12a1, a banknote payout slot 12a2, a coin insertion slot 12b1, a coin payout slot 12b2, and a coin return slot 12b3. These are installed on the same plane as the monitor 3 when viewed from above. By doing so, it becomes easy to indicate the above-mentioned respective devices using arrows or the like displayed on the monitor 3, and it is possible to guide the user in an easy-to-understand manner.

[0048] Also, since it is equipped with a projector 10 for projecting an operation guide G onto the monitor 3, the monitor 3 may be configured as a screen, and it becomes easy to also serve as a table for placing products.

[0049] Also, it is equipped with a monitor 4 provided above the monitor 3 and facing the customer U directly. Since a human-shaped guidance image is displayed on the monitor 4, it is possible to obtain a sense of familiarity close to that of a face-to-face cash register where a cashier is in charge while being a self-checkout. In this way, the human-shaped guidance image can be said to be a substitute for the cashier, and it is desirable to display it in front of the customer U. Therefore, by installing a separate monitor 4 instead of displaying it on the monitor 3, the convenience of the customer U can be improved.

[0050] Also, the self-checkout device 1 is equipped with a motion sensor 9 for detecting the position of the finger operating the monitor 3 and a PC 13 for determining the operation of the operation guide G based on the detection result of the motion sensor 9. By doing so, a touch panel is not required, and a function equivalent to that of a touch panel can be realized. Therefore, the monitor 3 can also serve as a table.

[0051] Also, the PC 13 determines the operation of the operation guide G when the fingertip approaches within, for example, 1 cm from the surface of the monitor 3. Therefore, the operation can be determined immediately before the finger touches the screen. Also, an operation feeling equivalent to that of a touch panel can be obtained.

[0052] Further, when the fingertip approaches within, for example, 3 cm from the surface of the monitor 3, the PC 13 causes a mark to be displayed at a position on the monitor 3 that is presumed to be the position pointed to by the fingertip. Thus, it is possible to show customers U, etc. where the finger is trying to point.

[0053] Note that in the above-described embodiment, the monitor 4 was provided, but it is not essential. When the monitor 4 is not provided, instead of the robot assistant image R, only voice may be output to assist the customer U.

[0054] Also, the monitor 3 does not have to be configured as the screen of the projector 10. For example, the monitor 3 can be configured as a liquid crystal display, and by providing a strong transparent cover on the liquid crystal display, it can be configured to be usable as a table for placing products, etc.

[0055] Also, the operation guide G may be displayed avoiding the products placed on the monitor 3. That is, the operation guide G is displayed avoiding the products on the first display surface. This can prevent the situation where the operation guide G is hidden by the products or the display becomes difficult to see because it is reflected in the products when displayed by a projector or the like. To avoid it, it may be shifted vertically, horizontally, or reduced in size, or a plurality of display patterns of the operation guide G may be prepared according to the product positions.

[0056] In order to display the operation guide G avoiding the products, it is necessary to detect the products on the monitor 3. Examples of product detection methods will be described with reference to FIGS. 6 and 7. In FIGS. 6 and 7, a video camera 6 and a motion sensor 9 are used. The video camera 9 can photograph the area A1 indicated by the broken line extending from the video camera 6 in FIG. 6. Therefore, the position of the product can be detected by recognizing the product with the video camera 6. The recognition of the product may be detected by learning the object shape, or may be detected by detecting at least non-planar portions.

[0057] In addition, by using not only the video camera 6 but also the motion sensor 9 in combination, the detection accuracy of the merchandise can be improved. The motion sensor 9 can recognize the area A2 which is the area including each device (monitor 3, bill insertion slot 12a1, etc.) of the self-checkout device 1 below the broken line extending from the motion sensor 9 in FIG. 7. Also, as described above, the motion sensor 9 can recognize not only which position on the monitor 3 has been operated by the movement of a finger but also how the merchandise has moved, such as being placed on the monitor 3 from a merchandise basket or the like. Therefore, by also using the detection result of the motion sensor 9, the position of the merchandise can be recognized with high accuracy. Then, the operation guide G may be displayed while avoiding the recognized merchandise.

[0058] Moreover, the present invention is not limited to the above-described embodiment. That is, those skilled in the art can make various modifications and implement them in accordance with the conventionally known knowledge without departing from the gist of the present invention. As long as the configuration of the self-checkout device of the present invention is still provided even by such modifications, of course, it is included in the scope of the present invention.

Explanation of Signs

[0059] 1 Self-checkout device 3 Monitor (first display surface) 4 Monitor (second display surface) 7 Scanner (device to be operated) 8 Printer (receipt printer) 9 Motion sensor (detection unit) 10 Projector (projection unit) 12 Automatic change dispenser 12a1 Bill insertion slot (device to be operated) 12a2 Bill payout slot (device to be operated) 12b1 Coin insertion slot (device to be operated) 12b2 Coin payout slot (device to be operated) 12b3 Coin return slot (device to be operated) 13 PC (judgment unit) 14 SUBPC G Operation guide R Robot assistant image (humanoid guidance image) U Customer (user)

Claims

1. a first display surface provided horizontally; a detection unit provided outside the display area of the first display surface for detecting an operation on an operation unit displayed on the first display surface; and an operation guide for the user is displayed on the first display surface the operation guide includes a display indicating the position of the device to be operated by an arrow and character information; the device to be operated is installed on the same plane as the first display surface when viewed from above, and a self-checkout device characterized by this.

2. The self-checkout device according to claim 1, characterized in that the devices to be operated include a scanner for reading product information from a product to be purchased, a cash insertion slot, a change outlet, and a receipt printer.

3. The self-checkout device according to claim 1 or 2, characterized in that the operation guide is displayed avoiding the products on the first display surface.

4. The self-checkout device according to any one of claims 1 to 3, characterized by comprising a projection unit that projects the operation guide onto the first display surface.

5. comprising a second display surface provided above the first display surface and facing the user; the second display surface is characterized in that a human-shaped guidance image is displayed, and a self-checkout device according to any one of claims 1 to 4.

6. the detection unit detects the position of the fingertip of the user; The self-checkout device according to any one of claims 1 to 5, further comprising a determination unit that determines an operation of the operation guide based on a detection result of the detection unit.

7. The self-checkout device according to claim 6, characterized in that the determination unit determines an operation of the operation guide when the fingertip approaches within a first distance from the surface of the first display surface.

8. The self-checkout device according to claim 7, characterized in that when the fingertip approaches within a second distance that is longer than the first distance from the surface of the first display surface, a mark is displayed at a position on the operation guide that is presumed to be pointed at by the fingertip.

Images