Article registration device and program

Abstract

To provide an article registration device and a program that can clearly guide an operator to an appropriate presentation position of a code symbol when the operator scans the code symbol attached to an article.SOLUTION: A self-service POS terminal (article registration device) includes: an image capturing unit that captures video including the appearance of an article held up by an operator; a code symbol recognition unit (recognition unit) that extracts a code symbol containing an article code affixed to the article from images composing the video captured by the image capturing unit, and recognizes the article code contained within the code symbol; an image display unit (display unit) that displays the image on a display device (display screen) visible to the operator; and a position guidance unit (guidance unit) that displays guidance information near the image to guide a position where the article is held to a correct position when the code symbol recognition unit cannot recognize the article code.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a product registration device and a program. [Background technology]

[0002] BACKGROUND ART Conventionally, there is known a code reading device that, when a code symbol reading fails, identifies the cause of the failure and provides audio guidance on how to improve the situation (for example, Patent Document 1).

[0003] Such conventional code readers issue voice messages such as "Move a little further to the right" or "Move a little closer." However, it is difficult for customers who hear such messages to immediately determine how to hold the product. Therefore, a more user-friendly guidance method has been desired. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem that the present invention aims to solve is to provide a product registration device and program that can clearly guide an operator to the appropriate presentation position of a code symbol when the operator reads the code symbol attached to a product. [Means for solving the problem]

[0005] The product registration device of the embodiment includes a photographing unit, a recognition unit, a display unit, and a guidance unit. The photographing unit captures video including the appearance of a product held by an operator. The recognition unit extracts a code symbol, including a product code, attached to the product from images constituting the video captured by the photographing unit and recognizes the product code contained in the code symbol. The display unit displays the video on a display screen visible to the operator. If the recognition unit cannot recognize the product code, the guidance unit displays guidance information near the video to guide the operator to an appropriate position to hold the product. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is an external view illustrating an example of a self-service POS terminal according to an embodiment. [Figure 2] FIG. 2 is a hardware block diagram showing an example of the hardware configuration of the self-checkout POS terminal. [Figure 3] FIG. 3 is a diagram showing an example of the basic configuration of a screen displayed on a display device. [Figure 4] FIG. 4 is a first diagram showing an example of a screen displayed on a display device when a code symbol attached to a product held over a fixed scanner is not read. [Figure 5] FIG. 5 is a second diagram showing an example of a screen displayed on the display device when the code symbol attached to the product held over the fixed scanner is not read. [Figure 6] FIG. 6 is a diagram showing an example of a screen displayed on a display device when a code symbol attached to a product held over a fixed scanner is read. [Figure 7] FIG. 7 is a diagram showing an example of a screen displayed on a display device when the same product code as that of a registered product is registered in the read code symbol. [Figure 8] FIG. 8 is a screen transition diagram showing an example of screen transition displayed on a display device. [Figure 9] FIG. 9 is a functional block diagram illustrating an example of a functional configuration of the self-checkout POS terminal according to the embodiment. [Figure 10] FIG. 10 is a flowchart illustrating an example of a processing flow when the self-checkout POS terminal according to the embodiment performs product registration. DETAILED DESCRIPTION OF THE INVENTION

[0007] (Explanation of the general configuration of the self-service POS terminal) A self-checkout POS terminal 10 according to an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is an external view showing an example of a self-checkout POS terminal according to an embodiment.

[0008] The self-service POS terminal 10 is a cashless payment machine operated by a customer in a store such as a retail shop to register and pay for products that the customer wishes to purchase. The self-service POS terminal 10 is an example of a product registration device in the present disclosure.

[0009] The self-service POS terminal 10 includes a display device 21 , an operation device 22 , a fixed scanner 23 , a handheld scanner 24 , a payment terminal 25 , a receipt printer 26 , and a speaker 27 .

[0010] The display device 21 displays various information related to a product registration process for registering products that a customer wishes to purchase, a payment process for making payments for registered products, etc. The display device 21 is, for example, a liquid crystal display or an organic EL display.

[0011] The operation device 22 acquires various pieces of customer operation information relating to product registration processing, payment processing, etc. The operation device 22 is, for example, a touch panel stacked on the display device 21.

[0012] The fixed scanner 23 is, for example, a camera-type scanner that reads a code symbol (a barcode or a two-dimensional code) in which a product code is registered, which is attached to a product held over the fixed scanner 23.

[0013] The handy scanner 24 is a scanner that reads the code symbols attached to products when registering products that are heavy or large, and whose code symbols are difficult to hold over the fixed scanner 23. The handy scanner 24 is, for example, a barcode reader.

[0014] The payment terminal 25 is a terminal device for making payments for registered products. The payment terminal 25 makes cashless payments using a payment method selected by the customer from a number of payment methods.

[0015] Specifically, the payment terminal 25 performs payment processing to settle the purchase price of a product using various payment methods, such as credit card payment, electronic money payment, code payment, and point payment. Credit card payment is a payment method in which the purchase price of a product is paid from a bank account registered to a credit card held by the customer. Electronic money payment is a payment method in which the purchase price of a product is paid from electronic money charged to a mobile device (e.g., a smartphone) or electronic money card held by the customer. Code payment is a payment method in which the purchase price of a product is paid using a payment app installed on a mobile device (e.g., a smartphone) held by the customer. Point payment is a payment method in which the purchase price of a product is paid from points registered on a mobile device (e.g., a smartphone) held by the customer or on the store's membership card, which the customer has earned based on the number of times they visit the store and the amount of purchases.

[0016] The payment terminal 25 includes a display device 251 , a numeric keypad 252 , and an IC card reader 253 .

[0017] The display device 251 is a liquid crystal display or an organic EL display that displays various information related to the payment process.

[0018] The ten-key pad 252 is an electronic or mechanical key that the customer operates when entering various personal identification numbers and the like related to the payment process.

[0019] When a customer uses an IC card to perform payment processing, the IC card reader 253 reads various information registered on the IC card, such as bank account information registered on the credit card.

[0020] In addition, the payment terminal 25 may further include a magnetic card reader that reads various information registered on the magnetic stripe of the card, a contactless card reader that reads various information registered on the card or mobile terminal via short-range wireless communication, etc.

[0021] The receipt printer 26 prints the results of the product registration process and the settlement process and issues them as a receipt.

[0022] The speaker 27 outputs various information relating to the product registration process and the payment process to the operator by outputting sounds and voices.

[0023] (Hardware configuration of self-service POS terminal) The hardware configuration of the self-checkout POS terminal 10 will be described with reference to Fig. 2. Fig. 2 is a hardware block diagram showing an example of the hardware configuration of the self-checkout POS terminal.

[0024] The self-service POS terminal 10 has a configuration in which a control unit 11, a storage unit 12, a peripheral device controller 14, and a communication controller 15 are interconnected via an internal bus 13.

[0025] The control unit 11 controls the overall operation of the self-service POS terminal 10. The control unit 11 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113. The CPU 111 is connected to the ROM 112 and the RAM 113 via internal buses such as an address bus and a data bus. The CPU 111 loads various programs stored in the ROM 112 and the storage unit 12 into the RAM 113. The CPU 111 controls the operation of the self-service POS terminal 10 by operating in accordance with the various programs loaded into the RAM 113. In other words, the control unit 11 has the configuration of a general computer.

[0026] The storage unit 12 is a storage device such as an HDD or SSD. Alternatively, the storage unit 12 may be a non-volatile memory such as a flash memory that retains stored information even when the power is turned off. The storage unit 12 stores a control program 121, a product master 122, a product registration file 123, and a payment file 124.

[0027] The control program 121 is a program that controls the overall operation of the self-checkout POS terminal 10. The control program 121 may be provided in a state stored in the storage unit 12, or may be provided by being recorded in an installable or executable file on a computer-readable non-transitory recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD. The control program 121 may also be provided by being stored on a computer connected to a network and downloaded via the network. Furthermore, the control program 121 may be provided or distributed via a network such as the Internet.

[0028] The product master 122 is a master file that stores product information such as product names and prices of products for sale. The product master 122 stores product names, unit prices, additional information, and the like in association with product codes. Note that the contents of the product master are updated as needed, so the self-service POS terminal 10 constantly updates the contents of the product master 122 to the latest state by, for example, acquiring the latest product master from a store server (not shown) via the communication controller 15.

[0029] The product registration file 123 is a file that stores registered product information (for example, product name, quantity, unit price, etc.) in association with a transaction code that identifies one transaction.

[0030] The settlement file 124 is a file that stores the settlement details (for example, the settlement date and time, the settlement method, the settlement amount, etc.) of the transaction in association with the transaction code.

[0031] The control unit 11 is connected to a display device 21, an operation device 22, a fixed scanner 23, a handheld scanner 24, a payment terminal 25, a receipt printer 26, and a speaker 27, which input and output various types of information, via a peripheral device controller 14. The outline of each input / output device has been described above, so a repeated explanation will be omitted.

[0032] The control unit 11 also communicates with a store server (not shown) via the communication controller 15. The self-service POS terminal 10 acquires the latest product master 122 from the store server. The self-service POS terminal 10 also periodically outputs, for example, a product registration file 123 and a settlement file 124 indicating transaction history to the store server.

[0033] (Screen configuration displayed on display device) The basic configuration of a screen displayed on the display device 21 of the self-checkout POS terminal 10 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the basic configuration of a screen displayed on the display device.

[0034] When "Start product registration" is selected on a menu screen (not shown) of the self-checkout POS terminal 10, the self-checkout POS terminal 10 displays a product registration screen 41 on the display device 21.

[0035] FIG. 3 shows the product registration screen 41 in a state where one product A has been registered.

[0036] The product registration screen 41 includes guidance information 42, a product list 43, a total amount 44, a checkout button 45, a handy scanner button 46, a store clerk call button 47, and a cancel button 48.

[0037] The area of ​​the guidance information 42 displays various information related to how to operate the self-service POS terminal 10. Fig. 3 shows an example in which guidance related to how to register a product is displayed in the area of ​​the guidance information 42. For example, when the self-service POS terminal 10 performs payment processing, guidance related to the payment method is displayed in the area of ​​the guidance information 42.

[0038] The product list 43 area displays product information (product name, quantity, price) of currently registered products. As the number of registered products increases, it becomes impossible to display them all on one screen, so product information for previously registered products is sequentially scrolled upward and disappears from the screen. When checking product information for products that have disappeared from the screen, the operator can page forward or backward through the product list 43 by tapping the scroll button located on the right side of the product list 43 area. The scroll button may function as a page forward button, or as a list forward button that scrolls the product list 43 line by line.

[0039] The total amount 44 column displays the total amount of the products currently registered.

[0040] The checkout button 45 is an operator that instructs the start of payment (checkout) for registered products. When the checkout button 45 is tapped, the self-service POS terminal 10 displays a payment method selection screen (not shown) on the display device 21, which allows the user to select a payment method.

[0041] The handy scanner button 46 is an operator that enables the use of the handy scanner 24. When the handy scanner button 46 is tapped, the self-service POS terminal 10 enables the handy scanner 24. The operator uses the handy scanner 24 to read the code symbol of a heavy or large item.

[0042] The store clerk call button 47 is an operator for calling a store clerk. When the store clerk call button 47 is tapped, the self-service POS terminal 10 turns on a warning light (not shown) and calls for help from a nearby store clerk. When the store clerk notices that the warning light is on, he rushes to the self-service POS terminal 10 and assists the operator.

[0043] The cancel button 48 is an operator for instructing to cancel the product registration operation. When the cancel button 48 is tapped, the self-service POS terminal 10 cancels the product registration operation and discards all of the product list 43 registered at that time. The cancel button 48 may be assigned a function for discarding only the registration information of the product that was registered immediately before.

[0044] Returning to the guidance information 42. When product registration starts, the operation method for registering a product is displayed in the area of ​​the guidance information 42. Specifically, when the code symbol (barcode) attached to the product to be purchased is held over the fixed scanner 23, a beep sounds and a notification that the product will be registered is heard.

[0045] (Screen displayed when code symbol cannot be read) 4 and 5, the contents of the screen displayed on the display device 21 by the self-service POS terminal 10 when the code symbol attached to a product held over the fixed scanner 23 cannot be read will be described. Fig. 4 is a first diagram showing an example of the screen displayed on the display device when the code symbol attached to a product held over the fixed scanner cannot be read. Fig. 5 is a second diagram showing an example of the screen displayed on the display device when the code symbol attached to a product held over the fixed scanner cannot be read.

[0046] When registering a product, the operator holds the code symbol (hereinafter referred to as a barcode) attached to the product over the fixed scanner 23. At this time, the self-checkout POS terminal 10 displays a barcode reading screen 51 shown in FIG. 4 on the display device 21.

[0047] Barcode reading screen 51 displays image 521 and guidance information 522 in the area of ​​guidance information 42 on product registration screen 41 (see FIG. 3) described above.

[0048] Image 521 is an image captured by a camera (not shown) built into fixed scanner 23. Image 521 is an image captured by the camera displayed at a video rate (for example, 30 frames per second). In other words, image 521 is a moving image. Note that image 521 may also be a moving image in which video-rate image is frame-dropped at a predetermined timing. Furthermore, the camera (not shown) built into fixed scanner 23 may be a monochrome camera or a color camera. However, since the image captured by the camera is presented to the operator of self-service POS terminal 10, it is desirable to use a color camera to make the products shown in the image easier to understand.

[0049] FIG. 4 shows an example in which the image captured by the camera is blurred, making it impossible for the fixed scanner 23 to recognize the barcode.

[0050] The guidance information 522 is information that guides the operator of the self-service POS terminal 10 to hold the product in an appropriate position. In the example of FIG. 4, the guidance displayed is, "Move the product forward, backward, left, or right so that the barcode appears on the screen." The operator of the self-service POS terminal 10 checks the guidance information 522 and adjusts the position where the product is held forward, backward, left, or right. Then, the image 521 changes in accordance with the change in the position where the product is held, so the operator can hold the barcode in an appropriate position while looking at the image 521. When the barcode is held in an appropriate position, the fixed scanner 23 recognizes the barcode. Then, the self-service POS terminal 10 displays a barcode recognition screen 71 (see FIG. 6), which will be described later, on the display device 21.

[0051] A barcode reading screen 61 shown in FIG. 5 shows an example in which the barcode of a product is out of frame in the image captured by the fixed scanner 23.

[0052] Barcode reading screen 61 displays image 621 and guidance information 622. The operator of self-service POS terminal 10 checks the guidance information 622 and adjusts the position where the product is held up, forward, backward, left or right. As a result, image 621 changes in accordance with the change in the position where the product is held up, so the operator can hold the barcode up in an appropriate position while looking at image 621. When the barcode is held up in an appropriate position, fixed scanner 23 recognizes the barcode. Then, self-service POS terminal 10 displays barcode recognition screen 71 (see FIG. 6 ), which will be described later, on display device 21.

[0053] Image 521 on barcode reading screen 51 and image 621 on barcode reading screen 61 are displayed so that when the operator of self-service POS terminal 10 moves the position where the product is held to the left relative to self-service POS terminal 10, the product shown in image 521 and image 621 moves in the same direction, i.e., to the left of display device 21.

[0054] Similarly, images 521 and 621 on the barcode reading screen 51 are displayed so that when the operator of the self-service POS terminal 10 moves the position where the product is held to the right relative to the self-service POS terminal 10, the products shown in images 521 and 621 move in the same direction, i.e., to the right of the display device 21.

[0055] Furthermore, images 521 and 621 on the barcode reading screen 51 are displayed so that when the operator of the self-service POS terminal 10 moves the position where the product is held up (down) relative to the self-service POS terminal 10, the products shown in images 521 and 621 move in the same direction, i.e., up (down) on the display device 21.

[0056] More specifically, a camera (not shown) built into the fixed scanner 23 flips the captured image horizontally and displays it on the display device 21. If the camera built into the fixed scanner 23 is equipped with a function for outputting images in horizontal inversion in advance, the self-POS terminal 10 is used with this function enabled (i.e., in a state where horizontal inversion output is performed).

[0057] (Example of the screen that appears when a code symbol is read) 6, the contents of the screen displayed on the display device 21 by the self-service POS terminal 10 when the code symbol attached to a product held over the fixed scanner 23 is read will be described. Fig. 6 is a diagram showing an example of the screen displayed on the display device when the code symbol attached to a product held over the fixed scanner is read.

[0058] When the fixed scanner 23 reads the barcode of the product, the self-checkout POS terminal 10 displays a barcode recognition screen 71 shown in FIG.

[0059] The barcode recognition screen 71 includes an image 721 , product information 722 , a product list 76 , and a total price 77 .

[0060] The image 721 is an original image that is used to recognize the barcode by the self-checkout POS terminal 10. That is, the image 721 is a still image. The image 721 includes a barcode area 73 and recognition completion information 74.

[0061] The barcode area 73 is an area that the self-service POS terminal 10 recognizes as a barcode area in the image 721. More specifically, the self-service POS terminal 10 displays a rectangular area that includes the area recognized as a barcode, superimposed on the image captured by the fixed scanner 23.

[0062] The recognition completion information 74 is information indicating that the self-service POS terminal 10 has successfully recognized the barcode. In Fig. 6, "OK" is displayed near the barcode area 73 as the recognition completion information 74, but this is not limited to this. For example, "recognition completed", "◯", etc. may be displayed as the recognition completion information 74.

[0063] The image 721 is displayed for a predetermined time (for example, two seconds). The self-checkout POS terminal 10 temporarily suspends barcode reading by the fixed scanner 23 while the image 721 is displayed. Therefore, while the image 721 is displayed, the image 721 does not change even if the operator moves the product or holds a new product over the fixed scanner 23.

[0064] The product information 722 is the product name and price of the product corresponding to the product code registered in the barcode read by the self-checkout POS terminal 10. The operator checks the product information 722 to confirm that the barcode has been read correctly.

[0065] In the product list 76, information about the newly recognized product (product B in the example of FIG. 6) is added to the existing product list. Then, in the total price 77, the total price of the currently registered products, including product B, is displayed.

[0066] The self-checkout POS terminal 10 outputs a beep 75 from the speaker 27 at the timing when the barcode recognition screen 71 is displayed, thereby notifying the operator of the self-checkout POS terminal 10 that the barcode has been recognized.

[0067] When the aforementioned predetermined time has elapsed since the barcode recognition screen 71 was displayed, the self-service POS terminal 10 resumes reading of the barcode with the fixed scanner 23. Then, the self-service POS terminal 10 again displays the barcode reading screen 51 or the barcode reading screen 61 on the display device 21. The operator of the self-service POS terminal 10 holds the next product over the fixed scanner 23 to have the barcode read.

[0068] (Another example of what will appear when a code symbol is read) 7, another example of a screen displayed on the display device 21 by the self-service POS terminal 10 when a code symbol attached to a product held over the fixed scanner 23 is read will be described. Fig. 7 is a diagram showing an example of a screen displayed on the display device when the same product code as that of a registered product is registered in the read code symbol.

[0069] If the product corresponding to the barcode read by the fixed scanner 23 has already been registered, the self-checkout POS terminal 10 displays a barcode recognition screen 81 shown in FIG.

[0070] The barcode recognition screen 81 includes an image 821 , product information 822 , a product list 86 , and a total price 87 .

[0071] The image 821 is the original image that is used to recognize the barcode by the self-checkout POS terminal 10. That is, the image 821 is a still image. The image 821 includes a barcode area 83 and recognition completion information 84.

[0072] The barcode area 83 is an area that the self-service POS terminal 10 recognizes as a barcode area in the image 821. More specifically, the self-service POS terminal 10 displays a rectangular area that includes the area recognized as a barcode, superimposed on the image captured by the fixed scanner 23.

[0073] The recognition completion information 84 is information indicating that the self-service POS terminal 10 has successfully recognized the barcode. Note that Fig. 7 shows a display example in the case where a product with the same product code as the product code registered in the recognized barcode has already been registered. In other words, the self-service POS terminal 10 determines that a total of two products B have been registered because one product B recognized this time has already been registered, and displays "x2" near the barcode area 83 as the recognition completion information 84, indicating that two products of the same product have been registered. Note that the display format of the recognition completion information 84 is not limited to the format shown in Fig. 7, and other formats may be used.

[0074] Image 821 is displayed for a predetermined time (for example, 2 seconds). While image 821 is displayed, self-checkout POS terminal 10 temporarily suspends barcode reading by fixed scanner 23. Therefore, while image 821 is displayed, image 821 does not change even if the operator moves the product or holds a new product over fixed scanner 23.

[0075] The product information 822 is the product name and price of the product corresponding to the product code registered in the barcode read by the self-service POS terminal 10. The operator checks the product information 822 to confirm that the barcode has been read correctly. Note that Fig. 7 shows an example of product information 822 that displays information indicating that two identical products B have been registered.

[0076] In the product list 86, information about the newly recognized product (the second product B in the example of FIG. 7) is added to the previous product list. Then, since the registered number of products B becomes two, the self-service POS terminal 10 merges the information about product B in the product list into one line and redisplays the product number as two. Then, the total price 87 displays the total price of the products currently registered.

[0077] The self-checkout POS terminal 10 outputs a beep 85 from the speaker 27 at the timing when the barcode recognition screen 81 is displayed, thereby notifying the operator of the self-checkout POS terminal 10 that the barcode has been recognized.

[0078] When the aforementioned predetermined time has elapsed since the barcode recognition screen 81 was displayed, the self-service POS terminal 10 resumes reading of the barcode with the fixed scanner 23. Then, the self-service POS terminal 10 again displays the barcode reading screen 51 or the barcode reading screen 61 on the display device 21. The operator of the self-service POS terminal 10 holds the next product over the fixed scanner 23 to have the barcode read.

[0079] (Screen transitions displayed on the self-service POS terminal when registering a product) The screen transitions displayed on the display device 21 when the self-service POS terminal 10 of the embodiment performs product registration will be described with reference to Fig. 8. Fig. 8 is a screen transition diagram showing an example of the screen transitions displayed on the display device.

[0080] In a state (state 91) in which the product registration screen 41 (see FIG. 3) is displayed on the display device 21, the fixed scanner 23 reads a barcode, and if the barcode is not recognized as a result, the self-checkout POS terminal 10 displays a barcode reading screen 51 (see FIG. 4) or a barcode reading screen 61 (see FIG. 5) on the display device 21. That is, the state of the display device 21 transitions from state 91 to state 92 via an arc 911.

[0081] Furthermore, in a state (state 91) in which the product registration screen 41 (see FIG. 3) is displayed on the display device 21, if the fixed scanner 23 reads a barcode and the barcode is recognized as a result, the self-checkout POS terminal 10 displays the barcode recognition screen 71 (see FIG. 6) or the barcode recognition screen 81 (see FIG. 7) on the display device 21. That is, the state of the display device 21 transitions from state 91 to state 93 via arc 914.

[0082] Next, in a state (state 92) in which the barcode reading screen 51 or the barcode reading screen 61 is displayed on the display device 21, the fixed scanner 23 reads the barcode, and if the barcode is not recognized as a result, the self-service POS terminal 10 again displays the barcode reading screen 51 or the barcode reading screen 61 on the display device 21. That is, the state of the display device 21 transitions from state 92 to state 92 via arc 912.

[0083] Furthermore, in a state (state 92) in which the barcode reading screen 51 or the barcode reading screen 61 is displayed on the display device 21, if the fixed scanner 23 reads a barcode and the barcode is recognized as a result, the self-service POS terminal 10 displays the barcode recognition screen 71 or the barcode recognition screen 81 on the display device 21. That is, the state of the display device 21 transitions from state 92 to state 93 via arc 913.

[0084] Next, in a state (state 93) in which the barcode recognition screen 71 or the barcode recognition screen 81 is displayed on the display device 21, the fixed scanner 23 reads the barcode after a predetermined time has elapsed, and if the barcode is not recognized as a result, the self-service POS terminal 10 displays the barcode reading screen 51 or the barcode reading screen 61 on the display device 21. That is, the state of the display device 21 transitions from state 93 to state 92 via arc 915.

[0085] Furthermore, in a state (state 93) in which the barcode recognition screen 71 or the barcode recognition screen 81 is displayed on the display device 21, if the fixed scanner 23 reads the barcode after a predetermined time has elapsed and the barcode is recognized as a result, the self POS terminal 10 again displays the barcode recognition screen 71 or the barcode recognition screen 81 on the display device 21. That is, the state of the display device 21 transitions from state 93 to state 93 via arc 916.

[0086] Furthermore, when the checkout button 45 or the cancel button 48 is tapped while the barcode recognition screen 71 or the barcode recognition screen 81 is displayed on the display device 21 (state 93), the self-service POS terminal 10 ends the product registration process.

[0087] (Functional configuration of self-service POS terminal) The functional configuration of the self-checkout POS terminal 10 of the embodiment will be described with reference to Fig. 9. Fig. 9 is a functional block diagram showing an example of the functional configuration of the self-checkout POS terminal of the embodiment.

[0088] The control unit 11 of the self-service POS terminal 10 deploys and operates the control program 121 in the RAM 113, thereby realizing as functional units the video capture unit 31, code symbol recognition unit 32, video display unit 33, presentation position guidance unit 34, recognition status display unit 35, product registration unit 36, product registration information display unit 37, and payment processing unit 38 shown in Fig. 9. Note that some or all of these functional units may be realized by dedicated hardware.

[0089] On the condition that product registration has started, the video capturing unit 31 captures a video including the appearance of the product held over the fixed scanner 23. The start of product registration is determined, for example, by selecting "Start product registration" on a menu screen (not shown) of the self-service POS terminal 10.

[0090] The code symbol recognition unit 32 extracts a code symbol including a product code attached to a product from the images constituting the video captured by the video capturing unit 31, and recognizes the product code included in the code symbol. The code symbol recognition unit 32 is an example of a recognition unit in the present disclosure.

[0091] The video display unit 33 displays the videos 521 and 621 on the display device 21 (display screen) that can be viewed by the operator. The video display unit 33 is an example of the display unit in the present disclosure.

[0092] When the code symbol recognition unit 32 cannot recognize the product code, the presentation position guidance unit 34 displays guidance information 522, 622 near the image to guide the user to an appropriate position to hold the product. The presentation position guidance unit 34 is an example of a guidance unit in the present disclosure.

[0093] When the code symbol recognizing unit 32 extracts a code symbol, the recognition status display unit 35 displays an image of the code symbol extracted by the code symbol recognizing unit 32 (image 721 in FIG. 6) and information related to the code symbol superimposed on the image on the display device 21. The information related to the code symbol is, for example, the position of the extracted code symbol (barcode area 73 in FIG. 6) and information indicating that the code symbol has been recognized (recognition completion information 74 in FIG. 6). Furthermore, the recognition status display unit 35 outputs a beep from the speaker 27 when the code symbol is recognized.

[0094] The product registration unit 36 ​​registers the product corresponding to the product code registered in the code symbol recognized by the code symbol recognition unit 32 as a product to be purchased in the product registration file 123. In addition, the product registration unit 36 ​​determines whether the product corresponding to the currently recognized product code has already been registered in the same transaction.

[0095] The product registration information display unit 37 displays on the display device 21 product information (product name, quantity, price, etc.) of the product corresponding to the product code registered in the code symbol recognized by the code symbol recognition unit 32 (product information 722 in FIG. 6). Furthermore, when multiple products with the same product code are registered in the same transaction, the product registration information display unit 37 displays on the display device 21 the total number of registrations of the products (recognition completion information 84 in FIG. 7) superimposed on the image 721.

[0096] The payment processing unit 38 performs payment for the product registered in the product registration file 123 on the condition that the checkout button 45 is tapped.

[0097] (Product registration process performed by self-service POS terminal) The flow of the product registration process performed by the self-checkout POS terminal 10 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of the flow of the product registration process performed by the self-checkout POS terminal of the embodiment.

[0098] The video shooting unit 31 determines whether product registration has started (step S11). If it is determined that product registration has started (step S11: Yes), the process proceeds to step S12. On the other hand, if it is not determined that product registration has started (step S11: No), step S11 is repeated.

[0099] When it is determined in step S11 that product registration has started, the video capturing unit 31 causes the camera built into the fixed scanner 23 to capture an image (step S12).

[0100] The code symbol recognition unit 32 determines whether a code symbol can be extracted from an image constituting the video captured by the video capture unit 31 (step S13). If it is determined that a code symbol can be extracted (step S13: Yes), the process proceeds to step S14. On the other hand, if it is not determined that a code symbol can be extracted (step S13: No), the process proceeds to step S23.

[0101] In step S13, if it is determined that a code symbol is extracted from an image constituting the video captured by the video capturing unit 31, the code symbol recognizing unit 32 recognizes the product code registered in the extracted code symbol (step S14).

[0102] When the code symbol recognizing unit 32 extracts a code symbol, the recognition state display unit 35 displays an image (still image) of the extracted code symbol on the display device 21 (step S15).

[0103] Next, the recognition state display unit 35 displays the position of the extracted code symbol and information indicating that the code symbol has been recognized, superimposed on the still image displayed in step S15 (step S16).

[0104] The recognition status display unit 35 outputs a beep from the speaker 27 to indicate that the barcode has been successfully recognized (step S17).

[0105] The product registration unit 36 ​​determines whether the product corresponding to the recognized product code has already been registered in the same transaction (step S18). If it is determined that the product corresponding to the recognized product code has already been registered in the same transaction (step S18: Yes), the process proceeds to step S19. On the other hand, if it is not determined that the product corresponding to the recognized product code has already been registered in the same transaction (step S18: No), the process proceeds to step S20.

[0106] In step S18, if it is determined that the product corresponding to the recognized product code has already been registered in the same transaction, the product registration information display unit 37 displays the total number of registrations of the product on the display device 21 (recognition completion information 84 in FIG. 8) (step S19). Then, the process proceeds to step S20.

[0107] In step S18, if it is determined that the product corresponding to the recognized product code has already been registered in the same transaction, or following step S19, the product registration information display unit 37 displays product information (product name, quantity, price, etc.) of the product corresponding to the product code registered in the code symbol recognized in step S14 on the display device 21 (product information 722 in Figure 6, product information 822 in Figure 7) (step S20).

[0108] The product registration unit 36 ​​performs a product registration process to register the product corresponding to the recognized product code in the product registration file 123 (step S21).

[0109] The payment processing unit 38 determines whether the checkout button 45 has been tapped (step S22). If it is determined that the checkout button 45 has been tapped (step S22: Yes), the self-service POS terminal 10 ends the product registration process and performs payment processing (not shown). On the other hand, if it is not determined that the checkout button 45 has been tapped (step S22: No), the process returns to step S12.

[0110] The process returns to step S 13. If it is determined in step S13 that the code symbol is not extracted, the video display unit 33 displays the videos 521 and 621 on the display device 21 (step S23).

[0111] Next, the presentation position guide unit 34 displays the guide information 522, 622 on the display device 21 (step S24).

[0112] (Modification of the embodiment) Various modifications are possible to the self-checkout POS terminal 10. For example, the self-checkout POS terminal 10 may further include a change dispenser to enable cash payment.

[0113] Furthermore, the self-service POS terminal 10 may be used simply as a product registration device for registering products, without the payment function. The operator who registers products may not only be a customer, but also a store clerk. By registering products using a product registration device based on the present disclosure, an inexperienced store clerk can become familiar with the operation method for having the fixed scanner 23 read code symbols.

[0114] Furthermore, the self-checkout POS terminal 10 may recognize the state of the image captured by the fixed scanner 23 in more detail and present more detailed guide information 522, 622.

[0115] For example, the self-service POS terminal 10 may add an autofocus function to a camera (not shown) built into the fixed scanner 23 to measure the distance from the camera to a product held over the fixed scanner 23. If the measured distance is greater than a preset threshold, the self-service POS terminal 10 may present guidance information such as "Please move the product closer" to the operator. If the measured distance is less than the preset threshold, the self-service POS terminal 10 may present guidance information such as "Please move the product farther away" to the operator.

[0116] In addition, if the barcode (code symbol) displayed in the image captured by the fixed scanner 23 overlaps with the edge of the screen (is out of frame), the self-POS terminal 10 may display guidance information such as "Please move the barcode up, down, left, or right so that the entire barcode is displayed on the screen."

[0117] As described above, the self-service POS terminal 10 (product registration device) of the embodiment includes a video capture unit 31 that captures a video including the appearance of a product held by an operator, a code symbol recognition unit 32 (recognition unit) that extracts a code symbol including a product code attached to the product from the image constituting the video captured by the video capture unit 31 and recognizes the product code included in the code symbol, a video display unit 33 (display unit) that displays video 521, 621 on a display device 21 (display screen) visible to the operator, and a presentation position guidance unit 34 (guidance unit) that displays guidance information 522, 622 near the video 521, 621 to guide the operator to an appropriate position to hold the product when the code symbol recognition unit 32 cannot recognize the product code. Therefore, when the operator has the code symbol attached to the product read, the operator can be easily guided to an appropriate presentation position for the code symbol.

[0118] Furthermore, the self-checkout POS terminal 10 (product registration device) of the embodiment further includes a recognition status display unit 35 that, when the code symbol recognition unit 32 (recognition unit) extracts a code symbol, displays on the display device 21 (display screen) an image 721 of the code symbol extracted by the code symbol recognition unit 32 and information related to the code symbol superimposed on the image 721. Therefore, the operator of the self-checkout POS terminal 10 can immediately recognize that the code symbol has been read.

[0119] Furthermore, in the self-checkout POS terminal 10 (product registration device) of the embodiment, the information related to the code symbol includes at least the position of the extracted code symbol (barcode area 73) and information indicating that the code symbol has been recognized (recognition completion information 74). Therefore, the operator of the self-checkout POS terminal 10 can immediately recognize that the code symbol has been read.

[0120] Moreover, the self-service POS terminal 10 (product registration device) of the embodiment further includes a product registration information display unit 37 that displays product information 722 of the product corresponding to the product code included in the recognized code symbol near the image 721 displayed by the recognition status display unit 35. Therefore, the operator of the self-service POS terminal 10 can check the product information of the registered product without looking over the product lists 76, 86 displayed on the display device 21.

[0121] Furthermore, in the self-checkout POS terminal 10 (product registration device) of the embodiment, if a product corresponding to the product code included in the recognized code symbol has already been registered, the product registration information display unit 37 displays the total number of registered products (recognition completion information 84) by superimposing it on the image 721. Therefore, the operator of the self-checkout POS terminal 10 can immediately check the number of registered products of the same product.

[0122] Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. This novel embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as set forth in the claims. [Explanation of symbols]

[0123] 10 Self-service POS terminal (product registration device) 21 Display device (display screen) 22 Operating Devices 23 Fixed Scanner 24 Handy Scanner 25 Payment terminals 251 Display Devices 252 10-key 253 IC card reader 26 Receipt Printer 27 Speaker 31 Videography Department 32 Code symbol recognition unit (recognition unit) 33 Video display unit (display unit) 34 Presentation position guide section (guidance section) 35 Recognition status display section 36 Product Registration Department 37 Product registration information display section 38 Payment Processing Unit 41 Product registration screen 42 Guidance Information 43 Product List 44 Total Amount 45 Checkout button 46 Handy scanner button 47 Staff call button 48 Stop button 51 Barcode reading screen 521 Video 522 Information 61 Barcode reading screen 621 Video 622 Information 71 Barcode Recognition Screen 721 images 722 Product information 73 Barcode Area 74 Recognition completion information 75 beeps 76 Product List 77 Total Amount 81 Barcode Recognition Screen 821 images 822 Product information 83 Barcode Area 84 Recognition completion information 85 beeps 86 Product List 87 Total Amount [Prior art documents] [Patent documents]

[0124] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-152633

Claims

1. a video capture unit that captures a video including the appearance of a product held over by an operator; a recognition unit that extracts a code symbol including a product code attached to the product from an image constituting the video captured by the video capture unit and recognizes the product code included in the code symbol; a display unit that displays the image on a display screen that is visible to the operator; and a guidance unit that displays guidance information near the image to guide the user to an appropriate position to hold the product when the recognition unit cannot recognize the product code. Product registration device.

2. a recognition status display unit that displays, when the recognition unit extracts the code symbol, an image of the code symbol extracted by the recognition unit and information related to the code symbol superimposed on the image on the display screen. The product registration device according to claim 1 .

3. The information relating to the code symbol is The extracted code symbol includes at least the location of the extracted code symbol and information indicating that the code symbol has been recognized. The product registration device according to claim 2.

4. a product registration information display unit that displays product information of a product corresponding to a product code included in the recognized code symbol near the image displayed by the recognition status display unit, The product registration device according to claim 2.

5. the product registration information display unit further displays, when a product corresponding to the product code included in the recognized code symbol is already registered, the total number of registered products of the product in question superimposed on the image. The product registration device according to claim 4.

6. A computer that controls the product registration device a video capture unit that captures a video including the appearance of a product held over by an operator; a recognition unit that extracts a code symbol including a product code attached to the product from an image constituting the video captured by the video capture unit and recognizes the product code included in the code symbol; a display unit that displays the image on a display screen that is visible to the operator; When the recognition unit cannot recognize the product code, the recognition unit functions as a guidance unit that displays guidance information near the image to guide the user to an appropriate position to hold the product. program.

Images