Self-register system

The self-checkout system integrates customer monitoring and clerk call features through separate payment and monitoring images, addressing the need for minimal software modifications and cost-effective functionality addition.

JP2024162359APending Publication Date: 2024-11-21KK VISUAL JAPAN
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023077775
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Existing self-checkout systems require significant software and hardware modifications to add functions like a clerk call button and surveillance camera indication, which are costly and time-consuming.

Method used

A self-checkout system that generates separate payment and monitoring images using a first and second skin application, allowing easy addition of functions without extensive software modifications, utilizing a surveillance camera and display unit to provide customer monitoring and clerk call functionality.

Benefits of technology

Enables easy integration of customer monitoring and clerk call features with minimal software changes, reducing operational costs and time, while maintaining a user-friendly interface and enhancing security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162359000001_ABST
    Figure 2024162359000001_ABST
Patent Text Reader

Abstract

To provide a self-register system that minimizes modification of software and can facilitate addition of a function.SOLUTION: A self-register system 1 includes: a POS application 213a and a first skin application 213b to be operated by a customer to generate an adjustment image having an operator image to which a function concerning adjustment of a commodity to be purchased is allocated; and a second skin application 213c that generates a monitoring image including a preview image 223a picked up by a camera 51 and a clerk call button 223b. The self-register system 1 also includes a display 22 on which the adjustment image and the monitoring image are displayed.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a self-checkout system in which a customer himself / herself pays for products he / she purchases. [Background technology]

[0002] 2. Description of the Related Art Self-checkout systems have been known that include a scanner or the like that allows a customer to scan product information in order to settle the payment for the products he or she purchases.

[0003] In the above-mentioned self-checkout system, for example, Patent Document 1 describes that when the store clerk call button on the self-payment terminal is pressed, a police light on the self-payment terminal flashes, allowing inexperienced customers to be dealt with immediately.

[0004] Patent document 2 also describes a self-checkout monitoring system that is equipped with a surveillance camera installed in a position that can continuously capture an area that includes the reach of both hands of a self-checkout user as the target area. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-205023 A [Patent Document 2] Patent No. 7039084 Summary of the Invention [Problem to be solved by the invention]

[0006] The above-mentioned store clerk call button is often provided on the operation screen of the self-checkout. Also, a display indicating that the surveillance camera is in operation is often provided on the operation screen of the self-checkout. In other words, these functions are built into the software of the self-checkout. Therefore, if software that did not have the above-mentioned functions was used until now, it was necessary to change or modify the software. Therefore, it was not easy to add functions because it required labor and cost.

[0007] It is also possible to configure the store clerk call button and the indicator showing that the surveillance camera is in operation using physical buttons or independent lamps, but this would require hardware modifications or equipment replacement, which is problematic in terms of labor and cost.

[0008] The present invention is intended to solve the above-mentioned problems, and has an object to provide a self-checkout system that allows functions to be easily added while minimizing software modifications. [Means for solving the problem]

[0009] The invention described in claim 1, which has been made to solve the above problem, is a self-checkout system characterized by comprising a first processing unit that generates a settlement image having an operator image that is operated by a customer and has a function related to the settlement of the purchased items assigned to it, a second processing unit that generates a surveillance image that includes at least one of an image indicating that the customer is being photographed by a surveillance camera and an image for a call operation to call a store clerk, and a display unit on which the settlement image and the surveillance image are displayed. Effect of the Invention

[0010] As described above, according to the present invention, the settlement image and the monitoring image are generated and displayed as separate images, so there is no need to modify the settlement image, and functions can be easily added with minimal modifications. [Brief description of the drawings]

[0011] [Figure 1] 1 is an external perspective view of a self-checkout system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a functional configuration diagram of the self-checkout system shown in FIG. 1. [Diagram 3] FIG. 2 is an explanatory diagram of a hierarchical structure of a first skin application, a second skin application, a POS application, hardware, etc.; [Figure 4] FIG. 13 is an explanatory diagram of the relationship between the store clerk screen and the self-checkout screen. [Diagram 5] FIG. 13 is an explanatory diagram of the relationship between the self-checkout screen and the monitoring / calling image. [Figure 6] 13A and 13B are diagrams showing specific examples of a preview screen and a store clerk call button. [Figure 7] 2 is a first example of the operation of the self-checkout system shown in FIG. 1. [Figure 8] 2 is a second example of the operation of the self-checkout system shown in FIG. 1. [Figure 9] 3 is a third example of the operation of the self-checkout system shown in FIG. 1. [Figure 10] 1 is a configuration example of a network system having a plurality of self-checkout systems and a server device. [Figure 11] 2 is a modified example of the self-checkout system shown in FIG. 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] A self-checkout system according to one embodiment of the present invention will be described with reference to Figures 1 to 10. Figure 1 is an external perspective view of a self-checkout system 1 according to one embodiment of the present invention.

[0013] The self-checkout system 1 includes a register device 2, a housing 3, a scanner 4, and posts 5 and 6.

[0014] The cash register 2 includes a main body 21 and a display 22. The cash register 2 functions as a cash register with POS functions by a POS application 213a described later. The main body 21 performs the overall settlement process for purchasing products. The main body 21 also communicates with the housing 3, and product information, information on the amount inserted, and the like are input. The main body 21 also issues instructions to an automatic change dispenser 34 (described later) included in the housing 3 to dispense change, and the like, based on the results of operation of the display 22.

[0015] The main body 21 also includes a receipt printer 23 (see FIG. 2). The receipt printer 23 prints receipts that include information such as the name of the purchased product, the unit price of the product, the deposit amount, and the amount of change.

[0016] Display unit 22 displays various operation screens (self-checkout screen 222 described later) for allowing a customer to settle the account for purchased items. This self-checkout screen 222 functions as a second image as described later, and display unit 22 functions as an image display unit. Display unit 22 is configured with, for example, a liquid crystal display, but does not have a touch panel function. This is because it has a function to replace a touch panel using motion sensor 52 as described later. Note that display unit 22 may be a touch panel, in which case the functions described later can be omitted.

[0017] The cash register 2 is installed on the top surface of the housing 3. Similarly, a scanner 4 and pillars 5 and 6 are also installed on the top surface. The housing 3 is equipped with an automatic change machine 34 (see also FIG. 2) consisting of a coin handling device 34a and a banknote handling device 34b. The housing 3 also has a banknote insertion slot, a banknote withdrawal slot, a coin insertion slot, a coin return slot, a coin withdrawal slot, etc. on the exterior, which serves as the operation surface for customers.

[0018] The housing 3 also includes a processing device 31 (see also FIG. 2) configured by, for example, a small PC (Personal Computer), etc. The processing device 31 identifies the gender and age of the customer from the customer image captured by the camera 51 using a well-known method.

[0019] Furthermore, the processing device 31 identifies which position on the display unit 22 the fingertip is pointing to, based on the position and moving direction of the fingertip detected by the motion sensor 52. The position of the fingertip may be identified by a well-known method.

[0020] The processor 31 is also connected to a microphone 32 and a speaker 33 (see also FIG. 2) and outputs necessary sounds during a series of processes from product input to payment. For example, in this embodiment, it outputs audio guidance to encourage smooth product input, and outputs a warning sound if any irregularity occurs, such as a failure to input a product.

[0021] Furthermore, when a store clerk call button described later is operated, the processor 31 lights (or blinks) the lighting unit 61 to call a store clerk. Note that the control of lighting the lighting unit 61 by the store clerk call button may be performed by a control device or the like separate from the processor 31.

[0022] The microphone 32 and the speaker 33 are provided at positions where the voice of the user of the housing 3 can be easily acquired and where the user can easily hear. The microphone 32 and the speaker 33 are also used when providing voice guidance based on the result of fingertip position identification by the motion sensor 52 and the result of face recognition by the camera 51.

[0023] The scanner 4 reads the barcode attached to the product by irradiating the product with a laser scanning line, or by using a CCD (Charge Coupled Device) scanner, etc. The scanner 4 can also scan any card with a barcode attached, such as a membership card or a point card.

[0024] The support pillar 5 extends upward from the top surface of the housing 3 and is bent diagonally upward toward the customer side. The support pillar 5 is provided with a camera 51 in the middle and a motion sensor 52 at the tip.

[0025] The camera 51 is a camera (surveillance camera) for capturing images of customers, and is a camera module having a CCD image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

[0026] The motion sensor 52 detects the shape and movement direction of the customer's fingers. In this embodiment, the motion sensor 52 is configured with a camera.

[0027] The support pillar 6 extends upward from the upper surface of the housing 3. At the tip of the support pillar 6, a lighting unit 61 is provided that lights up (or flashes) in, for example, blue or red.

[0028] In the cash register 2, a CPU 211 (see FIG. 2) described later determines which of the button images displayed on the display unit 22 has been operated based on the processing result in the processing device 31. Then, a first skin application 213b, a second skin application 213c, and a POS application 213a described later operate based on the determination result.

[0029] Furthermore, in this embodiment, when it is determined that the fingertip has approached, for example, within 3 cm of the surface of the display unit 22 based on the position of the fingertip identified by the processing device 31, the CPU 211 displays a mark at the position on the display unit 22 where the fingertip is presumed to be pointing. Then, when it is determined that the fingertip has approached, for example, within 1 cm of the surface of the display unit 22, the CPU 211 determines that the button at that position has been pressed (operated). These distance and other determinations can be made based on the results of motion detection.

[0030] That is, when the fingertip approaches within 3 cm (within a second distance that is longer than the first distance) from the surface of the display unit 22 (image display unit), the CPU 211 (determination unit) displays a mark at a position on the display unit 22 (image display unit) where the fingertip is presumed to be pointing. Also, when the fingertip approaches within 1 cm (first distance) from the surface of the display unit 22 (image display unit), the CPU 211 (determination unit) determines that the second button image is operated.

[0031] Fig. 2 shows the functional configuration of the self-checkout system 1 configured as described above. As shown in Fig. 2, the self-checkout system 1 includes a CPU 211, a RAM 212, a HDD 213, a communication interface 214, a graphics processing unit 215, an input / output interface 216, a display unit 22, a receipt printer 23, a scanner 4, a processing unit 31, a microphone 32, a speaker 33, and an automatic change dispenser 34.

[0032] The above-mentioned CPU 211 , RAM 212 , HDD 213 , communication interface 214 , graphics processing unit 215 , and input / output interface 216 are built into the main body 21 , and each block is connected to one another via a bus 217 .

[0033] The CPU 211 reads an application program for performing a payment process for products stored in the HDD 213 or the like via the bus 217, temporarily stores the read program in the RAM 212, and executes the program. Specifically, the CPU 211 reads the POS application 213a, the first skin application 213b, and the second skin application 213c stored in the HDD 213, and executes each of them.

[0034] The RAM 212 temporarily stores a part of an OS (Operating System) program and application programs to be executed by the CPU 211. The RAM 212 also stores various data necessary for processing by the CPU 211. The HDD 213 stores the above-mentioned POS application 213a, first skin application 213b, and second skin application 213c.

[0035] The communication interface 214 transmits and receives data to and from the outside, and may use a connection format such as a local area network (LAN). In this embodiment, the communication interface 214 communicates with a system that manages the self-checkout system 1 in the store and with an external server device.

[0036] The graphic processing device 215 converts the clerk screen (first image), the self-checkout screen (second image), and the monitoring / call image into image signals and outputs them to the display unit 22 in accordance with instructions from the CPU 211. Here, the self-checkout screen functions as a checkout image having an operator (button) image to which a function related to checkout of the purchased item is assigned. The monitoring / call image functions as a monitoring image including at least one of an image indicating that the customer is being photographed by the monitoring camera (camera 51) and an image for a call operation to call a clerk. The clerk screen functions as the first image, and the self-checkout screen functions as the second image. Details of each image will be described later.

[0037] The input / output interface 216 is connected to the scanner 4, the receipt printer 23, the processing device 31, and the automatic change machine 34.

[0038] Next, the hierarchical structure of the first skin application 213b, the second skin application 213c, the POS application 213a, and the hardware in this embodiment will be described with reference to FIG. 3. As shown in FIG. 3, the hardware such as the main body 21, the receipt printer 23, and the automatic change machine 34 operate based on an OS program. The POS application 213a operates on the OS program. The POS application 213a is an application program for a conventional cash register operated by a store clerk. The first skin application 213b operates on the POS application 213a, and the second skin application 213c operates on the first skin application 213b.

[0039] The first skin application 213b is an application program that mainly realizes a GUI (Graphical User Interface) related to the self-checkout function. In other words, the first skin application 213b changes the appearance of the GUI of the POS application 213a to self-checkout specifications. The first skin application 213b also controls the processing device 31 and controls GUI switching and the like based on the processing results of the processing device 31. In this embodiment, the POS application 213a itself is not modified to realize the self-checkout function, but is configured as a separate program.

[0040] In this embodiment, the POS application 213a operates as usual, and the store clerk screen 221 (see FIG. 4) is generated as image data and stored in a memory or the like, although it is not displayed on the display unit 22. The first skin application 213b transitions the screen based on changes in the store clerk screen 221 generated by the POS application 213a, as described later.

[0041] The second skin application 213c is an application program having functions such as a display indicating that the camera 51 is capturing an image, a store clerk call button, etc. The second skin application 213c adds the above-mentioned display and the store clerk call button to the GUI by the first skin application 213b.

[0042] As shown in FIG. 3, in this embodiment, the hardware and the OS, and the OS and the POS application 213a are tightly coupled. That is, they are closely linked to each other. On the other hand, the POS application 213a and the first skin application 213b, and the first skin application 213b and the second skin application 213c are loosely coupled. That is, they are weakly linked to each other. Therefore, even if the POS application 213a is changed, the first skin application 213b does not need to be changed or can be minimized. Similarly, even if the first skin application 213b is changed, the second skin application 213c does not need to be changed or can be minimized. In addition, functions executed by the processing device 31, such as motion detection, face recognition, and voice guidance, are tightly coupled to the first skin application 213b.

[0043] Next, the relationship between the store clerk screen and the self-checkout screen in this embodiment will be described with reference to Fig. 4. In Fig. 4, reference numeral 221 is an example of the store clerk screen, and reference numeral 222 is an example of the self-checkout screen.

[0044] The store clerk screen 221 has a product / price etc. display section 221a and an operation button display area 221b. The product / price etc. display section 221a displays the name and unit price of the product whose barcode has been scanned by the scanner 4, the current total price, etc. In other words, the product / price etc. display section 221a corresponds to a product information display area where information about the purchased product is displayed. The operation button display area 221b has a plurality of button images for inputting the type of product and the payment method (cash, credit card, electronic money, etc.).

[0045] The self-checkout screen 222 has a product / price display section 222a and operation buttons 222b and 222c. The product / price display section 222a is obtained by cutting out the product / price display section 221a of the clerk screen 221. In other words, the product / price display section 222a is not reconstructed by the first skin application 213b that generates the self-checkout screen 222 by acquiring information on the product name and price included in the product / price display section 221a from the POS application 213a, but is instead obtained by the first skin application 213b cutting out the product / price display section 221a from the image of the clerk screen 221 and embedding it in the self-checkout screen 222. It is not necessary to cut out the entire product / price display section 221a, but only the necessary parts such as the product name and price may be cut out.

[0046] The operation buttons 222b and 222c display button images of functions required in a series of processes from product input to payment, such as selection of a payment method, "Next," and "Settlement." The operation buttons 222b and 222c display only the minimum necessary button images, so there are fewer button images than in the store clerk screen 221. Therefore, the self-checkout screen 222 has a simpler screen configuration than the store clerk screen 221.

[0047] Furthermore, since the operation button 222b corresponds to the button 221b1, the operation button 222b is associated with the button 221b1 on the screen 221 for store clerk. Since the operation button 222c corresponds to the button 221b2, the operation button 222c is associated with the button 221b2 on the screen 221 for store clerk.

[0048] Being associated means that the buttons are linked so that when the operation button 222b is operated, the button 221b1 is operated. This does not mean that when the operation button 222b is pressed, a function corresponding to the button 221b1 runs on the POS application 213a, but means that when the operation button 222b is pressed, the button 221b1 is pressed. In other words, the first skin application 213b does not know anything about the function of the POS application 213a, but only transmits that a button on the clerk screen 221 is to be pressed. This corresponds to the processing device 3 performing a pseudo operation of an input means such as a keyboard or a mouse on the register device 2 based on the results of motion detection, face recognition, etc.

[0049] In addition, the first skin application 213b detects a change in the clerk screen 221 and changes the self-checkout screen 222. For example, if an additional product is scanned and the product / price etc. display section 221a changes, when the change is detected, the product / price etc. display section 221a is cut out again and reflected in the self-checkout screen 222. This can be done, for example, by setting in advance the coordinate range of the product / price etc. display section 221a in the image that becomes the clerk screen 221, and detecting a change over time in the coordinate range. In other words, the first skin application 213b monitors changes in a predetermined area of ​​the clerk screen 221 (first image).

[0050] As a method of detecting a change in the store clerk screen 221, for example, when the name of the screen (such as a product input screen or a membership card input screen, which will be described later) is displayed in the upper left corner of the store clerk screen 221, a change in the name, etc. may be detected. In this case, similarly to the above, a change over time in the coordinate range of the portion where the name, etc. is displayed may be detected.

[0051] As described above, the store clerk screen 221 is a first image having a plurality of first button images each assigned with a function related to the settlement of the purchased item. The self-checkout screen 222 is a second image having at least one or more second button images corresponding to the first button images, operated by the customer, and being simpler than the first image.

[0052] Next, the relationship between the self-checkout screen and the monitoring / calling image in this embodiment will be described with reference to Fig. 5. In Fig. 5, reference numeral 222 is an example of the self-checkout screen, and reference numeral 223 is an example of the monitoring / calling image. The self-checkout screen 222 shown in Fig. 5 is the same as that in Fig. 4.

[0053] The monitoring / call image 223 has a preview image 223a and a store clerk call button 223b. The preview image 223a is an indication that the camera 51 is capturing an image, and an image captured by the camera 51 is displayed in real time. The preview image 223a is displayed in the upper left corner of the display screen at a size (e.g., 180×120 dots, 10 frames / sec) that does not interfere with the operation and visibility of each button on the self-checkout screen 222.

[0054] The store clerk call button 223b is an image for a call operation to call a store clerk, and when a customer operates it, the lighting unit 61 lights up. When the store clerk confirms that the lighting unit 61 is lit, he or she goes to the self-checkout system 1 to assist the customer. The store clerk call button 223b is displayed in the upper right corner of the display screen.

[0055] Fig. 6 shows a specific example of the preview image 223a and the store clerk call button 223b. Fig. 6 is an example of a screen displayed on the display unit 22. The screen in Fig. 6 is a start screen (image) that is displayed before the payment process. In this screen, the preview image 223a is displayed in the upper left. To the right of the preview image 223a, "Camera in operation" is also displayed. This "Camera in operation" is also part of the monitoring / call image 223. In addition, the store clerk call button 223b is displayed in the upper right corner of the screen in Fig. 6.

[0056] 6, the monitor / call image 223 is displayed superimposed (overlapped) on the self-checkout screen 222. In other words, a preview image 223a and a store clerk call button 223b are displayed so as to overlap the area of ​​the self-checkout screen 222.

[0057] 5 and 6 includes both the preview image 223a and the store clerk call button 223b, but it may include only one of them. Also, it may be possible to display only "Camera in operation" without displaying the preview image 223a.

[0058] Next, an example of the operation of the self-checkout system 1 configured as described above will be described with reference to Figs. 7 to 9. Figs. 7 to 9 show the transition between the self-checkout screen 222 and the store clerk screen 221 when purchasing a product. In Figs. 7 to 9, the left column shows the self-checkout screen 222, and the right column shows the store clerk screen 221, and screens arranged in the same row correspond to each other. Note that the display of the monitor / call image 223 is omitted in Figs. 7 to 9.

[0059] First, when the self-checkout system 1 is started, the POS application 213a and the first skin application 213b are started, and the start screen S1 is displayed as the self-checkout screen 222 by the first skin application 213b on the display unit 22. Meanwhile, as the clerk screen 221 generated by the POS application 213a at this time, the product input screen T2-1 is generated and stored in the memory or the like as described above. Note that, at the time of start-up, the clerk screen 221 is displayed, and the self-checkout screen 222 may be displayed by operating the switching button image. In this way, it is possible to switch between the conventional POS register and the self-checkout as necessary.

[0060] Next, when the customer scans the barcode of the product with the scanner 4 while the start screen S1 is displayed, the POS application 213a receives the scanned information and transitions the store clerk screen 221 to the product input screen T2-2. The product input screen T2-2 includes the product name and price of the scanned product. Meanwhile, the first skin application 213b detects the transition (change) of the store clerk screen 221 and transitions the self-checkout screen 222 to the product input screen S2. As described in FIG. 4, the product input screen S2 displays the product name and price columns cut out from the product input screen T2-2.

[0061] Next, the customer operates the "Next" button on the product input screen S2. The "Next" button is associated with the "Read Membership Card" button on the product input screen T2-2, and when the "Next" button is operated, the "Read Membership Card" button is operated, and the store clerk screen 221 transitions to the member card input screen T3. Meanwhile, the first skin application 213b detects the transition (change) of the store clerk screen 221 and transitions the self-checkout screen 222 to the member card input screen S3.

[0062] Next, when the customer scans the membership card with the scanner 4 while the membership card input screen S3 is displayed, the scanned information is received by the POS application 213a, and the clerk screen 221 transitions to the sub-screen T4 (FIG. 8). If the customer operates the "Proceed to payment without scanning" button without scanning the membership card, the POS application 213a also transitions the clerk screen 221 to the sub-screen T4. Meanwhile, the first skin application 213b detects the transition (change) of the clerk screen 221 and transitions the self-checkout screen 222 to the payment method selection screen S4 (FIG. 8).

[0063] Next, the customer selects "Cash" on the payment method selection screen S4. The "Cash" button is associated with the "Current Total" button on the sub-screen T4, and when the "Cash" button is operated, the "Current Total" button is operated, and the clerk screen 221 transitions to the automatic change machine deposit screen T4-G1. Meanwhile, the first skin app 213b detects the transition (change) of the clerk screen 221 and transitions the self-checkout screen 222 to the automatic change machine deposit screen S4-G1.

[0064] Next, when the customer inserts bills or coins from the bill handling device 34b or the coin handling device 34a of the housing 3 on the automatic change machine deposit screen S4-G1, the POS application 213a receives information on the amount inserted and reflects it on the automatic change machine deposit screen T4-G1. The automatic change machine deposit screen after reflection is designated as T4-G2. Meanwhile, the first skin application 213b detects a change in the automatic change machine deposit screen T4-G1 (automatic change machine deposit screen T4-G2) and reflects it in the amount on the automatic change machine deposit screen S4-G1 of the self-checkout screen 222. The automatic change machine deposit screen after reflection is designated as S4-G2.

[0065] Next, the customer finishes inserting the cash and operates the "Settlement" button on the automatic change machine deposit screen S4-G2. The "Settlement" button is associated with the "Confirm" button on the automatic change machine deposit screen T4-G2, and when the "Settlement" button is operated, the "Confirm" button is operated and the clerk screen 221 transitions to the actual transaction screen T5-G (FIG. 9). Then, the POS application 213a causes the automatic change machine 34 of the housing 3 to discharge the change, and prints and outputs a receipt from the receipt printer 23. Meanwhile, the first skin application 213b detects that the clerk screen 221 has transitioned to the actual transaction screen T5-G, and transitions the self-checkout screen 222 to the completion screen S5-G (FIG. 9). The customer receives the change and receipt along with the product, and the purchase is completed.

[0066] In the above-described self-checkout system 1, the camera 51 captures an image of the customer during payment (from the start of payment to the end of payment), and this captured image data may be output to an external server device. A communication interface 214 is used for communication with the external server device. This captured image data is then stored in the external server device in association with sales data. Details will be described with reference to FIG. 10.

[0067] 10, a plurality of self-checkout systems 1 and a server device 500 are connected to a network N. Sales data 600 is acquired by the server device 500 from a server device (not shown) that aggregates sales data.

[0068] The server device 500 is a known server computer, and may be a cloud server, etc. The server device 500 acquires video data from the self-checkout system 1, and acquires sales data 600 from a tallying server, etc.

[0069] The server device 500 links (associates) the acquired video data with the sales data 600. This links the video data when a certain customer pays for a product with the sales data 600 at the time of the payment.

[0070] The server device 500 may also acquire data on the gender and age of the customer identified by the self-checkout system 1, or the server device 500, rather than the self-checkout system 1, may identify the gender of the customer.

[0071] That is, the network interface of the server device 500 functions as an image acquisition unit that acquires images from the self-checkout system and a sales acquisition unit that acquires sales information of products settled by the self-checkout system. A storage device such as a hard disk of the server device 500 functions as a storage unit that associates and stores the images acquired by the image acquisition unit with the sales information settled in the images.

[0072] According to the present embodiment described above, the self-checkout system 1 includes a first skin app 213b that is operated by a customer and generates a self-checkout screen 222 having an operator image to which a function related to the settlement of a purchased item is assigned, and a second skin app 213c that generates a monitoring / call image 223 including a preview image 223a captured by the camera 51 and a store clerk call button 223b. The self-checkout system 1 also includes a display unit 22 on which the self-checkout screen 222 and the monitoring / call image 223 are displayed.

[0073] By configuring the self-checkout system 1 as described above, it is possible to separate the self-checkout checkout function from the customer monitoring function. Therefore, there is no need to modify the self-checkout checkout function when adding a customer monitoring function, and the function can be easily added with minimal modifications. In addition, no physical buttons are required. Furthermore, it is possible to add monitoring functions (calling a store clerk while the surveillance camera is capturing images) without relying on the self-checkout app.

[0074] In addition, since the self-checkout screen 222 and the monitoring / call image 223 are displayed overlapping on the display unit 22, the self-checkout screen 222 and the monitoring / call image 223 appear to the customer as one unit, with no distinction between them. In addition, the display positions of the preview image 223a and the store clerk call button 223b can also be freely changed.

[0075] Furthermore, by including the preview image 223a captured by the camera 51 in the surveillance / call image 223, the customer is reliably informed that he or she is being monitored, which is also effective in terms of crime prevention.

[0076] The self-checkout system 1 also includes a POS application 213a that executes processing related to the settlement of purchased items and generates a clerk screen 221 having buttons 221b1 and 221b2 to which functions related to the settlement are respectively assigned. The first skin application 213b has an operation button 222b corresponding to the button 221b1 and an operation button 222c corresponding to the button 221b2, and generates a self-checkout screen 222 that is operated by a customer and has a simpler image than the clerk screen 221. The display unit 22 displays the self-checkout screen 222. The button 221b1 is associated with the operation button 222b, and the button 221b2 is associated with the operation button 222c.

[0077] Therefore, the conventional POS register can be made into a self-checkout register without the customer directly operating the clerk screen 221, which is an operation image of a conventional POS register, in order to display the self-checkout screen 222 operated by the customer. Also, since it is necessary to associate only the buttons that the customer needs to operate, the customer can operate on a simple screen, reducing operational errors. Furthermore, if one type of self-checkout screen 222 is prepared, it can be applied to multiple types of clerk screens 221 (POS applications 213a), making it easy to support multiple models.

[0078] In addition, since the lighting unit 61 is provided, which lights up in response to the operation of the store clerk call button 223b, the store clerk can be notified and called by emitting light.

[0079] In addition, the server device 500 acquires image data of a customer from the self-checkout system 1, acquires sales data of products that have been paid for by the self-checkout system 1, and stores the acquired image data in association with sales data processed for the payment for the image data. In this manner, it is possible to perform an analysis that associates sales data with customer information. For example, by identifying and analyzing age, gender, etc. from the image of a customer, it is possible to analyze which products are being sold to which customer demographic. Although a similar analysis is possible using a point card or the like, in this embodiment, an analysis is also possible for customers who do not have a point card or the like.

[0080] In the above embodiment, the self-checkout screen 222 and the monitoring / calling image 223 are superimposed and displayed on one display unit 22, but each image may be displayed on a different display device. Fig. 11 shows a modified example of this embodiment.

[0081] 11 shows a display unit 24 in addition to the display unit 22. The display unit 24 is, for example, a display device smaller than the display unit 22, and is provided on the periphery of the display unit 24. The display unit 24 may be configured with a touch panel, or may detect operations by a motion sensor 52 similar to the display unit 22.

[0082] 11, the monitor / call image 223 is not displayed on the display unit 22. In other words, the preview image 223a and the store clerk call button 223b are not displayed on the display unit 22. The preview image 223a and the store clerk call button 223b are displayed on the display unit 24.

[0083] According to the modified example of Fig. 11, the self-checkout screen 222 and the monitoring / calling image 223 are displayed on separate display devices. By doing so, there is no need to change the display process on the display unit 22. On the other hand, the monitoring / calling image 223 displayed on the display unit 24 only has a different output destination due to the second skin application 213c, and other processes remain unchanged. Display on a separate screen like this is easily possible because it does not depend on the self-checkout application, as described above.

[0084] 11, the monitoring / calling image 223 is displayed over the entire display unit 24, but for example, an advertisement or the like may be displayed on the display unit 24, and the monitoring / calling image 223 may be superimposed on the advertisement. The monitoring / calling image 223 is displayed by the second skin application 213c, and therefore can be easily displayed as long as it can be loosely coupled with any application, not limited to the first skin application 213b.

[0085] Furthermore, the present invention is not limited to the above-described embodiment. In other words, a person skilled in the art can implement the present invention by modifying it in various ways according to conventional knowledge without departing from the gist of the present invention. As long as the self-checkout system configuration of the present invention is still included in the scope of the present invention even after such modification, it is of course included in the scope of the present invention. [Explanation of symbols]

[0086] 1. Self-checkout system 2. Register device 3. Chassis 21 Main body 22 Display section 24 Display 51 Camera (Surveillance camera) 61 Lighting section 213a POS App 213b 1st skin app (1st processing section) 213c Second skin app (second processing section) 214 Communication interface (output section) 221 Clerk screen (1st image) 221b1 Button (First button image) 221b2 Button (First button image) 222 Self-checkout screen (payment image, second image) 222b Operation button (second button image) 222c Operation button (second button image) 223 Surveillance / call images (surveillance images) 223a Preview image (image showing that the customer is being photographed) 223b Store attendant call button (image for call operation) 500 External server (information processing device, video acquisition unit, sales acquisition unit, storage unit)

Claims

1. a first processing unit that generates a payment image having an operator image that is operated by a customer and has a function related to payment for the purchased product assigned thereto; a second processing unit that generates a surveillance image including at least one of an image indicating that the customer is being photographed by a surveillance camera and an image for a call operation to call a store clerk; a display unit on which the settlement image and the monitoring image are displayed; A self-checkout system comprising:

2. The self-checkout system according to claim 1 , wherein the settlement image and the monitoring image are displayed in an overlapping manner on a single display device.

3. The self-checkout system according to claim 1 , wherein the image indicating that the customer is being photographed includes an image photographed by the surveillance camera.

4. The self-checkout system according to claim 1 , wherein the settlement image and the monitoring image are displayed on separate display devices.

5. The self-checkout system according to claim 1, further comprising a lighting unit that lights up in response to an operation of the image for the call operation.

6. The surveillance camera; an output unit that outputs the captured image to an external server; The self-checkout system according to any one of claims 1 to 5, further comprising:

7. An image acquisition unit that acquires the image from the self-checkout system according to claim 6; A sales acquisition unit that acquires sales information of products settled by the self-checkout system; An information processing device comprising: a storage unit that stores the image acquired by the image acquisition unit and the sales information processed for settlement for the image in association with each other.

Citation Information

Patent Citations

  • Store system, clerk call processing method, and software

    JP2020205023A

  • Self-checkout register monitoring system and self-checkout register monitoring method

    JP7039084B1