Image display device, image display method, and image display program

Abstract

To prevent unauthorized cash register operations at a cash register.SOLUTION: Control means of an image display device 100 acquires a camera image of a camera 126 that captures the scene around a bar code reader 215a of a cash register 200, performs image analysis processing on the acquired camera image, creates the captured image showing an article moving in the vicinity of the bar code reader 215a based on the camera image when detecting that the article has moved in the vicinity of the bar code reader 215a based on the analysis result, and outputs the created captured image to a display means 110 for display.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image display device, an image display method, and an image display program, and more particularly to an image display device, an image display method, and an image display program capable of displaying the state of a cash register operation on a display means. [Background technology]

[0002] Conventionally, convenience stores, supermarkets, and other stores have introduced payment terminals (Point of Sales (POS) registers, hereafter referred to as "registers") that electronically record, as journal data, the time information when a customer purchases an item, the store number (store-specific information), the terminal number (register number, register-specific information), the product name, the number of items, the product price, the total purchase amount, etc.

[0003] Furthermore, in recent years, many self-checkout registers (self-payment terminals) have been installed, which allow customers to operate the register themselves and process the payment for purchased items. By using self-checkout registers, customers can operate the register themselves, eliminating the need for dedicated staff to operate the register, which can reduce labor costs, etc. (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 10-208149 Summary of the Invention [Problem to be solved by the invention]

[0005] However, some customers who use self-checkout registers commit fraud by completing the checkout process without scanning the barcodes of some products, or by scanning fewer barcodes than the number of items they are purchasing when purchasing multiple items of the same product.

[0006] The present invention has been made in consideration of the above problems, and an object of the present invention is to provide an image display device, an image display method, and an image display program that are capable of preventing fraudulent cash register operations. [Means for solving the problem]

[0007] In order to solve the above problem, the image display device of the present invention comprises a camera that captures an image of the area around a barcode reading unit of a cash register, a control means for creating a captured image based on camera image captured by the camera, and a display means for displaying the captured image, wherein the control means acquires the camera image from the camera, and performs image analysis processing on the acquired camera image, so that when it detects that a product has moved around the barcode reading unit, it creates the captured image showing the product moving around the barcode reading unit based on the camera image, and outputs the created captured image to the display means.

[0008] In addition, in the above-mentioned image display device, the control means may acquire a barcode reading signal output by the cash register when the barcode of the product is read by the barcode reading unit, and issue an alert if the barcode reading signal cannot be acquired in correspondence with the timing at which the captured image was created based on the camera image.

[0009] The image display device of the present invention comprises a camera that captures an image of the area around a barcode reading unit of a cash register, a control means for creating a captured image based on the camera image captured by the camera, and a display means for displaying the captured image created by the control means, wherein the control means acquires the camera image from the camera, acquires a barcode read signal output by the cash register when the barcode of a product is read by the barcode reading unit, creates the captured image showing the product moving around the barcode reading unit based on the camera image depending on the timing at which the barcode read signal is acquired, and outputs the created captured image to the display means.

[0010] In the above-mentioned image display device, the control means may output the camera image acquired by the camera to the display means together with the captured image.

[0011] The image display method of the present invention is an image display method for an image display device equipped with a camera that captures an image of the area around a barcode reading unit of a cash register, a control means for creating a captured image based on camera image captured by the camera, and a display means for displaying the captured image, wherein the control means has a camera image acquisition step of acquiring the camera image from the camera, an image analysis step of performing image analysis processing on the camera image acquired in the camera image acquisition step, a product detection step of determining whether or not a product moving around the barcode reading unit has been detected based on the camera image image analyzed in the image analysis step, a capture image creation step of creating, based on the camera image, a capture image showing the product moving around the barcode reading unit when a product moving around the barcode reading unit is detected in the product detection step, and a capture image output step of outputting the capture image created in the capture image creation step to the display means.

[0012] The above image display method may include a barcode read signal acquisition step in which the control means acquires a barcode read signal output by the cash register when the barcode of the product is read by the barcode reading unit, and a notification step in which the control means issues a notification when the barcode read signal cannot be acquired in the barcode read signal acquisition step, corresponding to the timing at which the capture image is created in the capture image creation step.

[0013] The image display method of the present invention is an image display method for an image display device equipped with a camera that captures an image of the area around a barcode reading unit of a cash register, a control means for creating a captured image based on camera image captured by the camera, and a display means for displaying the captured image, wherein the control means has a camera image acquisition step for acquiring the camera image from the camera, a barcode read signal acquisition step for acquiring a barcode read signal output by the cash register when the barcode of a product is read by the barcode reading unit, a capture image creation step for creating the capture image showing the product moving around the barcode reading unit based on the camera image depending on the timing at which the barcode read signal was acquired in the barcode read signal acquisition step, and a capture image output step for outputting the capture image created in the capture image creation step to the display means.

[0014] The above-mentioned image display method may, in the capture image output step, cause the control means to output the camera image acquired in the camera image acquisition step to the display means together with the capture image created in the capture image creation step.

[0015] The image display program of the present invention is an image display program for an image display device equipped with a camera that captures the surroundings of a barcode reading unit of a cash register, a control means for creating a captured image based on camera image captured by the camera, and a display means for displaying the captured image, and is characterized in that the image display program realises a camera image acquisition function that causes the control means to acquire the camera image from the camera, an image analysis function that causes the control means to perform image analysis processing on the camera image acquired by the camera image acquisition function, a product detection function that determines whether or not a product moving around the barcode reading unit has been detected based on the camera image image analyzed by the image analysis function, a capture image creation function that, when a product moving around the barcode reading unit is detected by the product detection function, creates the capture image based on the camera image, showing the product moving around the barcode reading unit, and a capture image output function that outputs the capture image created by the capture image creation function to the display means.

[0016] The above-mentioned image display program may enable the control means to realize a barcode read signal acquisition function that causes the control means to acquire a barcode read signal output by the cash register when the barcode of the product is read by the barcode reading unit, and an alarm function that causes the control means to issue an alarm when the barcode read signal cannot be acquired by the barcode read signal acquisition function, corresponding to the timing when the capture image is created by the capture image creation function.

[0017] The image display program of the present invention is an image display program for an image display device having a camera that captures the area around a barcode reading unit of a cash register, a control means for creating a captured image based on camera image captured by the camera, and a display means for displaying the captured image, and is characterized in that the control means realizes a camera image acquisition function that causes the camera image to be acquired from the camera, a barcode read signal acquisition function that causes the control means to acquire a barcode read signal output by the cash register when the barcode of a product is read by the barcode reading unit, a capture image creation function that creates, based on the camera image, a capture image showing the product moving around the barcode reading unit depending on the timing at which the barcode read signal is acquired by the barcode read signal acquisition function, and a capture image output function that causes the control means to output the capture image created by the capture image creation function to the display means.

[0018] The above-mentioned image display program may be one that, in the capture image output function, causes the control means to realize a function of outputting the camera image acquired by the camera image acquisition function to the display means together with the capture image created by the capture image creation function. Effect of the Invention

[0019] According to the image display device, the image display method, and the image display program of the present invention, it is possible to prevent fraudulent operations at a cash register. [Brief description of the drawings]

[0020] [Figure 1] 1 is a perspective view showing a register operation display device and a self-checkout device according to an embodiment of the present invention; [Diagram 2] 1 is a development view showing a schematic configuration of a cash register operation and display device according to an embodiment; [Diagram 3] FIG. 2 is a block diagram showing a schematic configuration of a PC according to an embodiment. [Figure 4]4 is a flowchart showing processing contents of a CPU according to the embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of an output image displayed on a main display in the embodiment. [Figure 6] 5 is a flowchart showing detailed processing contents of the output video creation processing shown in FIG. 4. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] The image display device according to the present invention will be described in detail below with reference to the drawings, showing a cash register operation display device as an example. Fig. 1 is a perspective view showing a cash register operation display device (image display device) 100 and a self-checkout register 200 according to an embodiment.

[0022] The self-register 200 is generally composed of a main body 210, which is a stepped box having two horizontal surfaces, an upper surface 212 on which a register display 220 is installed, and a middle surface 214 for making it easier to move a product when reading the product's barcode, a first installation stand 230 and a second installation stand 232 installed horizontally on the left and right sides of the main body 210, and the register display 220. A barcode reading unit 215a for reading barcodes attached to products is provided on an upright surface 215 that connects the middle surface 214 to the upper surface 212. An insertion port 216 for inserting bills, coins, etc. is provided at the front end of the middle surface 214, and a return port 218 for returning change (bills and coins) is provided below the insertion port 216.

[0023] When a customer uses the self-checkout register 200, they place the shopping basket containing the items on the first installation stand 230 on the right side and a take-out bag (eco bag or shopping bag) on ​​the second installation stand 232 on the left side. They then remove the items one by one from the shopping basket, have the barcodes of the items read by the barcode reading unit 215a at the middle surface 214, and then place the items into the take-out bag.

[0024] The cash register operation display device 100 is a device that captures images of cash register operations and displays the captured images so that customers can view them. As shown in Fig. 2, the cash register operation display device 100 includes a main display 110, a pole 120, an arm 130 that is attached to the pole 120, a PC (personal computer) 140, a mounting bracket 150 that conforms to the VESA (Video Electronics Standards Association) standard, and a camera 126.

[0025] Pole 120 has legs 122 and a pole body 124. Leg 122 is disk-shaped, and pole body 124 is erected at center portion 122a. Upper portion 124a of pole body 124 is bent into an inverted L shape, and camera 126 is attached to bent tip 124b. The height dimension from the lower end of pole body 124 (attachment portion to leg 122) to upper portion 124a bent into an inverted L shape is set to about 2m.

[0026] Camera 126 is installed on pole body 124 at an angle that allows a bird's-eye view of the front side of main display 110 (more specifically, the state of a customer operating self-checkout 200 shown in FIG. 1) from above, and a wide-angle lens is used for camera 126. Wiring (not shown) for camera 126 passes through the inside of pole body 124 and is connected to PC 140, so that the image captured by camera 126 can be read by PC 140 in real time.

[0027] The arm section 130 is attached to the pole body 124, and the attachment position of the arm section 130 can be changed up or down. An H-shaped arm attachment section 134 for attaching the mounting bracket 150 and the main display 110 to the arm section 130 is provided at the tip of the arm section 130.

[0028] The mounting bracket 150 is a bracket for attaching the PC 140 and the arm attachment part 134 of the arm unit 130 to the back surface of the main display 110. On the back surface of a typical display, screw holes are arranged for attaching wall-mounting brackets such as an arm member or a stand. The VESA standard is an international standard that standardizes the arrangement of these screw holes, and by using the mounting bracket 150 of the VESA standard, the arm attachment part 134 of the arm unit 130 and the PC 140 can be easily and reliably attached to the back surface of the main display 110. As shown by the dashed line in FIG. 2, by attaching mounting screws (not shown) to the screw holes of the mounting bracket 150, the screw holes of the arm attachment part 134, the screw holes on the back surface of the main display 110, and the screw holes on the bottom surface of the PC 140, it becomes possible to attach the main display 110 and the PC 140 to the arm unit 130 via the mounting bracket 150.

[0029] A cable (not shown) which is connected to a video output terminal (input / output I / F described below) of PC 140 is connected to an image input terminal (not shown) of main display 110, making it possible for PC 140 to output video (output video described below) to main display 110.

[0030] 3 is a block diagram showing a schematic configuration of the PC 140. The PC 140 has a CPU (Central Processing Unit) 141, a ROM (Read Only Memory) 142, a RAM (Random Access Memory) 143, a recording unit (recording means) 144, an input / output I / F (Interface) 145, and a communication I / F 146.

[0031] CPU 141 reads in real time the image captured by camera 126, and creates an image (hereinafter referred to as a captured image) at a timing when it can be determined that the barcode of the product has been scanned, based on the read image (hereinafter referred to as a camera image), by image import processing (capture processing). CPU 141 outputs the camera image and the captured image to main display 110 via input / output I / F 145, thereby performing processing to display the camera image and the captured image on main display 110. CPU 141 also performs processing to record the camera image and the captured image in recording unit 144 or video recording device 350 (for example, a video recording server connected via network 330 by communication I / F 146) in association with time information of the time of shooting.

[0032] In the ROM 142, a program indicating the processing contents of the CPU 141 (programs relating to the flowcharts shown in FIG. 4 and FIG. 6 described later) and the like are recorded. The CPU 141 executes processing by reading the program from the ROM 142. The RAM 143 is used as a work area for the processing executed by the CPU 141. Note that in the PC 140 according to the embodiment, the program is recorded in the ROM 142, but the program is not limited to being recorded in the ROM 142 and may be recorded in the recording unit 144.

[0033] The camera video is recorded in the recording unit 144 in association with information (time information) of the time when the camera video was captured by the camera 126. The recording unit 144 also records a capture image that has been subjected to image capture processing (capture processing) based on the camera video in association with information (time information) of the time when the image capture processing was performed. The recording unit 144 uses a general non-volatile memory such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a USB (Universal Serial Bus) memory.

[0034] The input / output I / F 145 is connected to a wiring (video input / output cable, for example, a composite cable for video) of the camera 126 (not shown). The video captured by the camera 126 can be imported into the PC 140 via the input / output I / F 145. When an input means 300 such as a keyboard or a mouse is connected to the PC 140, the input means 300 is connected via the input / output I / F 145. When the input means 300 is connected, a USB terminal or the like is used as the input / output I / F 145. Furthermore, the input / output I / F 145 is connected to a wiring (video input / output cable, for example, an HDMI (registered trademark) (High-Definition Multimedia Interface) cable) for outputting an output video to the main display 110. In this case, for example, an HDMI (registered trademark) terminal or the like is used as the input / output I / F 145.

[0035] The communication I / F 146 is an interface used to connect the PC 140 to the network 330. For example, a network interface card (NIC) is used as the communication I / F 146. By using the communication I / F 146, it becomes possible to connect the PC 140 to the network 330 without being limited to being wired or wireless.

[0036] FIG. 4 is a flowchart showing the processing contents of CPU 141. The processing contents of CPU 141 will be described according to the flowchart shown in FIG. 4. First, CPU 141 captures the camera image captured by camera 126 via input / output I / F 145 (S.01: camera image acquisition step, camera image acquisition function), and causes the captured camera image to be recorded in recording unit 144 or image recording device 350 (S.02). Then, CPU 141 creates an output image to be displayed on main display 110 using the camera image (S.03: capture image creation step, capture image creation function), outputs the output image to main display 110 (S.04: capture image output step, capture image output function), and ends the processing shown in FIG. 4. After that, CPU 141 repeatedly executes the processing shown in FIG. 4 to perform processing to display on main display 110 an output image showing the camera image read in real time.

[0037] 5 shows an example of an output image displayed on main display 110. Output image 400 is composed of a camera image display portion 410 displayed in the left half of the screen, and a captured image display portion 420 displayed in the right half of the screen. Camera images captured by camera 126 are displayed in real time in camera image display portion 410 (main display 110) of output image 400. In captured image display portion 420 in the right half of the screen, multiple display columns are provided in the vertical direction (in FIG. 5, three display columns are provided as an example), and each captured image is displayed in order from the top according to the creation time of the captured image.

[0038] Fig. 6 is a flow chart showing the specific contents of the output image creation process (S.03) shown in Fig. 4. The CPU 141 judges whether or not a commodity has passed (moved) on the middle surface 214 by applying image analysis processing using deep learning or the like to the captured camera image. Specifically, the CPU 141 extracts an image around the middle surface 214 from the camera image (S.11), and performs image analysis processing (S.12: image analysis step, image analysis function) on the extracted image around the middle surface 214.

[0039] Then, the CPU 141 performs image analysis processing to determine whether a specific product is captured in the extracted image (the product has passed or moved) (S.13: product detection step, product detection function). In more detail, the CPU 141 determines whether a product is moving from the first installation stand 230 through the middle surface 214 toward the second installation stand 232 in the extracted image around the middle surface 214.

[0040] Various methods of image analysis processing (S.12) for making such a judgment have already been proposed. For example, by using an application such as Google (registered trademark) Lens, it is possible to extract images of products similar to the photographed product. Even if something other than the product (such as a customer's hand) is reflected in the photographed image, it is possible to remove the other thing (hand, etc.) and judge only the product image by image analysis processing. By such product extraction processing, similar product discrimination processing, etc., it becomes possible to judge whether a product has passed (moved) (been reflected) on the middle surface 214 of the self-checkout 200.

[0041] As already explained, the barcode reading unit 215a is provided on the rising surface 215 continuing from the middle surface 214 to the upper surface 212. Therefore, when it is determined that a product has passed on the middle surface 214 (Yes in S.13), it can be presumed that the customer has performed a process to have the barcode of the product read by the barcode reading unit 215a.

[0042] When it is determined that the product has passed (moved) (been reflected) on the middle surface 214 (Yes in S.13), the CPU 141 creates a capture image of the timing when the product passed (moved) (been reflected) on the middle surface 214 based on the extracted video (camera video) around the middle surface 214 (S.14: capture image creation step, capture image creation function), displays the created capture image in the top display column of the capture image display portion 420 displayed on the right half of the screen, moves the previously taken capture images down one column at a time to display three capture images, and also displays the camera video in the camera video display portion 410 displayed on the left half of the screen to create an output video (S.15: creates an output video using a new capture image, capture image creation step, capture image creation function). After that, the CPU 141 returns the process to S.03 in FIG. 4, and outputs the output video created in S.15 to the main display 110 via the input / output I / F 145 (S.04).

[0043] On the other hand, if it is determined that no product has been moved on the middle surface 214 (No in S.13), the CPU 141 creates an output image by displaying a previously created capture image in the capture image display portion 420 in the right half of the screen and displaying a camera image read in real time in the camera image display portion 410 displayed in the left half of the screen (S.16: Create output image using previously captured image).Then, the CPU 141 returns the process to S.03 in Fig. 4 and outputs the output image created in S.16 to the main display 110 via the input / output I / F 145 (S.04).

[0044] As shown in FIG. 5, the right half of the output image screen displays an image (capture image) that shows the customer reading the barcode (operating the cash register), created at the time when it can be determined that the product has been read by the barcode reading unit 215a (if the result of S.13 is Yes).

[0045] Some customers who use self-checkout registers commit fraud by completing the checkout process without scanning some of the product's barcodes, or by scanning fewer barcodes than the number of items they are purchasing when purchasing multiple items of the same product.

[0046] In the cash register operation display device 100 according to the embodiment, a bird's-eye view of a customer's cash register operation from diagonally above is displayed in real time on the left half of the screen of the output image displayed on the main display 110. Therefore, when a customer operates the self-checkout to have the barcode of a product read, the customer's view of himself / herself is included in the main display 110, and the customer recognizes that the camera 126 is capturing how he / she is operating to read the barcode. This makes the customer aware that "my cash register operation may be monitored by the camera 126," and this creates a psychological tendency to not commit fraud. This creates a desire to have the barcode of the product properly scanned, making it possible to psychologically suppress fraudulent behavior by the customer.

[0047] Furthermore, in the cash register operation and display device 100 according to the embodiment, an image (captured image) showing the customer's operation of reading the barcode (cash register operation) is displayed in the right half of the screen of the output video shown on the main display 110. This captured image is a trimmed image of a product passing (moving, being reflected) on the middle surface 214, and is an enlarged image of the product's hand at the time when it can be determined that the product's barcode has been read.

[0048] For this reason, even if a customer commits fraudulent acts by grabbing multiple products (small products of the same type, such as multiple packs of gum) at once and having the barcodes of the products read fewer times than the number of products they grabbed, or by pointing the side of the product on which the barcode is not printed toward the barcode reading unit 215a to make it look like they are reading the barcode, the customer may become aware that "these fraudulent acts may be revealed by the captured image displayed on the main display 110." This makes it possible to psychologically restrain customers who use self-checkouts from committing fraudulent acts.

[0049] Furthermore, the camera footage and the captured images are associated with time information about the time of capture and are recorded in the recording unit 144 and the video recording device 350 (see the process of S.02 in FIG. 4). Therefore, when the date and time when a customer committed a fraudulent act can be identified from the journal data of the self-checkout 200, it becomes possible to easily extract and refer to the camera footage and the captured images from the recording unit 144 and the video recording device 350. Therefore, it becomes possible to judge and confirm after the fact whether or not a customer committed a fraudulent act based on the camera footage and the captured images.

[0050] An example of the image display device, image display method, and image display program according to the present invention has been shown above and described in detail with reference to the drawings. However, the image display device and the like according to the present invention are not limited to the cash register operation display device 100 shown in the embodiment. For example, in the cash register operation display device 100, a case has been described in which a camera image is displayed in the left half of the screen (camera image display portion 410) of the output image displayed on the main display 110, and a captured image is displayed in the right half of the screen (captured image display portion 420). However, the display positions of the camera image display portion 410 and the captured image display portion 420 in the output image are not limited to these positions, and it is also possible to display them in reverse.

[0051] Also, either the upper or lower part of the screen may be the camera video display portion 410, and the other may be the captured image display portion 420. Furthermore, it is also possible to configure the camera video display portion 410 and the captured image display portion 420 to be displayed in full screen alternately at regular intervals. Also, the captured images displayed in the captured image display portion 420 may be displayed in order from the bottom to the top of the display column according to the creation time of the captured image.

[0052] In either case, by displaying the camera footage and the captured image on main display 110 as output video 400, customers become aware that their cash register operations may be being monitored by camera 126, making them more likely to try to have the product barcodes scanned properly, thereby psychologically discouraging fraudulent behavior.

[0053] Also, in the cash register operation display device 100 according to the embodiment, the CPU 141 performs image analysis processing on the image around the middle surface 214 (S.12 in FIG. 6), and determines whether or not a product has passed (moved) (been reflected) on the middle surface 214 (S.13 in FIG. 6). If it is determined that a product has passed (moved) (been reflected) (Yes in S.13 in FIG. 6), it determines that the barcode of the product has been read by the barcode reading unit 215a, and creates a capture image (S.14 in FIG. 6). Meanwhile, a typical self-checkout is capable of detecting the timing at which the barcode of a product is read.

[0054] For this reason, when the self-register 200 performs a process of reading the barcode of the product, a barcode reading signal indicating that the reading has been performed is output from the self-register 200 to the CPU 141 of the register operation display device 100, so that the CPU 141 can determine whether or not the customer has actually had the barcode of the product read by the barcode reading unit 215a at the time when the barcode reading signal is acquired (barcode reading signal acquisition step, barcode reading signal acquisition function) or in response to these timings. Note that if there is a certain time lag from the time when the self-register 200 performs a process of reading the barcode of the product to the time when the CPU 141 receives the barcode reading signal, it is possible to determine whether or not the barcode has been read based on timing that takes that time lag into consideration.

[0055] Therefore, if the CPU 141 determines through image analysis processing that a product has passed (moved) (been captured) on the middle surface 214 and creates a captured image (S.12 to S.14 in FIG. 6), but is unable to obtain a barcode reading signal from the self-checkout register 200, the CPU 141 can determine that the customer did not actually have the barcode of the product read by the barcode reading unit 215a.

[0056] For this reason, when the CPU 141 determines that the product has passed (moved) through the middle surface 214 (Yes in S.13 of FIG. 6), a process may be added to check whether a barcode reading signal has been received from the self-register 200 within a predetermined time (within a time period considering the above-mentioned time lag), and if the barcode reading signal has not been received within the predetermined time, it may perform a notification process (notification step, notification function) such as displaying a warning on the main display 110 or emitting an alarm to notify store staff around the self-register of the high possibility that a fraudulent act has been committed by the customer. In addition, when performing such a notification process, the recording unit 144 or the video recording device 350 may be configured to record the time when the notification process was performed and a captured image (or camera image) at that time so that the state around the middle surface 214 at the time of the notification process can be confirmed after the fact.

[0057] With this configuration, a customer who has committed fraud (or attempted to commit fraud) even once will be made aware, through the warning message shown on main display 110, that they may be being monitored to see whether they are reading the barcode properly, which will psychologically deter them from committing fraudulent acts.

[0058] Furthermore, a configuration may be adopted in which a capture image showing the state of the product when it passes (moves) (is reflected in) the middle surface 214 is created in response to the timing of receiving the barcode reading signal, and displayed on the main display 110. By creating a capture image in this manner, it is possible to create a capture image at the timing when the barcode of the product is read by the barcode reading unit 215a with greater certainty than when a capture image is created by performing image analysis processing on the camera video to determine whether the product has passed (moved) (is reflected in) around the middle surface 214.

[0059] In this case, each time a customer passes (moves) an item on the middle surface 214, a store clerk standing around the cash register checks whether a captured image is displayed on the main display 110, and if the customer has not had the barcode read by the barcode reading unit 215a, the store clerk may call out to the customer and compare the purchased item with the journal data (or receipt).

[0060] Customers who see a store clerk speaking to them in this way will recognize that the store clerk is conducting a check to see if they are engaging in fraudulent activity, which will psychologically discourage fraudulent activity. [Explanation of symbols]

[0061] 100 ... Cash register operation display device (image display device) 110 ... Main display 120 ... Paul 122 ... (pole) leg 122a ... (leg) center part 124 ... (pole) body 124a …(Top of pole body) 124b …(pole body) tip 126 ... Camera 130 ... Arm section 134 ... (Arm part) arm attachment part 140 ... PC (personal computer) 141 ...(PC) CPU 142 ... (PC) ROM 143 ... (PC) RAM 144 ... (PC) Recording Section 145 ...(PC) Input / Output I / F 146 ... (PC) communication I / F 150 …Mounting bracket 200 ... Self-checkout 210 ... (Self-checkout) main body 212 ...(Main body) upper surface 214 ... Middle surface (of main body) 215 ...(Main body) standing surface 215a ... Barcode reading unit (main body) 216 ... (Main body) inlet 218 … Return port (of main body) 220 ... Cash register display 230...1st installation stand part 232...Second installation stand 300 ... Input method 330 … Network 350 ...Video recording device 400 ... Output image 410 ... Camera image display section 420 ...Capture image display area

Claims

1. A camera that captures the area around the barcode reader of the cash register, A control means for creating a capture image based on a camera image captured by the camera; A display means for displaying the captured image; Equipped with The control means Acquire the camera image from the camera; performing an image analysis process on the acquired camera image, and when it is detected that a product has moved around the barcode reading unit, creating the captured image showing the product moving around the barcode reading unit based on the camera image; outputting the created captured image to the display means; An image display device comprising:

2. The control means acquiring a barcode read signal output by the register when the barcode of the commodity is read by the barcode reading unit; When the barcode reading signal cannot be acquired, a notification is given in response to the timing when the captured image is created based on the camera image.

2. The image display device according to claim 1,

3. A camera that captures the area around the barcode reader of the cash register, A control means for creating a capture image based on a camera image captured by the camera; a display means for displaying the captured image created by the control means; Equipped with The control means Acquire the camera image from the camera; acquiring a barcode read signal output by the register when the barcode of the product is read by the barcode reading unit; creating the captured image showing the movement of the product around the barcode reading unit based on the camera image in response to the timing of acquiring the barcode reading signal; outputting the created captured image to the display means; An image display device comprising:

4. The control means outputting the camera image acquired from the camera to the display means together with the captured image; 4. The image display device according to claim 1, wherein:

5. A camera that captures the area around the barcode reader of the cash register, A control means for creating a capture image based on a camera image captured by the camera; A display means for displaying the captured image; An image display method for an image display device comprising: The control means a camera image acquisition step of acquiring the camera image from the camera; an image analysis step of performing image analysis processing on the camera image acquired in the camera image acquisition step; a commodity detection step of determining whether or not a commodity moving around the barcode reading unit is detected based on the camera image that has been image-analyzed in the image analysis step; a capture image creation step of creating, when a commodity moving around the barcode reading unit is detected in the commodity detection step, the capture image showing the commodity moving around the barcode reading unit based on the camera image; a capture image output step of outputting the capture image created in the capture image creation step to the display means; 13. An image display method comprising:

6. The control means a barcode reading signal acquiring step of acquiring a barcode reading signal outputted by the cash register when the barcode of the commodity is read by the barcode reading unit; a notification step of performing a notification when the barcode read signal cannot be acquired in the barcode read signal acquisition step, in response to a timing when the captured image is created in the captured image creation step; 6. The image display method according to claim 5, further comprising:

7. A camera that captures the area around the barcode reader of the cash register, A control means for creating a capture image based on a camera image captured by the camera; A display means for displaying the captured image; An image display method for an image display device comprising: The control means a camera image acquisition step of acquiring the camera image from the camera; a barcode reading signal acquiring step of acquiring a barcode reading signal outputted by the cash register when the barcode of the commodity is read by the barcode reading unit; a capture image creating step of creating the capture image showing the state of the commodity moving around the barcode reading unit based on the camera image in accordance with a timing of acquiring the barcode read signal in the barcode read signal acquiring step; a capture image output step of outputting the capture image created in the capture image creation step to the display means; 13. An image display method comprising:

8. The control means, in the capture image output step, outputting the camera image acquired in the camera image acquiring step, together with the capture image created in the capture image creating step, to the display means; 8. The image display method according to claim 5, further comprising:

9. A camera that captures the area around the barcode reader of the cash register, A control means for creating a capture image based on a camera image captured by the camera; A display means for displaying the captured image; An image display program for an image display device comprising: The control means a camera image acquisition function for acquiring the camera image from the camera; An image analysis function that performs image analysis processing on the camera image acquired by the camera image acquisition function; a product detection function that determines whether or not a product moving around the barcode reading unit is detected based on the camera image that has been image-analyzed by the image analysis function; a capture image creation function that creates, when the commodity detection function detects a commodity moving around the barcode reading unit, the capture image showing the commodity moving around the barcode reading unit based on the camera image; and a capture image output function for outputting the capture image created by the capture image creation function to the display means; An image display program for realizing the above.

10. The control means a barcode reading signal acquisition function for acquiring a barcode reading signal output by the cash register when the barcode of the commodity is read by the barcode reading unit; a notification function for making a notification when the barcode read signal cannot be acquired by the barcode read signal acquisition function in response to a timing when the capture image is created by the capture image creation function; 10. The image display program according to claim 9, further comprising:

11. A camera that captures the area around the barcode reader of the cash register, A control means for creating a capture image based on a camera image captured by the camera; A display means for displaying the captured image; An image display program for an image display device comprising: The control means a camera image acquisition function for acquiring the camera image from the camera; a barcode reading signal acquisition function for acquiring a barcode reading signal output by the cash register when the barcode of the product is read by the barcode reading unit; a capture image creation function that creates the capture image showing the movement of the product around the barcode reading unit based on the camera image in response to the timing when the barcode reading signal is acquired by the barcode reading signal acquisition function; a capture image output function for outputting the capture image created by the capture image creation function to the display means; An image display program for realizing the above.

12. In the capture image output function, the control means outputting the camera image acquired by the camera image acquisition function to the display means together with the capture image created by the capture image creation function; 12. The image display program according to claim 9, further comprising:

Images