Payment device, payment method, and program

Abstract

To enable accurate detection of the number of items included in an image during the checkout process. [Solution] The settlement device includes: acquisition means for acquiring multiple images generated by imaging means whose shooting range includes a first area where the products to be settled are placed and a second area different from the first area; image processing means for identifying a first number, which is the number of objects placed in the first area, and a second number, which is the number of objects that have moved from the first area to the second area, by processing the multiple images; calculation means for calculating a third number, which is the number of products, using the first and second numbers; execution means for executing a predetermined process when the difference between a fourth number, which is the number of products registered as products to be settled, and the third number is greater than or equal to a standard value; and settlement means for executing a settlement process for the products to be settled if the predetermined process has not been executed.

Description

Technical Field

[0001] The present invention relates to a settlement device, a settlement method, and a program.

Background Art

[0002] In recent years, when settling a product, it has been considered to acquire and process an image of the product and utilize the processing result.

[0003] For example, Patent Document 1 discloses an object number estimation device aimed at estimating the number of objects included in an image with less labor. This device first generates a first feature map by performing a convolution process on a target image. Next, this device processes the first feature map to estimate the number of target objects whose size is within a first predetermined range. Next, this device generates a second feature map by performing a convolution process on the first feature map. Next, this device processes the second feature map to estimate the number of target objects whose size is within a second predetermined range. The size included in the first predetermined range is smaller than the size included in the second predetermined range.

[0004] Also, Patent Document 2 discloses an article recognition device aimed at improving the recognition accuracy of an article. This device first acquires an image. The camera that generates this image photographs an area including a placement surface on which an article to be recognized is placed. Next, this device outputs a display image to a display device that displays the image on the placement surface. Next, this device generates a background image to be displayed on the placement surface based on the first image photographed by the above-described camera. And this device acquires a second image. The second image is generated by the above-described camera in a state where the above-described display device displays the above-described background image. And this device specifies the area of the article placed on the placement surface from the second image.

[0005] Furthermore, Patent Document 3 discloses a device that performs the following processing. First, a sensor is provided to detect when a scanned and registered product has been moved to the stock area. This device counts the number of times purchased products have been registered by scanner for each customer, and also counts the number of times the sensor has detected the movement of products for each customer. This device then compares the two counts and, if there is a discrepancy, determines that an operational error or fraud has occurred and issues a warning. [Prior art documents] [Patent Documents]

[0006] [Patent Document 1] International Publication No. 2021 / 038840 [Patent Document 2] Japanese Patent Publication No. 2020-190887 [Patent Document 3] Japanese Patent Application Publication No. 07-182561 [Overview of the project] [Problems that the invention aims to solve]

[0007] The inventors considered determining whether there is a possibility that products are not accurately registered by comparing the number of products registered by a product registration device with the number of products included in an image taken of the area containing the product registration device. When performing this process, it is necessary to accurately detect the number of products included in the image. However, the technologies described in Patent Document 1 and Patent Document 2 mentioned above may not be able to accurately detect the number of products.

[0008] One example of the object of the present invention is to provide a payment device, payment method, and program that can accurately detect the number of items included in an image, in view of the above-mentioned problems. [Means for solving the problem]

[0009] A settlement device in one aspect of this disclosure, An acquisition means that acquires multiple images generated by an imaging means whose shooting range includes a first area where the products to be settled are placed, and a second area different from the first area, Image processing means that, by processing the plurality of images, identifies a first number which is the number of objects placed in the first region, and identifies a second number which is the number of objects that have moved from the first region to the second region. A calculation means for calculating a third number, which is the number of the product, using the first number and the second number, An execution means that performs a predetermined process when the difference between the fourth number, which is the number of items registered as items subject to settlement, and the third number is equal to or greater than a standard value, If the aforementioned predetermined process is not executed, a settlement means for executing a settlement process for the goods subject to settlement, It is equipped with.

[0010] One aspect of this disclosure is the settlement method, which is performed by a computer. Multiple images are obtained from an imaging means whose shooting range includes a first area where the items to be paid for are placed, and a second area different from the first area. By processing the aforementioned multiple images, a first number is identified, which is the number of objects placed in the first region, and a second number is identified, which is the number of objects that have moved from the first region to the second region. Using the first and second numbers, calculate the third number, which is the number of the product. When the difference between the fourth number, which is the number of items registered as items subject to settlement, and the third number is equal to or greater than a certain threshold, a predetermined process is executed. If the aforementioned predetermined process is not executed, the settlement process for the product subject to settlement is executed. This includes the following.

[0011] One aspect of this disclosure is that the program is By being executed by a computer, the computer will Multiple images are obtained from an imaging means whose shooting range includes a first area where the items to be paid for are placed, and a second area different from the first area. By processing the plurality of images, a first number, which is the number of objects arranged in the first region, is specified, and a second number, which is the number of objects that have moved from the first region to the second region, is specified. Using the first number and the second number, a third number, which is the number of the products, is calculated. When the difference between a fourth number, which is the number of products registered as the products to be settled, and the third number is equal to or greater than a reference value, a predetermined process is executed. When the predetermined process is not executed, a settlement process for the products to be settled is executed. An operation including this is caused to be executed.

Advantages of the Invention

[0012] According to one aspect of the present invention, it is possible to provide a settlement device, a settlement method, and a program capable of accurately detecting the number of products included in an image.

Brief Description of the Drawings

[0013] [Figure 1] It is a diagram showing an outline of a product number specifying device according to an embodiment. [Figure 2] It is a diagram for explaining the usage environment of the product number specifying device. [Figure 3] It is a diagram for explaining an example of a shooting range by a shooting device. [Figure 4] It is a diagram showing an example of a functional configuration of the product number specifying device. [Figure 5] It is a diagram showing an example of a hardware configuration of the product number specifying device. [[ID=QQ]] [Figure 6] It is a flowchart showing an example of a process performed by the product number specifying device.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are denoted by the same reference numerals, and the description will be omitted as appropriate.

[0015] Figure 1 is a diagram showing an overview of the product count identification device 10 according to an embodiment. The product count identification device 10 comprises an acquisition unit 110, an image processing unit 120, and a calculation unit 130. The acquisition unit 110 acquires a plurality of images generated by a shooting device. The shooting range of the shooting device includes a first area where the products to be settled are placed, and a second area different from the first area. The image processing unit 120 processes the plurality of images acquired by the acquisition unit 110 to identify a first number, which is the number of objects placed in the first area, and a second number, which is the number of objects that have moved from the first area to the second area. The calculation unit 130 uses the first number and the second number to calculate a third number, which is the number of products.

[0016] The first area may contain other objects related to the products, such as communication devices like smartphones or wallets. In this case, the first number represents the sum of the number of products and the number of other objects. The product count identification device 10 then identifies the second number, which is the number of objects that have moved from the first area to the second area. By appropriately setting the second area, the likelihood that the second number represents the number of the aforementioned other objects increases. The calculation unit 130 then uses the first and second numbers to calculate the third number, which is the number of products. Therefore, the product count identification device 10 can accurately detect the number of products included in an image.

[0017] The following describes a detailed example of the product quantity identification device 10.

[0018] Figure 2 is a diagram illustrating the operating environment of the product count identification device 10. In the example shown in this figure, the product count identification device 10 is used as both a product registration device and a settlement device. However, as will be described later, the product count identification device 10 may be a separate device from the device that performs product registration and settlement, such as a cloud server.

[0019] The product quantity identification device 10 is installed in a store or office. If the product quantity identification device 10 is installed in a store, customers who enter the store operate the product quantity identification device 10 when purchasing products. On the other hand, if the product quantity identification device 10 is installed in an office, products are displayed in a corner of the office. People working in the office then operate the product quantity identification device 10 when purchasing these products.

[0020] The product count identification device 10 is used together with the first reading device 20, the second reading device 22, the imaging device 30, and the storage unit 40. In the example shown in this figure, the product count identification device 10 is used when a customer purchases products and has product registration and payment functions. That is, the product count identification device 10 also functions as a product registration device. The product count identification device 10 does not necessarily have a payment function. In this case, the product count identification device 10 transmits information indicating the registered products to the payment device.

[0021] The first reader 20 obtains product identification information from the product that the customer is about to purchase, i.e., the product subject to payment. The first reader 20 may obtain product identification information by reading a code attached to the product, such as a barcode or a two-dimensional code, or it may obtain product identification information from a wireless communication tag attached to the product, such as an RFID tag. The first reader 20 transmits the obtained product identification information to the product count identification device 10. At this time, the first reader 20 also transmits information indicating the timing of the acquisition of product identification information, such as acquisition date and time information, to the product count identification device 10. Hereinafter, this information will be referred to as the first timing information. The first timing information may be generated by the product count identification device 10. In this case, the product count identification device 10 generates the first timing information to indicate the timing at which it acquired product identification information from the first reader 20.

[0022] The second reader 22 reads information from a medium containing information about the payment method for the product and outputs it to the product count identification device 10. The payment method for the product is an electronic payment method, such as prepaid electronic money, credit card, or code payment. The second reader 22 then reads information indicating the payment method, such as electronic money identification information, credit card number, or code displayed on a terminal, from the medium storing this information. The second reader 22 may acquire this information by image recognition, by short-range wireless communication, or from an IC chip provided on the medium.

[0023] Furthermore, at least one of the first reading device 20 and the second reading device 22 may be integrated with the product quantity identification device 10.

[0024] The imaging device 30 repeatedly generates images at least from the time the first reading device 20 begins to acquire product identification information from the product until the second reading device 22 reads the payment method information. The imaging device 30 may continuously generate images. The frame rate of the imaging device 30 is, for example, 1 fps or more and 30 fps, but is not limited thereto.

[0025] The photographing device 30 may be attached to the product count identification device 10, or it may be attached above the product count identification device 10, for example, to the ceiling.

[0026] The imaging range of the imaging device 30 includes a first area where the products to be settled are placed, and a second area distinct from the first area. The first area may be two-dimensional or three-dimensional. Similarly, the second area may also be two-dimensional or three-dimensional. Specific examples of these two areas will be described later using other diagrams. The imaging device 30 then transmits the generated image to the product count identification device 10. At this time, the imaging device 30 also transmits information indicating the timing of image generation, such as generation date and time information, to the product count identification device 10. Hereafter, this information will be referred to as the second timing information.

[0027] The storage unit 40 stores product identification information and prices for multiple products. The product quantity identification device 10 uses the information stored in the storage unit 40 when processing the settlement of products. The storage unit 40 may be, for example, a server installed in the store where the product quantity identification device 10 is located.

[0028] Furthermore, the product count identification device 10 does not need to perform the registration and settlement processes for the target products. In this case, the product count identification device 10 is a separate device from the terminal that performs the registration and settlement processes, such as a POS terminal, such as a cloud server. The first reading device 20 then communicates with this terminal.

[0029] Figure 3 is a diagram illustrating an example of the shooting range by the shooting device 30. In the example shown in this figure, the product quantity identification device 10 is used when a product is purchased and is placed on a stand 50. The stand 50 is considerably larger than the product quantity identification device 10, and a portion of it is designated as the first area. The first area is an empty space where the product the customer intends to purchase, i.e., the product subject to payment, is temporarily placed.

[0030] On the platform 50 are the auxiliary devices of the product count identification device 10, such as the first reader 20 and the second reader 22. The first reader 20 reads product identification information from the products. The second reader 22 reads information about the payment method used at checkout from a medium such as a mobile terminal or card. The second area includes the area where the medium is placed during this reading. The second area also includes the range from which the second reader 22 can read information from the medium.

[0031] When a customer purchases a product, they may place a medium or wallet along with the product in the first area. In this case, at checkout, the customer removes the medium or wallet from the first area and moves it to the second area. Therefore, objects that have moved from the first area to the second area are likely not products. The product count identification device 10 calculates the number of objects that have moved in this way, i.e., the second number, by processing multiple images generated by the imaging device 30.

[0032] Figure 4 shows an example of the functional configuration of the product count identification device 10. As explained using Figure 1, the product count identification device 10 has an acquisition unit 110, an image processing unit 120, and a calculation unit 130. In the example shown in this figure, the product count identification device 10 further has an execution unit 140, a product registration unit 150, and a settlement unit 160.

[0033] As described above, the imaging device 30 continuously generates an image, at least while the first reading device 20 is acquiring product identification information. The acquisition unit 110 then acquires the image generated by the imaging device 30. At this time, the acquisition unit 110 also acquires second timing information.

[0034] The product registration unit 150 acquires product identification information from the first reader 20. At this time, the product registration unit 150 also acquires first timing information. The product registration unit 150 generates registration information indicating the products subject to settlement. The registration information includes a list of product identification information for the products subject to settlement, information indicating the total number of products subject to settlement, and information indicating the number of each product. Hereinafter, the total number of products based on the registration information will be referred to as the fourth number.

[0035] The image processing unit 120 performs object detection processing for each of the multiple images generated by the imaging device 30, specifically for objects present in the first region. The image processing unit 120 may perform object detection processing using a model generated by machine learning, or it may perform object detection processing using feature matching. Information necessary for the image processing unit 120 to perform object detection processing is stored, for example, in the storage unit 40.

[0036] The image processing unit 120 then uses the results of these detection processes to calculate the total number of objects present in the first region, i.e., the first number. In this process, the image processing unit 120 may track objects across multiple images and use the tracking results to determine the first number.

[0037] Furthermore, the image processing unit 120 tracks objects across multiple images to determine the number of objects that have moved from the first region to the second region, i.e., the second number. In this process, even if the same object moves from the first region to the second region multiple times, the image processing unit 120 does not include the second and subsequent movements in the second number.

[0038] Furthermore, the image processing unit 120 may continue the detection process using the newly generated image until the settlement process is completed. In this case, the image processing unit 120 increments the second number each time an object that has moved from the first region to the second region is detected. However, even if the object moves in the order of the first region, the second region, the first region, and the second region, the image processing unit 120 does not increment the second number for subsequent movements from the first region to the second region.

[0039] The image processing unit 120 may also identify the target image, which is the image to be processed when calculating the second number, using, for example, the first timing information and the second timing information. For example, the image processing unit 120 may use as the target image an image generated between a first predetermined time before the date and time indicated by the first timing information of the first acquired product identification information and a second predetermined time after the date and time indicated by the first timing information of the last acquired product identification information. The first predetermined time is, for example, 1 second or more and 30 seconds or less, but may be outside this range. The second predetermined time is, for example, 10 seconds or more and 30 seconds or less.

[0040] Here, the product referred to as "the first product identification information obtained" is, for example, the product among the products a customer is set up to pay for that the first customer has the product identification information read by the first reader 20. In other words, "the first product identification information obtained" corresponds to the product identification information that a customer first has the first reader 20 read. For example, if a customer inputs a message to the product quantity identification device 10 indicating that they want to start the product registration process, the product identification information entered immediately afterward corresponds to "the first product identification information obtained."

[0041] On the other hand, the product indicated by "the last acquired product identification information" is, for example, the product among the products a customer is set up to pay for that the last time the customer had the product identification information read by the first reader 20. In other words, "the last acquired product identification information" corresponds to the product identification information that a customer last had read by the first reader 20. For example, if a customer inputs into the product quantity identification device 10 that they are moving on to the settlement process, the product identification information entered immediately before that input corresponds to "the last acquired product identification information".

[0042] Note that the specific examples of "the first product identification information obtained" and "the last product identification information obtained" are not limited to the examples above. For example, if there is a certain amount of time between the dates and times indicated by a given first timing information and the next first timing information, "a given first timing information" may be the "first timing information of the last product identification information obtained" for a customer. In this case, "the next first timing information" will be the product identification information entered first among the products that the next customer plans to purchase.

[0043] Alternatively, the image processing unit 120 may identify a third timing, which is the timing at which the product number identification device 10 acquires the information read by the second reading device 22, and use this third timing to select a target image. For example, the image processing unit 120 may select as a target image an image generated between a first predetermined time before the date and time indicated by the first timing information of the initially acquired product identification information and this timing.

[0044] As explained with reference to Figure 1, the calculation unit 130 uses the first number and the second number to calculate the third number, which is the number of items to be settled. For example, the calculation unit 130 takes the value obtained by subtracting the second number from the first number as the third number.

[0045] The execution unit 140 performs a predetermined process when the difference between the fourth number, which is the total number of products registered by the product registration unit 150, and the third number is greater than or equal to a threshold value. This threshold value is, for example, 1, but may be 2 or greater. A difference greater than or equal to this threshold value indicates that there is a possibility that the total number of products registered by the product registration unit 150 is different from the total number of products that customers or people working in the office are trying to purchase. One example of the predetermined process is the output of warning information. The execution unit 140 may output warning information to the display or speaker of the product count identification device 10, or it may output warning information to a terminal operated by an administrator managing product sales, for example, a terminal operated by a store employee.

[0046] If the execution unit 140 does not perform the prescribed processing, that is, if there is a high probability that the total number of products registered in the product registration unit 150 matches the total number of products that customers or people working in the office intend to purchase, the settlement unit 160 performs settlement processing using the registration information generated by the product registration unit 150, i.e., a list of product identification information for products subject to settlement. In this case, the settlement unit 160 uses the information stored in the storage unit 40.

[0047] Furthermore, if the product count identification device 10 is used as a separate device from the device that registers and settles products, such as a cloud server, the product count identification device 10 does not have a product registration unit 150 and a settlement unit 160. In this case, a device having a product registration unit 150 and a settlement unit 160, such as a POS terminal, is placed separately from the product count identification device 10, for example, in the position of the product count identification device 10 in Figure 3. Hereinafter, this device will be referred to as the registration and settlement device. The product count identification device 10 then obtains information indicating the fourth number from this registration and settlement device. The execution unit 140 of the product count identification device 10 transmits information indicating whether the difference between the third number and the fourth number is greater than or equal to a standard value to the registration and settlement device. When the difference between the third number and the fourth number is greater than or equal to a standard value, the registration and settlement device displays predetermined information on its display or outputs it from its speaker.

[0048] Figure 5 shows an example of the hardware configuration of the product count identification device 10. The product count identification device 10 has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0049] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0050] The 1020 processor is a processor implemented in components such as the CPU (Central Processing Unit) and GPU (Graphics Processing Unit).

[0051] Memory 1030 is a main memory device implemented using RAM (Random Access Memory), etc.

[0052] The storage device 1040 is an auxiliary storage device implemented as a removable media such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or memory card, or as ROM (Read Only Memory), and has a recording medium. The recording medium of the storage device 1040 stores program modules that implement each function of the product count identification device 10 (for example, the acquisition unit 110, the image processing unit 120, the calculation unit 130, the execution unit 140, the product registration unit 150, and the settlement unit 160). The processor 1020 reads each of these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to that program module. The storage device 1040 may also function as a storage unit 40.

[0053] The input / output interface 1050 is an interface for connecting the product count identification device 10 with various input / output devices. For example, the product count identification device 10 communicates with at least one of the first reading device 20, the second reading device 22, the imaging device 30, and the storage unit 40 via the input / output interface 1050.

[0054] The network interface 1060 is an interface for connecting the product count identification device 10 to a network. This network may be, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method by which the network interface 1060 connects to the network may be wireless or wired. The product count identification device 10 may communicate with at least one of the imaging device 30 and the storage unit 40 via the network interface 1060.

[0055] Figure 6 is a flowchart showing an example of the processing performed by the product quantity identification device 10.

[0056] When a customer or someone working in the office purchases a product, they have the product identification information of that product read by the first reading device 20. The product registration unit 150 of the product quantity identification device 10 acquires this product identification information. If there are multiple products to be purchased, the product registration unit 150 acquires the product identification information for each of the multiple products. Then the product registration unit 150 calculates the fourth number (step S10).

[0057] Then, after the customer has the first reader 20 read product identification information from all the products, the customer has the second reader 22 read information about the payment method from the medium (step S20).

[0058] Furthermore, the acquisition unit 110 acquires multiple images generated by the imaging device 30. At least some of these multiple images are generated while the above-described processing is being performed. The image processing unit 120 then calculates the first number and the second number by processing these multiple images (step S30). A specific example of the processing performed here is explained with reference to Figure 4.

[0059] Then, the calculation unit 130 calculates a third number using the first and second numbers calculated by the image processing unit 120 (step S40). A specific example of the processing performed here is explained with reference to Figure 4.

[0060] Then, the execution unit 140 executes a predetermined process (step S60) when the difference between the fourth number and the third number is greater than or equal to a standard value (step S50: Yes). An example of a predetermined process is a warning process. After that, the product quantity identification device 10 returns to step S10.

[0061] On the other hand, if the difference between the fourth number and the third number is less than the standard value (step S50: No), the settlement unit 160 performs settlement processing using the information on the settlement means read by the second reading device 22 (step S70).

[0062] As described above, according to this embodiment, the image processing unit 120 of the product count identification device 10 processes multiple images generated by the shooting device 30 to identify a first number, which is the number of objects placed in the first area, and a second number, which is the number of objects that have moved from the first area to the second area. The first area contains the products to be paid for, but other objects, such as communication terminals like smartphones or wallets, may also be placed there. In this case, the first number represents the sum of the number of products and the number of other objects. The calculation unit 130 then uses the first and second numbers to calculate a third number, which is the number of products. Therefore, the product count identification device 10 can accurately detect the number of products included in an image.

[0063] The embodiments of the present invention have been described above with reference to the drawings, but these are merely examples of the present invention, and various other configurations can also be adopted.

[0064] Furthermore, although the flowchart used in the above description shows multiple steps (processes) in order, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content. Also, at least one step may be performed by another operating entity, such as another device or person. In addition, the above embodiments can be combined to the extent that their contents do not conflict.

[0065] Some or all of the above embodiments may also be described as follows, but are not limited to the following: 1. An acquisition means that acquires multiple images generated by an imaging means whose shooting range includes a first area where the products to be settled are placed, and a second area different from the first area. Image processing means that, by processing the plurality of images, identifies a first number which is the number of objects placed in the first region, and identifies a second number which is the number of objects that have moved from the first region to the second region. A calculation means for calculating a third number, which is the number of the product, using the first number and the second number, A device for determining the number of items, equipped with the following features. 2. In the product quantity identification device described in item 1 above, The second area includes an area where a medium containing information regarding the payment method for the product is placed when the information is input to the settlement device, and is a product quantity identification device. 3. In the product quantity identification device described in item 2 above, The settlement device obtains the information from a reading device that reads the information from the medium, The second region includes a range in which the reading device can read the information from the medium, and is a product count identification device. 4. In the product quantity identification device described in item 2 or 3 above, The aforementioned image processing means is The timing at which the information is input to the settlement device is identified, Using the aforementioned timing, select the target image from the multiple images, A product quantity identification device that identifies the second number using the aforementioned target image. 5. In the product quantity identification device described in any one of items 1 to 4 above, The image processing means is a product count identification device that, if the same object moves from the first region to the second region multiple times, does not include the second and subsequent movements in the second count. 6. In the product quantity identification device described in any one of items 1 to 4 above, A product quantity identification device comprising an execution means that performs a predetermined process when the difference between a fourth number, which is the number of products registered by the product registration means, and the third number is greater than or equal to a standard value. 7. The computer, Multiple images are obtained from an imaging means whose shooting range includes a first area where the items to be paid for are placed, and a second area different from the first area. By processing the aforementioned multiple images, a first number is identified, which is the number of objects placed in the first region, and a second number is identified, which is the number of objects that have moved from the first region to the second region. A method for determining the number of products, which involves using the first and second numbers to calculate a third number, which is the number of products. 8. In the method for determining the number of products described in item 7 above, The second area includes an area on which a medium containing information regarding the payment method for the product is placed when the information is input to a settlement device, and is a method for determining the number of products. 9. In the method for determining the number of products described in item 8 above, The settlement device obtains the information from a reading device that reads the information from the medium, The second region includes a range in which the reading device can read the information from the medium, and is a method for determining the number of products. 10. In the method for determining the number of products described in 8 or 9 above, The aforementioned computer, The timing at which the information is input to the settlement device is identified, Using the aforementioned timing, select the target image from the multiple images, A method for determining the number of products, which involves determining the second number using the aforementioned target image. 11. In the method for determining the number of products described in any one of items 7 to 10 above, The computer provides a method for determining the number of items, wherein if the same object moves from the first area to the second area multiple times, the second and subsequent movements are not included in the second number. 12. In the method for determining the number of products described in any one of items 7 to 10 above, A method for determining the number of products, wherein the computer performs a predetermined process when the difference between a fourth number, which is the number of products registered by the product registration means, and the third number is greater than or equal to a standard value. 13. To the computer, An acquisition function that acquires multiple images generated by an imaging means whose shooting range includes a first area where the products to be settled are placed, and a second area different from the first area, An image processing function that processes the aforementioned multiple images to identify a first number, which is the number of objects placed in the first region, and a second number, which is the number of objects that moved from the first region to the second region. A calculation function that uses the first and second numbers to calculate a third number, which is the number of the product, A computer-readable recording medium containing a program that enables the possession of a certain feature. 14. In the recording medium described in item 13 above, The second region is a recording medium in which a medium containing information regarding the payment method of the product is placed when the information is input to the settlement device. 15. In the recording medium described in item 14 above, The settlement device obtains the information from a reading device that reads the information from the medium, The second region is a recording medium that includes a range from which the reading device can read the information from the medium. 16. In the recording medium described in item 14 or 15 above, The aforementioned image processing function is The timing at which the information is input to the settlement device is identified, Using the aforementioned timing, select the target image from the multiple images, A recording medium that identifies the second number using the aforementioned target image. 17. In the recording medium described in any one of items 13 to 16 above, The image processing function is a recording medium in which, if the same object moves from the first region to the second region multiple times, the second and subsequent movements are not included in the second number. 18. In the recording medium described in any one of items 13 to 16 above, The program is a recording medium that provides the computer with an execution function that executes a predetermined process when the difference between the fourth number, which is the number of products registered by the product registration means, and the third number is greater than or equal to a standard value. 19. A program described in any one of the above items 13 to 18. [Explanation of Symbols]

[0066] 10 Product number identification device 20 First reading device 22 Second reading device 30 Imaging device 40 Storage section 110 Acquisition Department 120 Image Processing Unit 130 Calculation Unit 140 Execution Unit 150 Product Registration Department 160 Settlement Department

Claims

1. An acquisition means that acquires multiple images generated by an imaging means whose shooting range includes a first area where the products to be settled are placed, and a second area different from the first area, Image processing means that, by processing the plurality of images, identifies a first number which is the number of objects placed in the first region, and identifies a second number which is the number of objects that have moved from the first region to the second region. A calculation means for calculating a third number, which is the number of the product, using the first number and the second number, An execution means that performs a predetermined process when the difference between the fourth number, which is the number of items registered as items subject to settlement, and the third number is equal to or greater than a standard value, If the aforementioned predetermined process is not executed, a settlement means for executing a settlement process for the goods subject to settlement, A payment device equipped with the following features.

2. The aforementioned predetermined process includes a process that outputs warning information. The settlement device according to claim 1.

3. The aforementioned warning information includes information indicating that the total number of items registered as items subject to settlement differs from the total number of items the customer intends to purchase. The settlement device according to claim 2.

4. The execution means outputs the warning information to at least one of the customer who is about to purchase the product subject to settlement and the administrator who manages the sale of the product subject to settlement. The settlement device according to claim 2 or 3.

5. The second region includes a region in which a medium having information regarding the payment method for the product is located. The settlement device according to any one of claims 1 to 4.

6. The second region includes the readable range of a reader device that reads the information from the medium, The settlement device according to claim 5.

7. The aforementioned image processing means is The timing at which the information was acquired from the reading device is identified, Using the aforementioned timing, select the target image from the multiple images, The second number is identified using the aforementioned target image. The settlement device according to claim 6.

8. The image processing means, if the same object moves from the first region to the second region multiple times, does not include the second and subsequent movements in the second count. The settlement device according to any one of claims 1 to 7.

9. Computers Multiple images are obtained from an imaging means whose shooting range includes a first area where the items to be paid for are placed, and a second area different from the first area. By processing the aforementioned multiple images, a first number is identified, which is the number of objects placed in the first region, and a second number is identified, which is the number of objects that have moved from the first region to the second region. Using the first and second numbers, calculate the third number, which is the number of the products. When the difference between the fourth number, which is the number of items registered as items subject to settlement, and the third number is equal to or greater than a certain threshold, a predetermined process is executed. If the aforementioned predetermined process is not executed, the settlement process for the product subject to settlement is executed. A settlement method that includes the following.

10. By being executed by a computer, the computer will Multiple images are obtained from an imaging means whose shooting range includes a first area where the items to be paid for are placed, and a second area different from the first area. By processing the aforementioned multiple images, a first number is identified, which is the number of objects placed in the first region, and a second number is identified, which is the number of objects that have moved from the first region to the second region. Using the first and second numbers, calculate the third number, which is the number of the products. When the difference between the fourth number, which is the number of items registered as items subject to settlement, and the third number is equal to or greater than a certain threshold, a predetermined process is executed. If the aforementioned predetermined process is not executed, the settlement process for the product subject to settlement is executed. A program that performs an action that includes the following.

Images