Product number specification device, product number specification method, and program

Abstract

A product quantity identification device (10) comprises an acquisition unit (110), an image processing unit (120), and a calculation unit (130). The acquisition unit (110) acquires a plurality of images generated by an imaging device. The imaging range of the imaging device includes a first area where a product to be paid for is located and a second area different from the first area. The image processing unit (120) processes the plurality of images acquired by the acquisition unit (110) to identify a first number, which is the number of objects placed in the first area, and to identify a second number, which is the number of objects that have moved from the first area to the second area. The calculation unit (130) uses the first number and the second number to calculate a third number, which is the number of products.

Description

[Technical Field]

[0001] The present invention relates to a product number specification device, a product number specification method, and program Regarding. [Background technology]

[0002] In recent years, it has been considered to acquire and process an image of a product when paying for it, and to use the results of this processing.

[0003] For example, Patent Document 1 discloses an object number estimation device that aims to estimate the number of objects contained in an image with little effort. This device first generates a first feature map by performing convolution processing on a target image. Next, this device processes the first feature map to estimate the number of target objects whose sizes fall within a first predetermined range. Next, this device generates a second feature map by performing convolution processing on the first feature map. Next, this device processes the second feature map to estimate the number of target objects whose sizes fall within a second predetermined range. The sizes falling within the first predetermined range are smaller than the sizes falling within the second predetermined range.

[0004] Patent Document 2 discloses an item recognition device aimed at improving the accuracy of item recognition. This device first acquires an image. A camera that generates this image captures an area including a placement surface on which an item to be recognized is placed. Next, this device outputs an image for display to a display device that displays an image on the placement surface. Next, this device generates a background image to be displayed on the placement surface based on a first image captured by the camera. Then, this device acquires a second image. The second image is generated by the camera while the display device is displaying the background image. Then, this device identifies the area of ​​the item placed on the placement surface from the second image.

[0005] Patent Document 3 discloses a device that performs the following process. First, a sensor is provided to detect when a scanned and registered product is moved to a stock section. This device then counts the number of times purchased products are registered by the scanner for each customer, and also counts the number of times the sensor detects the movement of products for each customer. This device then compares the two counts, and if they do not match, it determines that an operational error or fraud has occurred and issues a warning. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] International Publication No. 2021 / 038840 [Patent Document 2] Japanese Patent Application Publication No. 2020-190887 [Patent Document 3] Japanese Patent Application Publication No. 07-182561 Summary of the Invention [Problem to be solved by the invention]

[0007] The inventors have considered determining whether or not there is a possibility that products have been registered inaccurately by comparing the number of products registered by a product registration device with the number of products included in an image captured of an area including the product registration device. When performing this process, it is necessary to accurately detect the number of products included in the image. However, the techniques described in Patent Document 1 and Patent Document 2 above may not be able to accurately detect the number of products.

[0008] In view of the above-mentioned problems, an example of an object of the present invention is to provide a product number specifying device, a product number specifying method, and program The purpose is to provide [Means for solving the problem]

[0009] According to one aspect of the present invention, an acquisition means acquires a plurality of images generated by an imaging means that includes in its imaging range a first area where products to be checked out are placed and a second area different from the first area; an image processing means for processing the plurality of images to identify a first number that is the number of objects arranged in the first area and to identify a second number that is the number of objects that have moved from the first area to the second area; a calculation means for calculating a third number, which is the number of the products, using the first number and the second number; A product number specifying device is provided.

[0010] According to one aspect of the present invention, a computer acquiring a plurality of images generated by an imaging means including in an imaging range a first area in which the products to be checked out are arranged and a second area different from the first area; processing the plurality of images to identify a first number that is a number of objects disposed in the first region and a second number that is a number of objects that have moved from the first region to the second region; A method for specifying the number of products is provided, which calculates a third number, which is the number of products, using the first number and the second number.

[0011] According to one aspect of the present invention, a computer includes: an acquisition function for acquiring a plurality of images generated by an imaging means including in its imaging range a first area in which the products to be checked out are arranged and a second area different from the first area; an image processing function that processes the plurality of images to identify a first number that is the number of objects placed in the first area and to identify a second number that is the number of objects that have moved from the first area to the second area; a calculation function that calculates a third number, which is the number of the products, using the first number and the second number; A program that gives Mu Provided. [Effects of the Invention]

[0012] According to one aspect of the present invention, there is provided a product number specifying device and a product number specifying method that can accurately detect the number of products included in an image. program can provide. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating an overview of a product quantity specification device according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating a usage environment of the product number specifying device. [Figure 3] FIG. 2 is a diagram illustrating an example of a photographing range of a photographing device. [Figure 4] FIG. 2 is a diagram illustrating an example of a functional configuration of a product number identification device. [Figure 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a product number specifying device. [Figure 6] 10 is a flowchart illustrating an example of a process performed by the product number specifying device. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, like components are designated by like reference numerals, and the description thereof will be omitted as appropriate.

[0015] FIG. 1 is a diagram illustrating an overview of a product number determination device 10 according to an embodiment. The product number determination device 10 includes an acquisition unit 110, an image processing unit 120, and a calculation unit 130. The acquisition unit 110 acquires multiple images generated by a photographing device. The photographing range of the photographing device includes a first area in which the products to be checked out are placed, and a second area different from the first area. The image processing unit 120 processes the multiple images acquired by the acquisition unit 110 to determine a first number, which is the number of objects placed in the first area, and a second number, which is the number of objects that have moved from the first area to the second area. The calculation unit 130 uses the first number and the second number to calculate a third number, which is the number of products.

[0016] In the first area, The items to be checked out are placed, merchandise other than Other objects, such as a communication terminal such as a smartphone or a wallet, may be placed in the image. In this case, the first number indicates the sum of the number of products and the number of other objects. In response to this, the product number specifying device 10 specifies a second number, which is the number of objects that have moved from the first area to the second area. By appropriately setting the second area, the second number is more likely to indicate the number of the other objects. The calculation unit 130 then uses the first number and the second number to calculate a third number, which is the number of products. Therefore, the product number specifying device 10 can accurately detect the number of products included in the image.

[0017] A detailed example of the product number specifying device 10 will be described below.

[0018] 2 is a diagram illustrating the environment in which the product quantity specifying device 10 is used. In the example shown in this figure, the product quantity specifying device 10 is used as both a product registration device and a settlement device. However, as will be described later, the product quantity specifying device 10 may be a device, such as a cloud server, separate from the device that registers products and settles payments.

[0019] The product number specifying device 10 is installed in a store or an office. When the product number specifying device 10 is installed in a store, a customer who enters the store operates the product number specifying device 10 when purchasing a product. On the other hand, when the product number specifying device 10 is installed in an office, products are displayed in a corner of the office. Then, a person working in the office operates the product number specifying device 10 when purchasing this product.

[0020] The product number specifying device 10 is used together with a first reading device 20, a second reading device 22, a photographing device 30, and a storage unit 40. In the example shown in the figure, the product number specifying device 10 is used when a customer purchases products, and has a product registration function and a checkout function. In other words, the product number specifying device 10 also functions as a product registration device. Note that the product number specifying device 10 does not necessarily have to have a checkout function. In this case, the product number specifying device 10 transmits information indicating the registered products to the checkout device.

[0021] The first reading device 20 acquires product identification information from the product that the customer is attempting to purchase, i.e., the product that is the subject of payment. The first reading device 20 may acquire the product identification information by reading a code attached to the product, such as a barcode or two-dimensional code, or may acquire the product identification information from a wireless communication tag attached to the product, such as an RFID tag. The first reading device 20 transmits the acquired product identification information to the product count specifying device 10. At this time, the first reading device 20 also transmits information indicating the timing of acquisition of the product identification information, such as acquisition date and time information, to the product count specifying device 10. Hereinafter, this information will be referred to as first timing information. The first timing information may be generated by the product number specifying device 10. In this case, the product number specifying device 10 generates the first timing information to indicate the timing at which the product identification information was acquired from the first reading device 20.

[0022] The second reading device 22 reads information about the payment method for the products from a medium containing the information and outputs the information to the product quantity determination device 10. The payment method for the products is an electronic payment method, such as prepaid electronic money, credit card, or code payment. The second reading device 22 then reads information about the payment method for the products, such as electronic money identification information, a credit card number, or information indicating the payment method, from the medium storing this information. The second reading device 22 may obtain this information by image recognition, by short-range wireless communication, or from an IC chip provided on the medium.

[0023] At least one of the first reading device 20 and the second reading device 22 may be integrated with the product number specifying device 10.

[0024] The photographing device 30 repeatedly generates images at least from the time when the first reading device 20 starts to acquire the commodity identification information from the commodity until the second reading device 22 reads the information related to the payment method. The photographing device 30 may generate images constantly. The frame rate of the photographing device 30 is, for example, 1 fps Over 30 fps However, it is not limited to this.

[0025] The photographing device 30 may be attached to the product number specifying device 10, or may be attached above the product number specifying device 10, for example, on the ceiling.

[0026] The photographing range of the photographing device 30 includes a first area where the products to be checked out are placed, and a second area different from the first area. The first area may be two-dimensional or three-dimensional. Similarly, the second area may be two-dimensional or three-dimensional. Specific examples of these two areas will be described later using other figures. The photographing device 30 then transmits the generated image to the product quantity specifying device 10. At this time, the photographing device 30 also transmits information indicating the timing of generation of the image, for example, generation date and time information, to the product quantity specifying device 10. Hereinafter, this information will be referred to as second timing information.

[0027] The storage unit 40 stores product identification information and prices for each of a plurality of products. The product quantity specifying device 10 uses the information stored in the storage unit 40 when processing the payment for the products. The storage unit 40 may be, for example, a server installed in the store where the product quantity specifying device 10 is located.

[0028] The product quantity specifying device 10 does not have to perform the registration process and the settlement process of the target products. In this case, the product quantity specifying device 10 is a device that performs the registration process and the settlement process, such as a cloud server, separate from the terminal that performs the registration process and the settlement process, such as a POS terminal. The first reading device 20 communicates with this terminal.

[0029] 3 is a diagram illustrating an example of the photographing range of the photographing device 30. In the example shown in this figure, the product quantity specifying device 10 is used when purchasing products and is placed on a stand 50. The stand 50 is sufficiently larger than the product quantity specifying device 10, and a part of it is designated as a first area. The first area is an area where the products that the customer is trying to purchase, i.e., the products to be paid for, are temporarily placed, and is an empty space.

[0030] On the platform 50, accessories of the product quantity determination device 10, such as a first reading device 20 and a second reading device 22, are placed. The first reading device 20 reads product identification information from the products. The second reading device 22 reads information about the payment method used at checkout from a medium such as a mobile terminal or card. The second region includes the area where the medium is placed during this reading. The second region also includes the range in which the second reading device 22 can read information from the medium.

[0031] When a customer purchases a product, they may place a medium or wallet in the first area along with the product. In this case, the customer removes the medium or wallet from the first area and moves it to the second area when paying. Therefore, it is highly likely that an object that moves from the first area to the second area is not a product. The product number determination device 10 processes the multiple images generated by the image capture device 30 to calculate the number of objects that have moved in this way, i.e., the second number.

[0032] Fig. 4 is a diagram showing an example of the functional configuration of the product number specifying device 10. As described using Fig. 1, the product number specifying device 10 has an acquisition unit 110, an image processing unit 120, and a calculation unit 130. In the example shown in this figure, the product number specifying device 10 further has an execution unit 140, a product registration unit 150, and a settlement unit 160.

[0033] As described above, the photographing device 30 is constantly generating images at least while the first reading device 20 is acquiring the commodity identification information. The acquiring unit 110 then acquires the images generated by the photographing device 30. At this time, the acquiring unit 110 also acquires the second timing information.

[0034] The product registration unit 150 acquires product identification information from the first reading device 20. At this time, the product registration unit 150 also acquires first timing information. The product registration unit 150 generates registration information indicating the products to be settled. The registration information includes a list of product identification information for the products to be settled, information indicating the total number of products to be settled, and information indicating the number of each product. Hereinafter, the total number of products based on the registration information will be referred to as the fourth number.

[0035] The image processing unit 120 performs a process of detecting an object present in a first region for each of the multiple images generated by the image capturing device 30. The image processing unit 120 may perform the object detection process using a model generated by machine learning, or may perform the object detection process by feature matching. Information required for the image processing unit 120 to perform the object detection process is stored in, for example, the storage unit 40.

[0036] Then, image processing unit 120 uses the results of these detection processes to calculate the total number of objects present in the first area, i.e., the first number. At this time, image processing unit 120 may track objects across multiple images and identify the first number using the tracking results.

[0037] Furthermore, the image processing unit 120 tracks the object across multiple images to determine the number of objects that have moved from the first area to the second area, i.e., the second number. In this case, even if the same object moves from the first area to the second area multiple times, the image processing unit 120 does not include the second and subsequent movements in the second number.

[0038] Note that image processing unit 120 may continue performing the detection process using newly generated images until the payment process is completed. In this case, image processing unit 120 increments the second number each time an object that has moved from the first area to the second area is detected. In this case, image processing unit 120 does not increment the second number for the second or subsequent movement from the first area to the second area, even if the object moves through the first area, second area, first area, and second area in that order.

[0039] The image processing unit 120 may identify a target image, which is an image to be processed when calculating the second number, using, for example, first timing information and second timing information. For example, the image processing unit 120 may set, as the target image, an image generated during the period from a first predetermined time before the date and time indicated by the first timing information of the first acquired product identification information to a second predetermined time after the date and time indicated by the first timing information of the last acquired product identification information. The first predetermined time is, for example, from 1 second to 30 seconds, but may be outside this range. The second predetermined time is, for example, from 10 seconds to 30 seconds.

[0040] Here, the product indicated by the "first acquired product identification information" is, for example, the product among the products to be paid for by a certain customer, for which the customer first has the first reading device 20 read the product identification information. In other words, the "first acquired product identification information" corresponds to the product identification information that a certain customer first has the first reading device 20 read. For example, when a customer inputs an instruction to start product registration processing into the product number specification device 10, the product identification information input immediately thereafter corresponds to the "first acquired product identification information."

[0041] On the other hand, the product indicated by the "last acquired product identification information" is, for example, the product among the products to be settled by a certain customer, for which the customer last had the first reading device 20 read the product identification information. In other words, the "last acquired product identification information" corresponds to the product identification information that a certain customer last had the first reading device 20 read. For example, when a customer inputs an instruction to proceed to the settlement process into the product number specification device 10, the product identification information input immediately before that corresponds to the "last acquired product identification information."

[0042] Note that specific examples of the "first acquired product identification information" and the "last acquired product identification information" are not limited to the above examples. For example, if there is a predetermined time or more between the dates and times indicated by a certain piece of first timing information and the next piece of first timing information, the "certain first timing information" may be the "first timing information of the last acquired product identification information" of a certain customer. In this case, the "next first timing information" is the product identification information that is first entered among the products that the next customer plans to purchase.

[0043] Furthermore, the image processing unit 120 may identify a third timing, which is the timing when the product number specifying device 10 acquires the information read by the second reading device 22, and select a target image using the third timing. For example, the image processing unit 120 selects, as the target image, an image generated during the period from a first predetermined time before the date and time indicated by the first timing information of the initially acquired product identification information until this third timing.

[0044] The calculation unit 130 calculates a third number, which is the number of products to be settled, using the first number and the second number, as described with reference to Fig. 1. For example, the calculation unit 130 subtracts the second number from the first number to obtain the third number.

[0045] The execution unit 140 executes a predetermined process when the difference between the fourth number, which is the total number of products registered by the product registration unit 150, and the third number is equal to or greater than a reference value. This reference value is, for example, 1, but may be equal to or greater than 2. The difference being equal to or greater than the reference value indicates that the total number of products registered in the product registration unit 150 may differ from the total number of products that customers or office workers are attempting to purchase. An example of the predetermined process is outputting warning information. The execution unit 140 may output the warning information to a display or speaker provided in the product quantity identification device 10, or may output the warning information to a terminal operated by a manager who manages product sales, such as a terminal operated by a store clerk.

[0046] If the execution unit 140 does not perform the predetermined process, i.e., if there is a high possibility that the total number of products registered in the product registration unit 150 matches the total number of products that customers or office workers are trying to purchase, the settlement unit 160 performs settlement processing using the registration information generated by the product registration unit 150, i.e., a list of product identification information for the products to be settled. At this time, the settlement unit 160 uses the information stored in the storage unit 40.

[0047] Note that when the product number specifying device 10 is used as a device separate from the device that registers and settles products, such as a cloud server, the product number specifying device 10 does not include the product registration unit 150 and the settlement unit 160. In this case, a device having the product registration unit 150 and the settlement unit 160, such as a POS terminal, is placed in the position of the product number specifying device 10 in FIG. 3, for example. Hereinafter, this device will be referred to as the registration settlement device. The product number specifying device 10 then acquires information indicating the fourth number from the registration settlement device. The execution unit 140 of the product number specifying device 10 transmits information indicating whether the difference between the third number and the fourth number is equal to or greater than a reference value to the registration settlement device. When the difference between the third number and the fourth number is equal to or greater than the reference value, the registration settlement device displays predetermined information on the display of the device or outputs it from the speaker of the device.

[0048] 5 is a diagram showing an example of the hardware configuration of the product number specifying device 10. The product number specifying device 10 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0049] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0050] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0051] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0052] The storage device 1040 is an auxiliary storage device realized by removable media such as a hard disk drive (HDD), a solid state drive (SSD), or a memory card, or a read-only memory (ROM), and has a recording medium. The recording medium of the storage device 1040 stores program modules that realize each function of the product quantity identification device 10 (e.g., the acquisition unit 110, the image processing unit 120, the calculation unit 130, the execution unit 140, the product registration unit 150, and the settlement unit 160). The processor 1020 loads each of these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 may also function as the memory unit 40.

[0053] The input / output interface 1050 is an interface for connecting the product quantity specifying device 10 to various input / output devices. For example, the product quantity specifying device 10 communicates with at least one of the first reading device 20, the second reading device 22, the photographing device 30, and the storage unit 40 via the input / output interface 1050.

[0054] The network interface 1060 is an interface for connecting the product quantity specifying device 10 to a network. This network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The network interface 1060 may be connected to the network wirelessly or by wire. The product quantity specifying device 10 may communicate with at least one of the photographing device 30 and the storage unit 40 via the network interface 1060.

[0055] FIG. 6 is a flowchart showing an example of the process performed by the product number specifying device 10.

[0056] When a customer or an office worker purchases a product, the product identification information of the product is read by the first reading device 20. The product registration unit 150 of the product number identification device 10 acquires this product identification information. If there are multiple products to be purchased, the product registration unit 150 acquires the product identification information for each of the multiple products. Then, the product registration unit 150 calculates the fourth number (step S10).

[0057] Then, after the customer has caused the first reading device 20 to read the product identification information from all the products, the customer causes the second reading device 22 to read information about the payment method from the medium (step S20).

[0058] The acquisition unit 110 also acquires a plurality of images generated by the photographing device 30. At least some of these images are generated while the above-described processing is being performed. The image processing unit 120 then processes these images to calculate the first number and the second number (step S30). A specific example of the processing performed here is as described with reference to FIG. 4.

[0059] Then, the calculation unit 130 calculates the third number using the first number and the second number calculated by the image processing unit 120 (step S40). A specific example of the processing performed here is as described with reference to FIG.

[0060] If the difference between the fourth number and the third number is equal to or greater than the reference value (Step S50: Yes), the execution unit 140 executes a predetermined process (Step S60). One example of the predetermined process is a warning process. Thereafter, the product number specification device 10 returns to Step S10.

[0061] On the other hand, if the difference between the fourth number and the third number is less than the reference value (step S50: No), the settlement unit 160 performs settlement processing using the information about the payment method read by the second reading device 22 (step S70).

[0062] As described above, according to this embodiment, the image processing unit 120 of the product quantity specifying device 10 processes multiple images generated by the photographing device 30 to specify a first number, which is the number of objects placed in the first area, and a second number, which is the number of objects moved from the first area to the second area. The first area contains products to be checked out, but may also contain objects other than the products, such as a communication device such as a smartphone or a wallet. In this case, the first number indicates the sum of the number of products and the number of other objects. The calculation unit 130 then uses the first number and the second number to calculate a third number, which is the number of products. Therefore, the product quantity specifying device 10 can accurately detect the number of products included in an image.

[0063] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.

[0064] In addition, although the flowcharts used in the above description show multiple steps (processes) in a sequential order, the execution order of the steps in each embodiment is not limited to the order shown. In each embodiment, the order of the steps shown in the drawings can be changed to the extent that the content is not affected. Furthermore, at least one step may be performed by another operating entity, such as another device or person. Furthermore, the above-described embodiments can be combined to the extent that the content is not contradictory.

[0065] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. An acquisition means for acquiring a plurality of images generated by an imaging means that includes in its imaging range a first area in which the products to be checked out are placed and a second area different from the first area; an image processing means for processing the plurality of images to identify a first number that is the number of objects arranged in the first area and to identify a second number that is the number of objects that have moved from the first area to the second area; a calculation means for calculating a third number, which is the number of the products, using the first number and the second number; A product number specifying device comprising: 2. In the product number specifying device described in 1 above, The second area includes an area where a medium having information regarding a payment method for the products is placed when the information is input into a payment device. 3. In the product number specifying device described in 2 above, The settlement device acquires the information from a reading device that reads the information from the medium, The second region includes a range in which the reading device can read the information from the medium. 4. In the product number specifying device described in 2 or 3 above, The image processing means Identifying the timing when the information was input to the settlement device; selecting a target image from the plurality of images using the timing; A product number identification device that identifies the second number using the target image. 5. In the product number specifying device described in any one of 1 to 4 above, The image processing means, when the same object moves from the first area to the second area multiple times, does not include the second or subsequent movements in the second number. 6. In the product number specifying device according to any one of the above items 1 to 4, The product number specification device includes an execution means for executing a predetermined process when the difference between a fourth number, which is the number of products registered by the product registration means, and the third number is equal to or greater than a reference value. 7. The computer acquiring a plurality of images generated by an imaging means including in an imaging range a first area in which the products to be checked out are arranged and a second area different from the first area; processing the plurality of images to identify a first number that is a number of objects disposed in the first region and a second number that is a number of objects that have moved from the first region to the second region; A method for specifying the number of products, which calculates a third number, which is the number of products, using the first number and the second number. 8. In the method for specifying the number of products described in 7 above, A method for specifying the number of products, wherein the second area includes an area where a medium having information regarding the payment method for the products is placed when the information is input into a payment device. 9. In the method for specifying the number of products described in 8 above, The settlement device acquires the information from a reading device that reads the information from the medium, The second area includes a range in which the reading device can read the information from the medium. 10. In the method for specifying the number of products described in 8 or 9 above, The computer Identifying the timing when the information was input to the settlement device; selecting a target image from the plurality of images using the timing; A method for identifying the number of products, the method including identifying the second number using the target image. 11. In the method for specifying the number of products described in any one of 7 to 10 above, A method for determining the number of products, wherein if the same object moves from the first area to the second area multiple times, the computer does not include the second or subsequent movements in the second number. 12. In the method for specifying the number of products described in any one of 7 to 10 above, The computer executes a predetermined process when the difference between a fourth number, which is the number of products registered by the product registration means, and the third number is equal to or greater than a reference value. 13. On the computer, an acquisition function for acquiring a plurality of images generated by an imaging means including in its imaging range a first area in which the products to be checked out are arranged and a second area different from the first area; an image processing function that processes the plurality of images to identify a first number that is the number of objects placed in the first area and to identify a second number that is the number of objects that have moved from the first area to the second area; a calculation function that calculates a third number, which is the number of the products, using the first number and the second number; A computer-readable recording medium that records a program that allows a computer to 14. The recording medium according to 13 above, The second area is a recording medium including an area in which a medium having information regarding the payment method for the product is placed when the information is input into the settlement device. 15. The recording medium according to claim 14, The settlement device acquires the information from a reading device that reads the information from the medium, A recording medium, wherein the second area includes a range in which the reading device can read the information from the medium. 16. The recording medium according to 14 or 15 above, The image processing function includes: Identifying the timing when the information was input to the settlement device; selecting a target image from the plurality of images using the timing; A recording medium for identifying the second number using the target image. 17. The recording medium according to any one of the above items 13 to 16, A recording medium, wherein the image processing function is such that when the same object moves from the first area to the second area multiple times, the second and subsequent movements are not included in the second number. 18. The recording medium according to any one of the above items 13 to 16, The program is a recording medium that gives the computer an execution function of executing a predetermined process when the difference between the fourth number, which is the number of products registered by the product registration means, and the third number is equal to or greater than a reference value. 19. The program according to any one of items 13 to 18 above. [Explanation of symbols]

[0066] 10 Product number identification device 20 First reading device 22 Second reading device 30 Imaging equipment 40 Storage section 110 Acquisition Department 120 Image processing unit 130 Calculation Unit 140 Executive Department 150 Product Registration Department 160 Settlement Department

Claims

1. an acquisition means for acquiring a plurality of images generated by an imaging means including in its imaging range a first area in which the products to be checked out are arranged and a second area different from the first area; an image processing means for processing the plurality of images to identify a first number that is the number of objects arranged in the first area and to identify a second number that is the number of objects that have moved from the first area to the second area; a calculation means for calculating a third number, which is the number of the products, using the first number and the second number; A product number specifying device comprising:

2. 2. The product number specifying device according to claim 1, The second area includes an area in which a medium having information regarding a payment method for the products is placed.

3. 3. The product number specifying device according to claim 2, The second area includes a readable range of a reading device that reads the information from the medium.

4. 4. The product number specifying device according to claim 3, The image processing means Identifying the timing of acquiring the information from the reading device; selecting a target image from the plurality of images using the timing; A product number identification device that identifies the second number using the target image.

5. The product number specification device according to any one of claims 1 to 4, The image processing means, when the same object moves from the first area to the second area multiple times, does not include the second or subsequent movements in the second number.

6. The product number specification device according to any one of claims 1 to 4, The product number specifying device includes an execution means for executing a predetermined process when the difference between a fourth number, which is the number of products registered by the product registration means, and the third number is equal to or greater than a reference value.

7. The computer acquiring a plurality of images generated by an imaging means including in an imaging range a first area in which the products to be checked out are arranged and a second area different from the first area; processing the plurality of images to identify a first number that is a number of objects located in the first region and a second number that is a number of objects that have moved from the first region to the second region; A method for specifying the number of products, the method comprising: calculating a third number, which is the number of products, using the first number and the second number.

8. On the computer, an acquisition function for acquiring a plurality of images generated by an imaging means including in its imaging range a first area in which the products to be checked out are arranged and a second area different from the first area; an image processing function that processes the plurality of images to identify a first number that is the number of objects arranged in the first area and to identify a second number that is the number of objects that have moved from the first area to the second area; a calculation function that calculates a third number, which is the number of the products, using the first number and the second number; A program that allows you to have

Images