Article identification system, article identification device, program

Abstract

To provide an article identification system, an article identification device, and a program that can recognize multiple articles in a batch and calculate their quantities.SOLUTION: A CPU of an identification terminal 4 of an article identification system 1 accepts an input by an operator of the number of articles arranged on a photography table 2. The CPU instructs a photographing device 3 to acquire a captured image of a captured area P on the photographing table 2. The CPU performs image processing on the captured image to extract codes in the captured image. The CPU can perform processing to calculate the number of extracted codes.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an article identification system, an article identification device, and a program for collectively identifying information of a plurality of articles.

Background Art

[0002] Devices that can collectively recognize information of a plurality of products are known. The product registration device described in Patent Document 1 can collectively recognize a plurality of products by photographing a plurality of products on a tray and collectively reading barcodes of the products in the photographed image.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when products are arranged overlapping on a tray, the barcode may be hidden by other products in the photographed image, and the number of barcodes read from the photographed image may differ from the actual number of products on the tray.

[0005] An object of the present invention is to provide an article identification system, an article identification device, and a program that can collectively recognize a plurality of articles and calculate the quantity.

Means for Solving the Problems

[0006] According to a first aspect of the present invention, an article identification system is provided, comprising: an input unit for receiving operation input; an imaging unit for imaging a predetermined imaging range; and a control unit capable of controlling the input unit and the imaging unit, wherein a plurality of articles, each pre-assigned with a code for individual identification, are arranged within the imaging range of the imaging unit; the control unit is capable of performing an input process for receiving input of the number of articles, which is the quantity of the articles, from the input unit; and further, the system is characterized by performing an imaging process for imaging the imaging range with the imaging unit; an extraction process for extracting the codes from the image captured by imaging the imaging range; and a calculation process for calculating the number of codes extracted in the extraction process, which is the number of codes.

[0007] The operator can input the quantity of items placed within the shooting range into the item identification system via the input unit. Meanwhile, the control unit of the item identification system can extract the codes assigned to each item from the captured image of multiple items placed within the shooting range and calculate the number of codes. Therefore, if the number of items the operator entered differs from the number of codes calculated by the item identification system, the operator can know that there is a problem with the system's identification of items or that the number of items the operator entered is incorrect.

[0008] This embodiment includes a display unit for displaying information, and the control unit may, after receiving the input of the number of items in the input process, execute a point display process to display the code points calculated in the calculation process on the display unit. If the code points are displayed before the input of the number of items, the operator may be misled by the code points and input the wrong number of items. The item identification system can suppress input errors in the number of items by having the operator input the number of items before the display of the code points.

[0009] The control unit in this embodiment may perform a comparison process that compares the number of items with the number of codes, and a result display process that, if the number of items and the number of codes match, displays a match indication on the display unit indicating that the number of items and the number of codes match. The item identification system can compare the calculated number of codes with the number of items entered by the operator and display a match indication if they match. Therefore, the operator can confirm that the number of items matches the number of codes.

[0010] In this embodiment, if the number of items and the number of codes differ as a result of the comparison process, the control unit may, in the result display process, display a mismatch indication on the display unit indicating that the number of items and the number of codes do not match. The item identification system can compare the calculated number of codes with the number of items entered by the operator and display a mismatch indication if they differ. Therefore, the operator can know that the number of items differs from the number of codes.

[0011] In this embodiment, if the control unit displays the mismatch indication in the result display process, it may execute a re-input process to accept re-input of the number of items in the input unit. If the number of items differs from the code number, the number of items can be checked and the number of items can be re-input. Therefore, the operator can correct the input error of the number of items.

[0012] In this embodiment, if the control unit displays the mismatch display in the result display process, it may re-execute the shooting process, the extraction process, and the calculation process to recalculate the number of code points. If the number of items differs from the number of code points, the operator can, for example, rearrange the items in the captured image where the code reading was not performed correctly. Then, the item identification system can re-shoot the multiple items and recalculate the number of code points. Therefore, the item identification system can, for example, extract codes that failed to be extracted due to the arrangement of the items and correct the number of code points.

[0013] In this embodiment, the control unit may perform the image capture process before or simultaneously with the input process. By starting the image capture process of the item identification system before or simultaneously with the operator's numerical input, the waiting time required for recognition can be reduced.

[0014] This embodiment includes a storage unit that stores item information, which is information about the item, and the code in association with each other. The control unit may perform an acquisition process to obtain the item information corresponding to the code extracted in the extraction process from the storage unit, and perform a list display process to display a list of the item information on the display unit. The item identification system can display a list of item information corresponding to each code extracted from the captured images of multiple items. Therefore, the operator can check whether the item information for each item placed within the shooting range is displayed and confirm whether the item code has been correctly extracted.

[0015] In this embodiment, the control unit may perform an image display process on the display unit to display the captured image taken in the shooting process. The item identification system can display the captured image on the display unit. Therefore, the operator can confirm whether multiple items are arranged correctly in the captured image.

[0016] The control unit in this embodiment may perform a marking process to display a mark indicating that the code extracted in the extraction process has been extracted in the area of ​​the captured image where the extracted code is displayed. The item identification system can display a mark on each of the codes extracted from the captured image. Therefore, the operator can confirm in the captured image whether multiple items are arranged correctly and whether each code has been extracted correctly.

[0017] The control unit in this embodiment may perform an information display process in which an item information display indicating the item information acquired in the acquisition process is displayed near the area in the captured image where the code extracted in the extraction process is displayed. The item identification system can display an item information display for each of the codes extracted from the captured image. Therefore, the operator can confirm whether each of the multiple items placed within the shooting range is correctly recognized based on the item information display displayed on the captured image.

[0018] According to a second aspect of the present invention, an article identification device is provided, comprising an input unit that receives input for operations and a control unit that controls an imaging unit that images a predetermined imaging range, wherein a plurality of articles, each pre-assigned with a code for individual identification, are arranged within the imaging range of the imaging unit, the control unit is capable of performing an input process that can obtain an article count, which is the number of articles that have been input to the input unit, and further comprising an imaging process that obtains an image of the imaging range captured by the imaging unit, an extraction process that extracts the codes from the image, and a calculation process that calculates a code count, which is the number of codes extracted in the extraction process. According to the second aspect, the same effects as the first aspect are achieved.

[0019] According to a third aspect of the present invention, a program is provided that can be executed by a computer of an article identification device capable of controlling an input unit that receives input for operations and an imaging unit that images a predetermined imaging range, wherein a plurality of articles, each pre-assigned with a code for individual identification, are placed within the imaging range of the imaging unit, and the program can cause the computer to execute an input process that can acquire the number of articles, which is the quantity of articles that have been input by the input unit, and further, the program is characterized by causing the computer to execute an imaging process that acquires an image of the imaging range captured by the imaging unit, an extraction process that extracts the codes from the image, and a calculation process that calculates the number of codes extracted in the extraction process, which is the number of codes. According to the third aspect, the same effects as the first aspect are achieved.

Brief Description of the Drawings

[0020] [Figure 1] It is a perspective view showing the appearance of the article identification system 1. [Figure 2] It is a block diagram showing the electrical configuration of the article identification system. [Figure 3] It is an example display of the article identification screen 50. [Figure 4] It is a conceptual diagram of the product information database 60. [Figure 5] It is a flowchart of the article identification process. [Figure 6] It is a continuation of the flowchart of the article identification process. <00�0090>It is an example display of the initial state of the article identification screen 50. [Figure 8] It is an example display when a mark is displayed on the article identification screen 50. <000009〖〗4>It is an example display when the product name is displayed on the article identification screen 50. [Figure 10] It is an example display when a mark and the product name are displayed on the article identification screen 50 when articles are arranged overlapping each other and no AR object is extracted.

Modes for Carrying Out the Invention

[0021] Referring to the drawings, the article identification system 1 according to an embodiment of the present invention will be described. The article identification system 1 is a system that photographs a plurality of articles each provided with an identification code, presents the number of codes extracted from the photographed image, and enables an operator to easily confirm whether there is any mistake in the score of the articles. The article identification system 1 is used, for example, as a system for collectively identifying a plurality of products at the time of settlement in a store that sells articles as products.

[0022] As shown in Figure 1, the item identification system 1 comprises a shooting table 2, a shooting device 3, and an identification terminal 4. The shooting table 2 is a platform that indicates the position for placing multiple items to be photographed. In this embodiment, a tray 25 for holding multiple items is prepared, and by placing the tray 25 on the shooting table 2, all items on the tray 25 are placed within the shooting range P. Each item is individually packaged in a transparent bag, and a label sticker 26 with the product name and a different code for each type of product is attached in advance. The code is, for example, an AR marker.

[0023] The imaging device 3 is a device that photographs a preset imaging range P on the imaging table 2 from above the imaging table 2. The imaging device 3 has a columnar portion fixed to the side of the imaging table 2 and extending upward, an arm-shaped portion at the top of the columnar portion that extends towards the center and above the imaging table 2, and an imaging unit 31 provided at the bottom of the arm-shaped portion that directs the imaging direction toward the imaging table 2 located below. The imaging unit 31 is assembled to the imaging device 3 after its imaging direction and field of view have been adjusted in advance to photograph the imaging range P of the imaging table 2.

[0024] The identification terminal 4 is, for example, a well-known tablet device. The identification terminal 4 connects to the camera 3 using a known USB cable 35 and acquires captured images or video footage of the shooting range P captured by the camera 3. In the following description, if there is no particular distinction between captured images (still images) and captured video footage (moving footage), they will be referred to as captured images. As will be described in detail later, the identification terminal 4 accepts input from the operator and displays on the screen the captured images taken by the camera 3, the number of codes extracted from the captured images, a list of product information corresponding to the codes, etc. The identification terminal 4 may be used as a terminal device for a point-of-sale (POS) system (not shown), or it may be used in connection with a cash register (not shown).

[0025] Referring to Figure 2, the electrical configuration of the item identification system 1 will be described. The imaging device 3 has an imaging unit 31 and a control unit 32. The imaging unit 31 is a known CCD image sensor or CMOS image sensor. The control unit 32 processes the data output from the imaging unit 31 to generate image data of the captured image and outputs it to the identification terminal 4. When outputting captured video, the control unit 32 continuously generates image data according to the frame rate and outputs it as video data to the identification terminal 4.

[0026] The identification terminal 4 has a control unit 41, a storage unit 42, a touch panel 43, and a USB interface 46. The control unit 41 includes a known CPU, ROM, and RAM (not shown). The CPU controls the identification terminal 4. The ROM stores the boot program and initial setup information. The RAM temporarily stores data during the process of the CPU executing processing. The storage unit 42 is, for example, flash memory. The storage unit 42 stores a control program to be executed by the CPU, an item identification program described later, and an item information database 60 that associates codes with item information.

[0027] The touch panel 43 includes a display unit 44 and an input unit 45. The display unit 44 is a liquid crystal display. The input unit 45 is a touch panel provided on the surface of the display unit 44. The USB interface 46 performs data communication with the imaging device 3 according to the USB standard.

[0028] Referring to Figure 3, the screen displayed on the display unit 44 of the identification terminal 4 will be explained. In the item identification process described later, the item identification screen 50 is displayed on the display unit 44 of the identification terminal 4. The item identification screen 50 includes a point input area 51, a captured image display area 52, a product list display area 53, an OK button 54, an NG button 55, a total amount display area 56, and a total point display area 57.

[0029] The score input area 51 displays operation items for accepting input of the score of items placed on the shooting table 2 via touch operation by the operator. For example, a number from 1 to 10 is displayed to indicate the number of items that the operator can select by touch operation, and a triangle mark is displayed to indicate that operation items can be displayed by swiping when entering a number of 11 or more. When the operator has entered the number of items, a circle mark is displayed to indicate the entered score.

[0030] The image display area 52 displays the image captured by the camera 3 within the shooting range P. The image also shows multiple items placed on the shooting table 2, along with the identification code attached to each item. The product list display area 53 displays a list of product information corresponding to the codes extracted from the image. The product information includes the product name and unit price, and is associated with the codes in the product information database 60, which will be described later.

[0031] The OK button 54 is activated and becomes operable when the number of items entered by the operator matches the number of codes extracted from the captured image. The NG button 55 is activated and becomes operable when the number of items and the number of codes do not match. The total amount display area 56 displays the total amount of the items listed in the product list display area 53. The total points display area 57 displays the total points of the items listed in the product list display area 53. The total points are the number of codes extracted from the captured image.

[0032] Referring to Figure 4, the product information database 60 will be explained. The product information database 60 associates product names and unit prices with information that indicates the characteristics of codes pre-registered as AR markers (for convenience, Figure 4 shows an appearance diagram of the code). The codes are different for each type of product. The product information database 60 is stored in the storage unit 42 when the item identification program is installed on the identification terminal 4.

[0033] The item identification process will be explained with reference to Figures 5 to 9. When an operator performs an operation to start the item identification application via the input unit 45 in the identification terminal 4, the CPU of the control unit 41 reads and executes the item identification program stored in the storage unit 42, thereby starting the item identification process.

[0034] The CPU of the control unit 41 displays the initial state of the item identification screen 50 on the display unit 44. As shown in Figure 7, in the initial state of the item identification screen 50, the point input area 51 is activated, and the number of items can be entered (selected) by touch operation. Nothing other than the items is displayed in the captured image display area 52, the product list display area 53, the total amount display area 56, and the total points display area 57, and the OK button 54 and NG button 55 are inactive.

[0035] As shown in Figure 5, the CPU waits for input of the number of items (S1: NO). When the CPU receives input of the number of items via touch operation by the operator (S1: YES), the CPU stores the entered number of items in the storage unit 42 (S2). The CPU displays a circle mark in the item identification screen 50, in the point input area 51, at a position surrounding the numerical value indicating the entered number of items (S3).

[0036] The CPU issues an instruction to the imaging device 3, and the imaging unit 31 begins imaging the imaging range P (S5). The imaging range P is captured as video. The CPU receives video data from the control unit 32 of the imaging device 3 and begins displaying it in the image display area 52 of the display unit 44 (S6).

[0037] The CPU acquires captured images from the video data and performs code extraction processing on the acquired captured images (S7). In the code extraction process, objects that have feature parts as AR markers in the captured images are extracted as AR objects. Note that the packaging of an item may overlap with the codes of other items, but if the packaging is transparent, it will have little effect on the process of extracting AR objects.

[0038] The CPU displays a marker (S8) on each of the AR objects extracted by the code extraction process in the captured image displayed in the captured image display area 52 to indicate that it has been extracted as an identification target. As shown in Figure 8, a marker 28 indicating the object extracted as an AR object is displayed superimposed on the captured image. The marker 28 is, for example, a green frame that outlines the contour of the AR object.

[0039] As shown in Figure 5, the CPU queries the product information database 60 in the memory unit 42 to search for product information corresponding to the code indicated by the AR object extracted in the code extraction process (S11). The code query is performed on all product information registered in the product information database 60. Therefore, if product information corresponding to the extracted code is not found (S12: NO) and the code query for all product information is not completed (S15: NO), the CPU returns to S11 and continues the code query. If product information corresponding to the extracted code is found (S12: YES), the CPU reads the product information from the product information database 60 and adds it to the product list created in RAM and stores it (S13). The code query is performed on all codes extracted in S7. Therefore, if there are any codes that have not been queried (S17: NO), the CPU returns the process to S11.

[0040] On the other hand, if product information corresponding to the extracted code is not found (S12: NO), and the code query for all product information is completed (S15: YES), the CPU adds error information to the product list (S16). The CPU proceeds to S17 and continues the code query as long as there are unqueried codes. If the code query for all extracted codes is completed (S17: YES), the CPU proceeds to S21.

[0041] As shown in Figure 6, the CPU stores the product list in the storage unit 42 (S21). The CPU displays the product list in the product list display area 53 of the item identification screen 50 (S22). Next, the CPU displays the product name corresponding to the code near the code in the captured image (video) displayed in the captured image display area 52 (S23). As shown in Figure 9, the product name 29 obtained from the product information corresponding to the code indicated by the AR object is displayed superimposed on the captured image near the position of the AR object extracted in the code extraction process.

[0042] As shown in Figure 6, the CPU multiplies the unit price and quantity of each item in the product list and calculates the total amount by adding up the amounts for each item. It also calculates the total number of items by adding up the quantities of all items (S25). The number of items is the number of codes extracted in the code extraction process. The CPU displays the calculated total amount in the total amount display area 56 and the calculated code points in the total points display area 57 (26).

[0043] The CPU compares the number of items stored in S2 with the number of codes calculated in S25. If the number of items and the number of codes match (S31: YES), the CPU activates the OK button 54 (S32) and waits for the operator to press the OK button 54 (S33: NO). When the OK button 54 is pressed (S33: YES), the CPU issues an instruction to the imaging device 3 to terminate the imaging of the imaging range P by the imaging unit 31. The imaging image display area 52 of the display unit 44 displays the image (still image) that was displayed in the last frame of the imaging video (S35). The CPU then proceeds to accounting processing, which is not shown.

[0044] For example, as shown in Figure 10, when items are placed overlapping with other items, the image portion of the code may not be extracted as an AR object in the captured image, resulting in a discrepancy between the number of codes and the number of items. As shown in Figure 6, in the judgment process of S31, if the number of items and the number of codes do not match (S31:NO), the CPU activates the NG button 55 (S33). The CPU waits for input from the operator via touch operation of the NG button 55 (S42:NO) and for input of the number of items (S45:NO).

[0045] If the number of items and the number of codes differ, the operator recounts the number of items on the scanning table 2. If the previously entered number of items differs from the actual number of items, indicating a counting error, the operator re-enters the correct number of items in the item input area 51.

[0046] When the CPU receives the input of the number of items via touch operation by the operator (S45:YES), it returns to processing S2, stores the input number of items in the storage unit 42 (S2), and displays a circle indicating the number of items in the item input area 51 (S3). Thereafter, the processing from S5 onwards of the item identification process is executed in the same manner as described above.

[0047] In the judgment process of S31, if the number of items and the number of codes do not match, and the number of items on the imaging table 2 is recounted and it is not a counting error, the operator determines that the codes were not extracted correctly because the label stickers 26 of the items overlapped or the items were positioned diagonally relative to the imaging unit 31 (see Figure 10). In this case, the operator rearranges the items on the imaging table 2 and then operates the NG button 55.

[0048] When the NG button 55 is pressed by the operator's touch operation (S42: YES), the CPU returns the display state of the item identification screen 50 to its initial state (S43) and returns to processing S3. The CPU displays a circle indicating the number of items stored in the memory unit 42 in the point input area 51 (S3). Thereafter, the processing from S5 onwards of the item identification process is executed in the same manner as described above.

[0049] As explained above, the operator can input the quantity of items placed within the shooting range P to the identification terminal 4 via the input unit 45. Meanwhile, the control unit 41 of the identification terminal 4 can extract the codes provided on each item from the captured image of multiple items placed within the shooting range P and calculate the number of codes. Therefore, if the number of items the operator has entered differs from the number of codes calculated by the item identification system 1, the operator can know that there is a problem with the system's identification of the items.

[0050] If the code count is displayed before the number of items is entered, the operator may be misled by the code count and enter the wrong number of items. The item identification system 1 can suppress errors in entering the number of items by allowing the operator to enter the number of items (S1) before the display of the code count (S26).

[0051] The item identification system 1 compares the calculated code count with the item count entered by the operator and activates the OK button 54 if they match. Therefore, the operator can confirm that the item count matches the code count.

[0052] The item identification system 1 compares the calculated code count with the item count entered by the operator and activates the NG button 55 if they differ. Therefore, the operator can know that the item count is different from the code count.

[0053] If the number of items differs from the code number, the operator can verify the number of items and re-enter the number of items (S45). Therefore, the operator can correct any errors in entering the number of items.

[0054] If the number of items differs from the number of codes, the operator can, for example, rearrange the items whose codes were not read correctly in the captured image. By operating the NG button 55, the item identification system 1 can re-photograph multiple items and recalculate the number of codes. Therefore, the item identification system 1 can extract codes that failed to be extracted due to the arrangement of the items, for example, and correct the number of codes.

[0055] The item identification system 1 can display product information corresponding to each code extracted from the captured images of multiple items in a list in the product list display area 53. Therefore, the operator can check whether the product information for each item located within the shooting range P is displayed and confirm whether the item codes have been extracted correctly.

[0056] The item identification system 1 can display the captured image in the captured image display area 52 of the item identification screen 50. Therefore, the operator can verify from the captured image whether multiple items are arranged correctly.

[0057] The item identification system 1 can display a marker 28 on each of the codes extracted from the captured image. Therefore, the operator can verify from the captured image whether multiple items are correctly arranged and whether each code has been correctly extracted.

[0058] The item identification system 1 can display the product name 29 for each code extracted from the captured image. Therefore, the operator can confirm whether each of the multiple items placed within the shooting range P has been correctly recognized based on the product information displayed in the captured image.

[0059] In the above embodiment, the display of the OK button 54 corresponds to the "match display" of the present invention. The display of the NG button 55 corresponds to the "mismatch display" of the present invention. The product name 29 corresponds to the "item information display" of the present invention. The process of S1 corresponds to the "input process" of the present invention. The process of S5 corresponds to the "shooting process" of the present invention. The process of S7 corresponds to the "extraction process" of the present invention. The process of S25 corresponds to the "calculation process" of the present invention. The process of S26 corresponds to the "score display process" of the present invention. The processes of S32 and S41 correspond to the "result display process" of the present invention. The process of S45 corresponds to the "re-input process" of the present invention. The process of S13 corresponds to the "acquisition process" of the present invention. The process of S22 corresponds to the "list display process" of the present invention. The process of S6 corresponds to the "image display process" of the present invention. The process of S8 corresponds to the "marker display process" of the present invention. The process of S23 corresponds to the "information display process" of the present invention.

[0060] The present invention can be modified from the above embodiments. Although the code was described using an AR marker as an example, known barcodes, QR codes (registered trademarks), etc. may be used as codes, or a marker developed independently may be used as a code. Application software that enables registration of AR markers may be installed on the identification terminal 4, enabling registration of products in the product information database 60. In addition to the product name and unit price, the product information may include other information such as raw materials, manufacturing date, and allergy information. Furthermore, a printing device capable of printing label stickers may be connected to the identification terminal 4, enabling the creation of label stickers printed with the product name and code registered in the product information database 60.

[0061] Instead of the identification terminal 4, the camera 3 may be connected to a cash register or POS system terminal, and the control unit of the cash register or the terminal of the POS system may perform the same processing as the identification terminal 4. Inputting the number of items is not limited to touch operations on the operation items indicating the number of items; various input methods may be used, such as direct input of the number of items, input by selection from a pull-down menu, input by selection from a rotary dial menu, or input by voice recognition.

[0062] Marker 28 is a frame that outlines the AR object extracted in the code extraction process, but any marker that makes it easy for the operator to recognize the AR object is acceptable, such as a panel that fills in the AR object or an arrow that points to the AR object. In the item identification screen 50, the total score display area 57 that displays the code score may be placed near the captured image display area 52. The product name 29 displayed on the item identification screen 50 is not limited to the product name, but may also include other product information. For example, the product model number, expiration date, allergy information, etc. may be registered in the product information database 60 in advance, and the product name 29 including this information may be displayed near the corresponding code.

[0063] In S5-S26, the CPU of the identification terminal 4 started capturing images of the shooting range P using the shooting device 3, created a product list based on a query to the product information database 60 for the codes extracted from the captured images, and calculated the number of codes. Of these processes, the timing of each process, except for the various display processes on the item identification screen 50 in S8, S22, S23, and S26, may be changed as appropriate. For example, the processes in S5-S7, S11-S21, and S25 may be executed before the input process for the number of items in S1. In this case, it is preferable to accept the operation of buttons to instruct the execution of the processes in S5-S7, S11-S21, and S25 immediately after the start of the item identification process, after confirming that the tray 25 with the items on it has been placed on the shooting table 2. Alternatively, the processes in S5-S7, S11-S21, and S25 may be executed before the process in S2 after the input process for the number of items in S1, or before the process in S3 after the storage process for the number of items in S2. Alternatively, the processes in S5-S7, S11-S21, and S25 may be started simultaneously with the process of displaying the number of items in S3. In either of the above cases, the various display processes on the item identification screen 50 in S8, S22, S23, and S26 are executed after the process of displaying the number of items in S3 has been performed. In this way, by starting the shooting process of the item identification system 1 before the operator inputs numerical values, the waiting time required for recognition can be reduced. The timing of the process of displaying the captured video in S6 may be changed as appropriate as described above, but like the other display processes, it may also be executed after the process of displaying the number of items in S3 has been performed.

[0064] Note that the processes in S5-S7, S11-S21, and S25 may be performed as other processes that run in parallel with the item identification process. In this case, the processes in S5-S7, S11-S21, and S25 may start running in parallel at the same time as the process of displaying the number of items in S3. In this case as well, similar to the above, the various display processes on the item identification screen 50 in S8, S22, S23, and S26 should be executed after the process of displaying the number of items in S3 has been performed.

[0065] Although the identification terminal 4 is a tablet device, other devices such as personal computers and smartphones may be used. Furthermore, the camera function of the tablet device may be used as the photographic device 3. In this case, the tablet device with the camera function will operate as an item identification device and can function independently as the item identification system 1 of this embodiment. [Explanation of symbols]

[0066] 1. Item identification system 3. Imaging device 4. Identification terminal 28 Landmarks 29 Product name 31 Photography Department 41 Control Unit 42 Storage section 44 Display section 45 Input section 50 Item Identification Screen 54 OK button 55 NG button P Shooting range

Claims

1. An input unit that accepts operation input, A camera unit that photographs a predetermined shooting range, A control unit capable of controlling the input unit and the imaging unit An article identification system having, It has a display unit that displays information, Within the imaging range of the imaging unit, a plurality of items, each pre-assigned with a code for individual identification, are placed. The control unit, The input unit can perform an input process to receive input for the number of items, which is the quantity of the items. Furthermore, A shooting process in which the shooting unit captures the shooting range, An extraction process for extracting the code from the captured image taken within the aforementioned shooting range, A calculation process to calculate the number of codes, which is the number of codes extracted in the extraction process, After receiving the number of items in the input process, a point display process is performed to display the code points calculated in the calculation process on the display unit. To execute An item identification system characterized by the following.

2. The control unit, A comparison process that compares the number of items and the number of codes, If the number of items and the number of codes match, a result display process is performed in which the display unit displays a matching indication indicating that the number of items and the number of codes match. To execute The article identification system according to claim 1, characterized by the following:

3. The control unit, If, as a result of the comparison process described above, the number of items and the number of codes differ, the result display process shall display a mismatch indication on the display unit indicating that the number of items and the number of codes do not match. The article identification system according to claim 2, characterized by the following:

4. The control unit, If the aforementioned mismatch is displayed during the result display process, a re-input process is executed to accept re-input of the number of items in the input unit. The article identification system according to claim 3, characterized by the following:

5. The control unit, If the aforementioned mismatch is displayed during the result display process, the shooting process, the extraction process, and the calculation process are executed again to recalculate the code points. The article identification system according to claim 3, characterized by the following:

6. The control unit, Perform the aforementioned shooting process before or simultaneously with the aforementioned input process. An article identification system according to any one of claims 1 to 5, characterized by the above.

7. It has a storage unit that stores the item information, which is information about the item, and the code in association with each other. The control unit, The process involves performing an acquisition process to obtain the item information corresponding to the code extracted in the extraction process from the storage unit, and then performing a list display process to display a list of the item information arranged on the display unit. An article identification system according to any one of claims 1 to 6, characterized by the above.

8. The control unit, The display unit performs an image display process to display the captured image taken in the shooting process. The article identification system according to claim 7, characterized by the following:

9. The control unit, In the extraction process, a marking process is performed to display a mark indicating that the code extracted in the area of ​​the captured image where the extracted code is displayed. The article identification system according to claim 8, characterized by the following:

10. The control unit, An information display process is performed in which an item information display showing the item information acquired in the acquisition process is displayed near the part of the captured image where the code extracted in the extraction process is displayed. The article identification system according to claim 8 or 9, characterized by the following:

11. An input unit that receives input for operations, A camera unit that photographs a predetermined shooting range, A control unit capable of controlling the input unit and the imaging unit An article identification system having, Within the imaging range of the imaging unit, a plurality of items, each pre-assigned with a code for individual identification, are placed. The control unit, The input unit can perform an input process to receive input for the number of items, which is the quantity of the items. Furthermore, A shooting process in which the shooting unit captures the shooting range, An extraction process for extracting the code from the captured image taken within the aforementioned shooting range, A calculation process to calculate the number of codes, which is the number of codes extracted in the extraction process, and Execute, In the input process, after receiving the number of items, the calculation process calculates the number of codes. An item identification system characterized by the following.

12. An item identification device comprising an input unit that receives operation input and a control unit that can control an imaging unit that images a predetermined imaging range, It has a display unit that displays information, Within the imaging range of the imaging unit, a plurality of items, each pre-assigned with a code for individual identification, are placed. The control unit, The input unit can perform an input process that can obtain the number of items, which is the quantity of items that have been received as input. Furthermore, The aforementioned shooting unit performs a shooting process to acquire a captured image in which the shooting range has been captured, An extraction process for extracting the code from the aforementioned captured image, A calculation process to calculate the number of codes, which is the number of codes extracted in the extraction process, After receiving the number of items in the input process, a point display process is performed to display the code points calculated in the calculation process on the display unit. Having An item identification device characterized by the following.

13. An article identification device comprising an input unit that receives input for operations and a control unit that can control an imaging unit that images a predetermined imaging range, Within the imaging range of the imaging unit, a plurality of items, each pre-assigned with a code for individual identification, are placed. The control unit, The input unit can perform an input process that can obtain the number of items, which is the quantity of items that have been received as input. Furthermore, The aforementioned shooting unit performs a shooting process to acquire a captured image in which the shooting range has been captured, An extraction process for extracting the code from the aforementioned captured image, A calculation process to calculate the number of codes, which is the number of codes extracted in the extraction process, and Equipped with, In the input process, after receiving the number of items, the calculation process calculates the number of codes. An item identification device characterized by the following.

14. A program executable by a computer for an object identification device that can control an input unit that receives operation input and an imaging unit that images a predetermined imaging range, The aforementioned article identification device has a display unit that displays information, Within the imaging range of the imaging unit, a plurality of items, each pre-assigned with a code for individual identification, are placed. The aforementioned program, The input unit can be used to cause the computer to perform an input process that can obtain the number of items, which is the quantity of items that have been input. Furthermore, The aforementioned shooting unit performs a shooting process to acquire a captured image in which the shooting range has been captured, An extraction process for extracting the code from the aforementioned captured image, A calculation process to calculate the number of codes, which is the number of codes extracted in the extraction process, After receiving the number of items in the input process, a point display process is performed to display the code points calculated in the calculation process on the display unit. To cause the computer to execute A program characterized by the following.

15. A program executable by a computer for an article identification device that can control an input unit that receives input for operations and an imaging unit that images a predetermined imaging range, Within the imaging range of the imaging unit, a plurality of items, each pre-assigned with a code for individual identification, are placed. The aforementioned program, The input unit can be used to cause the computer to perform an input process that can obtain the number of items, which is the quantity of items that have been input. Furthermore, The aforementioned shooting unit performs a shooting process to acquire a captured image in which the shooting range has been captured, An extraction process for extracting the code from the aforementioned captured image, A calculation process to calculate the number of codes, which is the number of codes extracted in the extraction process, and The computer is made to execute the above, In the input process, after receiving the number of items, the calculation process calculates the number of codes. A program characterized by the following.

Images