Information processing device and program

Abstract

To provide an information processing apparatus that can appropriately control processing related to image recognition and processing of uploading an image used for the image recognition to a server.SOLUTION: An information processing apparatus has a function to communicate with an external storage device, and comprises image recognition means, transmission means, and stopping means. The image recognition means performs image recognition on a picked-up image picked up by an imaging unit. The transmission means transmits, to the external storage device, the picked-up image on which the image recognition means has performed image recognition. When the transmission means transmits the picked-up image to the external storage device, the stopping means stops image recognition performed by the image recognition means.SELECTED DRAWING: Figure 14

Description

【Technical Field】 【0001】 Embodiments of the present invention relate to an information processing apparatus and a program. 【Background Art】 【0002】 In stores that sell goods and services (hereinafter collectively referred to as "goods"), a POS (Point Of Sales) system is used. This type of POS system includes a scanner that reads a product code from a barcode attached to a product (hereinafter also referred to as a "product barcode"). Product barcodes include one-dimensional codes and two-dimensional codes. In one example, the product barcode is printed on a sticker and affixed to the product. In another example, the product barcode is printed on a package that houses the product. The POS system registers information on the product that the customer intends to purchase based on the product code read by the scanner. 【0003】 An operator who operates the POS system has to search for the product barcode from the product and hold it in front of the scanner, so the operation of reading the product code is troublesome. As a result, the work of registering product information (hereinafter also referred to as "product registration") by the operator requires time and effort. In particular, in a so-called self-POS system, since a customer who is not used to product registration has to scan the product barcode, it is desired to improve the operability of reading the product code, in other words, the operability of the operator for identifying the product. 【0004】 In such a POS system, by using image recognition technology, it is conceivable to identify a product from features such as the appearance of the product and perform product registration, and to accumulate images captured at the time of product registration on a server on the cloud for AI learning. 【Prior Art Documents】 【Patent Documents】 【0005】 【Patent Document 1】 Japanese Unexamined Patent Application Publication No. 2019-21168 [Patent Document 2] Japanese Patent Publication No. 2023-17957 [Overview of the Initiative] [Problems that the invention aims to solve] 【0006】 The problem that this invention aims to solve is to provide an information processing device and program that can appropriately control the processing related to image recognition and the processing of uploading the images used for image recognition to a server. [Means for solving the problem] 【0007】 The information processing device of this embodiment is an information processing device having a communication function with an external storage device, and comprises an image recognition means, a transmission means, and a stopping means. The image recognition means performs image recognition on an image captured by an imaging unit. The transmission means transmits the image captured by the image recognition means to the external storage device. The stopping means stops the image recognition performed by the image recognition means when the transmission means transmits the image captured to the external storage device. [Brief explanation of the drawing] 【0008】 [Figure 1] Figure 1 shows the overall configuration of the product information management system according to the embodiment. [Figure 2] Figure 2 is a perspective view showing the external appearance of the self-service POS system according to the embodiment. [Figure 3] Figure 3 is a block diagram showing the hardware configuration of the POS terminal in the embodiment. [Figure 4] Figure 4 is a block diagram showing the hardware configuration of the scanner in the embodiment. [Figure 5] Figure 5 is a block diagram showing the hardware configuration of the image recognition device according to the embodiment. [Figure 6] Figure 6 is a block diagram showing the hardware configuration of the server in the embodiment. [Figure 7]Figure 7 shows the data structure of the product master stored in the memory unit of the POS terminal of this embodiment. [Figure 8] Figure 8 shows the data structure of the matching dictionary stored in the memory unit of the image recognition device according to the embodiment. [Figure 9] Figure 9 is a block diagram showing the functional configuration of the control unit of the POS terminal according to the embodiment. [Figure 10] Figure 10 is a block diagram showing the functional configuration of the control unit of the scanner according to the embodiment. [Figure 11] Figure 11 is a block diagram showing the functional configuration of the control unit of the image recognition device according to the embodiment. [Figure 12] Figure 12 is a block diagram showing the functional configuration of the control unit of the server according to the embodiment. [Figure 13] Figure 13 is a flowchart showing the operation flow of the scanner, image recognition device, and server in the embodiment. [Figure 14] Figure 14 is a flowchart showing the operation flow of the scanner and image recognition device in the embodiment. [Figure 15] Figure 15 is a flowchart showing the operation flow of the scanner in the embodiment. [Modes for carrying out the invention] 【0009】 The following describes embodiments of the information processing device and program with reference to the drawings. However, the present invention is not limited to the embodiments described below. 【0010】 (Product Information Management System) First, the product information management system MS of the embodiment will be described with reference to Figure 1. Figure 1 is a diagram showing the overall configuration of the product information management system MS of the embodiment. The product information management system MS includes a product information registration system RS and a server 40. 【0011】 The product information registration system RS includes a POS terminal 10, a scanner 20, and an image recognition device 30. The POS terminal 10 and the scanner 20 are communicably connected via a LAN (Local Area Network) or a USB (Universal Serial Bus). The scanner 20 and the image recognition device 30 are communicably connected via a LAN. 【0012】 In the embodiment, Ethernet (registered trademark) and TCP (Transmission Control Protocol) are used together for LAN communication, but the communication protocol is not limited. 【0013】 The POS terminal 10 and the image recognition device 30 are communicably connected to a LAN hub LH via a LAN. The LAN hub LH is communicably connected to a wireless router WR via a LAN. The wireless router WR can wirelessly communicate with a server 40 via a network NW. 【0014】 The scanner 20 captures an image of a product to obtain a product image which is the captured image. The scanner 20 transmits the obtained product image to the image recognition device 30 via a LAN. Also, the scanner 20 detects and decodes a product barcode (code information: one-dimensional code and two-dimensional code) included in the obtained product image. That is, the scanner 20 reads the information held by the product barcode. The decoding result of the product barcode includes the product code held by the product barcode. The scanner 20 transmits the decoding result to the image recognition device 30 via a LAN. 【0015】 The image recognition device 30 receives product images, which are captured images from the scanner 20, via the LAN. The image recognition device 30 has an image recognition function, for example, using a pre-trained model created by machine learning, and performs image recognition on the product images using this function. Specifically, the image recognition device 30 acquires features contained in the product images using its image recognition function, compares the acquired features with a matching dictionary that associates multiple features with product codes, and obtains the product code associated with the feature that is closest to the acquired feature. In other words, the image recognition result includes the product code of the product shown in the product image. The image recognition device 30 may also perform image recognition on the product images using methods such as deep learning. The image recognition device 30 transmits the image recognition result to the scanner 20 via the LAN. 【0016】 The scanner 20 receives the image recognition results from the image recognition device 30 via LAN. The scanner 20 merges the decoded results and the image recognition results. Here, merging means obtaining a single product code from the decoded results and the image recognition results. Therefore, the merged result includes the product barcode contained in the product image or the product code of the product shown in the product image. The scanner 20 transmits the merged result to the POS terminal 10 via LAN or USB. The POS terminal 10 registers the product based on the product code of the merged result received from the scanner 20. 【0017】 Furthermore, the image recognition device 30 determines whether to use the product images received from the scanner 20 for additional learning or analysis of various states (state analysis). For example, if the difference between the acquired feature and the feature closest to the acquired feature is greater than or equal to a predetermined amount, the image recognition device 30 determines that the product images received from the scanner 20 are product images to be used for additional learning or state analysis. The image recognition device 30 stores the product images determined to be used for additional learning or state analysis, along with the product codes of the decoded results received from the scanner 20, in its storage unit, and transmits (uploads) them to the server 40 (external storage device) via LAN at a pre-set timing. 【0018】 In the image recognition device 30, the timing for uploading product images and product codes determined to be used for additional training or state analysis to the server 40 can be predetermined by the image recognition device 30 or the server 40, or at a timing of the user's choosing. For example, the image recognition device 30 may upload them at predetermined intervals, or when the free space in the storage unit that stores product images and product codes falls below a predetermined level. 【0019】 Furthermore, the product images uploaded from the image recognition device 30 to the server 40 are not limited to product images used for additional training or state analysis; product images for other purposes may also be uploaded. 【0020】 In the image recognition device 30, both the process of recognizing a product image to obtain a product code and the process of uploading the product image and product code to the server 40 are computationally intensive because the data being processed is a large image. Performing both processes simultaneously would result in reduced processing speed and decreased recognition accuracy. Therefore, in the product information management system MS of this embodiment, when uploading a product image saved by the image recognition device 30 to the server 40, the process of recognizing the product image to obtain a product code is not performed. Instead, product identification is performed by detecting the product barcode using the scanner 20 and obtaining the product code. This avoids the impact on the image recognition device 30 without interrupting product identification. 【0021】 Server 40 receives product images and product codes uploaded from image recognition device 30 via LAN. Server 40 stores the received product images and product codes in association with each other. 【0022】 Server 40 uses the stored product images and product codes to perform additional training on the pre-trained model for product image recognition. Server 40 updates the pre-trained model through this additional training. In addition, Server 40 updates the matching dictionary in conjunction with the additional training. Updating the matching dictionary includes modifying existing records and adding new records. Server 40 transmits the updated pre-trained model and the updated matching dictionary to the image recognition device 30 via LAN. 【0023】 The image recognition device 30 receives the updated trained model and the updated matching dictionary from the server 40 via LAN. The image recognition device 30 updates its currently held trained model with the received updated trained model. The image recognition device 30 also updates its currently held matching dictionary with the received updated matching dictionary. 【0024】 In this product information management system (MS), when a product's packaging changes, the effort required to re-collect product images for additional training of the pre-trained model used for product image recognition is eliminated. 【0025】 Server 40 also uses the product images accumulated through uploads from image recognition device 30, for example, to analyze the state (events) of image recognition performed by image recognition device 30. 【0026】 Furthermore, there may be multiple servers 40 on the network NW that upload product images from the image recognition device 30. For example, product images used for additional training may be uploaded to server 40, while product images used for state analysis may be uploaded to another server (external storage device). In this case, product codes do not necessarily have to be attached to the product images used for state analysis. For example, to determine which product image is to be analyzed from the uploaded product images, the determination may be made based on the creation date and time (timestamp) recorded as attribute information (properties) of the product image. 【0027】 Furthermore, server 40 manages the product master. POS terminals 10 transmit accounting information (information related to accounting transactions) to wireless router WR via LAN through LAN hub LH. Wireless router WR transmits the received accounting information to server 40 via network NW. Server 40 manages the product master based on the received accounting information. For example, server 40 receives accounting information from multiple POS terminals 10 and manages a product master for each of the multiple POS terminals 10. Product master management includes modifying existing records and adding new records. Server 40 also transmits a product master appropriate for each POS terminal 10 to that terminal 10 via network NW, wireless router WR, and LAN hub LH. 【0028】 (Product Information Registration System) The following describes a self-service POS system, operated by the customer purchasing the product, as an example of a product information registration system. However, product information registration systems are not limited to self-service POS systems. A product information registration system may also be a POS system operated by the store staff selling the product. 【0029】 Figure 2 is a perspective view showing the external appearance of the self-service POS system 1. The self-service POS system 1 comprises a POS terminal 10, a scanner 20 built into the POS terminal 10, and an image recognition device 30 built into the POS terminal 10. Here, the self-service POS system 1 is an example of a product information registration system, the POS terminal 10 is an example of a registration device, and the scanner 20 and image recognition device 30 are examples of information processing devices. 【0030】 The scanner 20 identifies the product the customer is purchasing and transmits the product code of the identified product to the POS terminal 10. The product code is an example of product identification information that identifies a product. The POS terminal 10 registers the product based on the product code entered from the scanner 20 and also performs accounting processing related to the registered product. Accounting processing is the process that the POS terminal 10 performs in order for the customer to pay for the purchased product. 【0031】 As shown in Figure 2, the POS terminal 10 comprises a main unit 50, a first basket stand 70, and a second basket stand 80. The main unit 50 has a display 51 and a touch panel 52 on its top, and houses a printer 53, a card reader 54, and a change dispenser 55 (see Figure 3 for each) inside. 【0032】 Display 51 is a display device such as an LCD (Liquid Crystal Display) that displays various information. For example, display 51 displays product information such as the product name and price of products registered by the customer during the customer registration operation. Display 51 also displays accounting information such as the total transaction amount and change amount in conjunction with the customer's accounting operation. 【0033】 The touch panel 52 is located on the surface of the display 51 and inputs information corresponding to the touch location to the control unit 100 (see Figure 3) of the POS terminal 10. Customers or administrators (both operators who are users) using the POS terminal 10 can operate the touch panel 52 by touching various buttons and operation keys displayed on the display 51. 【0034】 As shown in Figure 2, below the display 51, facing the direction of the customer, are the reading window 230 for the scanner 20, the receipt printing slot 531 for the printer 53, and the card insertion slot 541 for the card reader 54. 【0035】 The reading window 230 is a window through which the scanner 20 captures an image of the product's appearance. The customer, who is the operator of the self-service POS system 1, performs the product registration operation by holding the product they wish to purchase over the reading window 230. The customer holds the product over the reading window 230, changing its orientation, until the self-service POS system 1 completes the product registration and a registration completion sound is emitted. 【0036】 The issuing slot 531 is an opening for ejecting receipts printed by the printer 53. The receipts have information (accounting information) related to the transactions processed by the POS terminal 10 printed on them. The POS terminal 10 may also be configured to issue electronic receipts instead of paper receipts printed by the printer 53. 【0037】 The card slot 541 is an opening for inserting credit cards or other cards to be read by the card reader 54. When a customer makes a payment with a credit card, or when a customer has a store membership card or similar card read, a card is inserted through the card slot 541. 【0038】 Furthermore, the main body 50 has a coin slot 551, a coin outlet 552, a coin tray 553, a banknote slot 554, and a banknote outlet 555, which correspond to the position of the change machine 55 housed inside. 【0039】 The coin slot 551 is an opening into which customers insert coins to pay. Coins inserted into the coin slot 551 are stored in the change machine 55. The coin outlet 552 is an opening that discharges coins dispensed from the change machine 55. The coin outlet 552 discharges change or coins that were inserted into the coin slot 551 but not accepted by the change machine 55. The coin tray 553 is a tray that receives coins discharged from the coin outlet 552. The banknote slot 554 is an opening into which customers insert banknotes to pay. Banknotes inserted into the banknote slot 554 are stored in the change machine 55. The banknote outlet 555 is an opening that discharges banknotes, which are the change dispensed from the change machine 55. 【0040】 The first basket rest 70 is a rest on which a shopping basket (not shown) containing the goods that a customer intends to purchase is placed. The first basket rest 70 is equipped with a first weighing unit 71. The first weighing unit 71 weighs the total weight of the shopping basket placed on the first basket rest 70 and the goods contained in the shopping basket. 【0041】 The second basket placement platform 80 is a platform on which a shopping basket (not shown) containing goods that have been removed from a shopping basket placed on the first basket placement platform 70 and whose product code has been read, i.e., registered goods, is placed. The second basket placement platform 80 comprises a second weighing unit 81, a pair of support rods 82, and a temporary placement platform 83. 【0042】 The second weighing unit 81 weighs the total weight of a shopping basket placed on the second basket placement platform 80 and the goods contained in the shopping basket, or the total weight of a shopping bag (not shown) supported by a pair of support rods 82 and the goods contained in the shopping bag. The support rods 82 are rods for hooking and supporting a shopping bag that contains registered goods. The support rods 82 make it easier to put goods into the shopping bag by supporting the shopping bag in an open state. The temporary placement platform 83 is a platform for temporarily placing easily damaged or deformable goods among the registered goods, such as tofu and eggs. The customer can then place the goods placed on the temporary placement platform 83 into the shopping basket or shopping bag at the end. 【0043】 The customer registers the items by holding the items they have taken out of the shopping basket placed on the first basket stand 70 up to the reading window 230. The customer then places the registered items into a shopping basket placed on the second basket stand 80 or into a shopping bag supported by the support rod 82. 【0044】 The first weighing unit 71 measures the weight before and after removing items from a shopping basket placed on the first basket stand 70, allowing the control unit 100 (see Figure 3) to recognize the weight change. The second weighing unit 81 measures the weight before and after placing items in a shopping basket placed on the second basket stand 80 or in a shopping bag supported by a support rod 82, allowing the control unit 100 to recognize the weight change. By determining whether these two weight changes are equal, the control unit 100 can determine whether all the items the customer intends to purchase have been registered. 【0045】 Furthermore, the main body 50 is equipped with a cylindrical pole 57 that extends upward. The upper tip of the pole 57 is provided with a light-emitting part 571 that lights up when calling a store employee (also known as the manager of the POS terminal 10). 【0046】 (POS terminal hardware configuration) Next, the hardware configuration of the POS terminal 10 will be described with reference to Figure 3. Figure 3 is a block diagram showing the hardware configuration of the POS terminal 10. 【0047】 The POS terminal 10 includes a control unit 100, a storage unit 110, a display 51, a touch panel 52, a printer 53, a card reader 54, a change dispenser 55, a first weighing unit 71, a second weighing unit 81, a light-emitting unit 571, an audio output unit 120, a connection interface 121, and a LAN interface 122. These components—the control unit 100, the storage unit 110, the display 51, the touch panel 52, the printer 53, the card reader 54, the change dispenser 55, the first weighing unit 71, the second weighing unit 81, the light-emitting unit 571, the audio output unit 120, the connection interface 121, and the LAN interface 122—are connected to each other via a bus 123 or the like. 【0048】 The control unit 100 consists of a computer equipped with a CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, and RAM (Random Access Memory) 103. The CPU 101, ROM 102, and RAM 103 are connected to each other via a bus 123. 【0049】 The CPU 101 controls the entire POS terminal 10. The ROM 102 stores various programs and data, such as the program used to drive the CPU 101. The RAM 103 is used as the work area for the CPU 101 and loads the various programs and data stored in the ROM 102 and the memory unit 110. The control unit 100 executes various control processes of the POS terminal 10, for example, by having the CPU 101 operate according to the control program 111 stored in the memory unit 110 and loaded into the RAM 103. 【0050】 RAM103 has a product information unit 1031. The product information unit 1031 stores product information read from the product master 112 (described later) based on the product code acquired from the scanner 20. Product registration is performed when product information is stored (registered) in the product information unit 1031. The product information stored in the product information unit 1031 includes the product code, product name, price, etc. The product information unit 1031 stores product information related to one transaction and is cleared when the accounting processing for that transaction is completed. 【0051】 The storage unit 110 is composed of a storage medium such as an HDD (Hard Disk Drive) or flash memory, and retains its contents even when the power is cut off. The storage unit 110 stores the control program 111 and the product master 112. 【0052】 The control program 111 is a program that implements functions such as sending an imaging start signal to the scanner 20 to enable the operation of the scanner 20 when transaction start information declaring the start of a transaction is entered from the touch panel 52, receiving a product code from the scanner 20, performing product registration based on the received product code, sending an imaging stop signal to the scanner 20 to disable the operation of the scanner 20 when registration completion information indicating that product registration for a product related to a transaction has been completed is entered from the touch panel 52, performing accounting processing for the registered product, and performing settings for various operating modes within the product information registration system RS according to the administrator's operation. The control program 111 may be stored in the ROM 102 instead of being stored in the storage unit 110. 【0053】 The product master 112 is a master file that stores product information for the products handled by the store. Since the products handled by the store change daily, the product master 112 is updated as needed by a store server (not shown) connected via the LAN interface 122. Figure 7 shows the data structure of the product master 112. The product master 112 includes product codes, product categories associated with the product codes, product names, and prices. 【0054】 The product code is information that identifies a product. The product classification is information that categorizes products sold in stores. The product name is information that indicates the name of the product. The price is information that indicates the price (unit price) of the product. Note that product master 112 may also include other information associated with the product code. 【0055】 Returning to Figure 3, we will continue the explanation of the hardware configuration of the POS terminal 10. The configuration and functions of the display 51 and touch panel 52 are as described above. 【0056】 The printer 53 is configured, for example, as a thermal printer. The printer 53 prints transaction information on roll-shaped receipt paper and issues it as a receipt from the issuing slot 531. 【0057】 The card reader 54 reads the credit information necessary for payment from the credit card inserted through the card slot 541. The card reader 54 also reads member information that identifies the member from a membership card or point card or other medium inserted through the card slot 541. The card reader 54 may read information magnetically from the card, or it may be an IC card reader that reads information from an IC card with a built-in IC (Integrated Circuit) chip. 【0058】 The change dispenser 55 accepts the banknotes and coins paid by the customer when they pay for the goods in cash, and dispenses change as needed. Banknotes are inserted through the banknote slot 554, and coins are inserted through the coin slot 551. The banknotes of the change are discharged through the banknote discharge slot 555, and the coins of the change are discharged through the coin discharge slot 552. 【0059】 The configuration and functions of the first weighing unit 71, the second weighing unit 81, and the light-emitting unit 571 are as described above. The voice output unit 120 generates voice as needed to notify the customer of information. For example, the voice output unit 120 outputs a notification sound to indicate that product registration is complete. The voice output unit is an example of a notification unit. 【0060】 The connection interface 121 is an interface for communicating with the scanner 20 via LAN or USB. The control unit 100 sends and receives information (data) to and from the scanner 20 via the connection interface 121, via LAN or USB. For example, the control unit 100 receives a product code from the scanner 20 via the connection interface 121, via LAN or USB. 【0061】 The LAN interface 122 is an interface for communicating with the LAN hub LH via the LAN. The control unit 100 sends and receives information (data) to and from the LAN hub LH via the LAN interface 122. For example, the control unit 100 sends and receives information between the server 40 and the product master 112 via the LAN through the LAN hub LH and the wireless router WR. 【0062】 The LAN interface 122 also serves as an interface for communicating with external devices such as a store server (not shown) managed by the store. The control unit 100 sends and receives information to and from external devices via the LAN interface 122. 【0063】 (Scanner hardware configuration) Next, the hardware configuration of the scanner 20 will be described with reference to Figure 4. Figure 4 is a diagram showing the hardware configuration of the scanner 20. 【0064】 Scanner 20 captures an image of the product purchased by the customer and obtains a product image. Next, scanner 20 detects the product barcode contained in the product image, i.e., the barcode attached to the captured product, and decodes the detected product barcode. The decoding result of the product barcode includes the product code held by the product barcode. Scanner 20 also transmits the product image to image recognition device 30 via LAN. 【0065】 The scanner 20 comprises a control unit 200, a storage unit 210, an imaging unit 220, a connection interface 221, and a LAN interface 222. These control unit 200, storage unit 210, imaging unit 220, connection interface 221, and LAN interface 222 are connected to each other via a bus 223 or the like. 【0066】 The control unit 200 consists of a computer equipped with a CPU 201, ROM 202, and RAM 203. The CPU 201, ROM 202, and RAM 203 are connected to each other via a bus 223. 【0067】 The CPU 201 controls the entire scanner 20. The ROM 202 stores various programs and data, such as the program used to drive the CPU 201. The RAM 203 is used as the work area for the CPU 201 and loads the various programs and data stored in the ROM 202 and the storage unit 210. The control unit 200 executes various control processes for the scanner 20, for example, by having the CPU 201 operate according to the control program 211 stored in the storage unit 210 and loaded into the RAM 203. 【0068】 The RAM 203 has a flag unit 2031. The flag unit 2031 stores the upload flag ON "1" in accordance with the upload notification received from the image recognition device 30 when the image recognition device 30 uploads the product image and product code to the server 40. The flag unit 2031 also stores the upload flag OFF "0" in accordance with the upload completion notification received from the image recognition device 30 when the upload of the product image and product code from the image recognition device 30 to the server 40 is completed. 【0069】 The storage unit 210 is composed of a storage medium such as an HDD or flash memory, and retains its contents even when the power is cut off. The storage unit 210 stores the control program 211 and the processing results 212. 【0070】 The control program 211 has the following functions: to start imaging with the imaging unit 220 in response to receiving a transaction start signal from the POS terminal 10; to save the frame image (imaging image) of the product captured by the imaging unit 220 to the RAM 203; to acquire the frame image (product image, which is the imaging image) held by the RAM 203; to detect the product barcode included in the product image; to decode the product barcode; to send the product image to the image recognition device 30 when the upload flag of the flag unit 2031 is OFF "0"; and to decode the product barcode when the upload flag of the flag unit 2031 is OFF "0". This includes a program for implementing functions such as sending the code result to the image recognition device 30 and receiving the image recognition result from the image recognition device 30, merging the decode result and the image recognition result when the upload flag of the flag unit 2031 is OFF "0", sending the merged product code to the POS terminal 10 when the upload flag of the flag unit 2031 is OFF "0", and sending the decoded product code to the POS terminal 10 when the upload flag is ON "1", and stopping imaging by the imaging unit 220 in response to receiving a registration completion signal from the POS terminal 10. The control program 211 may be stored in the ROM 202 instead of being stored in the storage unit 210. 【0071】 The processing result 212 includes the decoding result obtained by decoding the product barcode, the image recognition result obtained by the image recognition device 30, and the merged result obtained by merging the decoding result and the image recognition result. The merged result includes the product barcode included in the product image or the product code of the product shown in the product image. 【0072】 The imaging unit 220 is composed of, for example, a color CCD image sensor or a color CMOS image sensor. The imaging unit 220, in accordance with the control of the control unit 200, captures images of products through the reading window 230 and outputs product images, which are the captured images. For example, the imaging unit 220 captures moving images at a predetermined frame rate (for example, 30fps). The imaging unit 220 sequentially stores the captured frame images in the RAM 203. The frame images (product images) held in the RAM 203 are used to identify the product codes of the products depicted in the frame images. 【0073】 The connection interface 221 is an interface for communicating with the POS terminal 10 via LAN or USB. The control unit 200 sends and receives information (data) to and from the POS terminal 10 via the connection interface 221, either via LAN or USB. 【0074】 The LAN interface 222 is an interface for communicating with the image recognition device 30 via the LAN. The control unit 200 sends and receives information (data) to and from the image recognition device 30 via the LAN interface 222. 【0075】 The control unit 200 detects the product barcode contained in the frame image (product image) held by the RAM 203, decodes the product barcode, and obtains the product code held by the product barcode. Also, if the upload flag of the flag unit 2031 is OFF "0", the control unit 200 transmits the frame image (product image) held by the RAM 203 to the image recognition device 30 via the LAN interface 222 and receives the image recognition result (product code) from the image recognition device 30. Furthermore, the control unit 200 merges the decoding result and the image recognition result to identify the product barcode contained in the product image or the product code of the product shown in the product image, and transmits the identified product code to the POS terminal 10 via the connection interface 221. Also, if the upload flag of the flag unit 2031 is ON "1", the control unit 200 identifies the product code of the decoding result as the product code of the product shown in the product image, and transmits the identified product code to the POS terminal 10 via the connection interface 221. 【0076】 (Image recognition device hardware configuration) Next, the hardware configuration of the image recognition device 30 will be described with reference to Figure 5. Figure 5 is a diagram showing the hardware configuration of the image recognition device 30. 【0077】 The image recognition device 30 receives product images captured by the scanner 20 via LAN when it has not yet uploaded the product images and product codes it has stored to the server 40. The image recognition device 30 starts image recognition upon receiving the images captured by the scanner 20 and stops image recognition when it stops receiving images from the scanner 20. The image recognition device 30 performs image recognition on the product images contained in the received images. That is, the image recognition device 30 obtains the product codes of the products shown in the product images based on the features of the product images. The image recognition device 30 transmits the image recognition results to the scanner 20 via LAN. The image recognition device 30 also transmits (uploads) product images and product codes that it has determined to be used for additional training or state analysis to the server 40 via LAN. Furthermore, the image recognition device 30 receives the updated trained model and matching dictionary from the server 40 via LAN and updates the currently held trained model and matching dictionary. 【0078】 The image recognition device 30 comprises a control unit 300, a storage unit 310, and a LAN interface 321. These control unit 300, storage unit 310, and LAN interface 321 are connected to each other via a bus 322 or the like. 【0079】 The control unit 300 consists of a computer equipped with a CPU 301, ROM 302, and RAM 303. The CPU 301, ROM 302, and RAM 303 are connected to each other via a bus 322. 【0080】 The CPU 301 controls the entire image recognition device 30. The ROM 302 stores various programs and data, such as the program used to drive the CPU 301. The RAM 303 is used as the work area for the CPU 301 and loads the various programs and data stored in the ROM 302 and the storage unit 310. The control unit 300 executes various control processes of the image recognition device 30, for example, by having the CPU 301 operate according to the control program 311 stored in the storage unit 310 and loaded into the RAM 303. 【0081】 The RAM 303 has a product image unit 3031 and a flag unit 3032. The product image unit 3031 stores (saves) the product image, which is the captured image received from the scanner 20, as the target of image recognition. The product image unit 3031 also stores (saves) the product code, which is the decoded result received from the scanner 20 corresponding to the product image. 【0082】 The flag unit 3032 stores the upload flag ON "1" when it uploads product images and product codes that it has determined will be used for additional learning or state analysis from the product images and product codes stored in the product image unit 3031 to the server 40 at a pre-set timing by the image recognition device 30. The flag unit 3032 also stores the upload flag OFF "0" when the upload of product images and product codes from the image recognition device 30 to the server 40 is completed. 【0083】 Product images and product codes stored in the product image section 3031 that were not determined to be used for additional training or state analysis may be deleted. 【0084】 The memory unit 310 is composed of a storage medium such as an HDD or flash memory, and retains its contents even when the power is cut off. The memory unit 310 stores the control program 311, the learned model 312, and the comparison dictionary 313. 【0085】 The control program 311 has the following functions: to set the upload flag ON "1" in the flag unit 3032 at a pre-set timing and send an upload notification to the scanner 20; to set the upload flag OFF "0" in the flag unit 3032 and send an upload completion notification to the scanner 20 when the upload of the captured image and product code to the server 40 is complete; to receive the captured image, which is the product image, from the scanner 20 when the upload flag in the flag unit 3032 is OFF "0"; to perform image recognition on the product image; to determine if the image recognition was successful; and to send the image recognition result to the scanner 20. This includes programs for implementing functions such as transmitting data, receiving the decoded product code from the scanner 20, determining whether to use the product image for additional training or state analysis, storing (saving) the product image and product code determined to be used for additional training or state analysis in the product image unit 3031 and transmitting (uploading) them to the server 40 when the upload flag in the flag unit 3032 is set to ON "1", receiving the updated trained model and updated matching dictionary from the server 40, updating the currently held trained model with the updated trained model, and updating the currently held matching dictionary with the updated matching dictionary. The control program 311 may be stored in the ROM 302 instead of the storage unit 310. 【0086】 The pre-trained model 312 is an image recognition model for performing image recognition on product images. The pre-trained model 312 has been trained using machine learning and can be further trained using machine learning. 【0087】 The matching dictionary 313 is a data table that manages the correspondence between products and the characteristic features of the appearance of those products. Figure 8 shows the data structure of the matching dictionary 313. The matching dictionary 313 includes product codes and the characteristic features associated with the product codes. The matching dictionary 313 may have multiple characteristic features for a single product code. The product codes in the matching dictionary 313 are the same as the product codes in the product master 112 held by the storage unit 110 of the POS terminal 10. 【0088】 As described above, the product code is information that identifies a product. Feature quantities are parameterized representations of the product's appearance, such as its standard shape, surface color, pattern, and texture. The control unit 300 acquires the feature quantities contained in the product image, compares the acquired feature quantities with a matching dictionary, and obtains the product code associated with the acquired feature quantities. In other words, based on the feature quantities acquired from the product image, the control unit 300 obtains the product code of the product shown in the product image from among the products pre-recorded in the matching dictionary 313. 【0089】 Returning to Figure 5, we will continue the explanation of the hardware configuration of the image recognition device 30. 【0090】 The LAN interface 321 is an interface for communicating with the scanner 20 and the LAN hub LH. The control unit 300 sends and receives information (data) with the scanner 20 and the LAN hub LH via the LAN interface 321. 【0091】 For example, the control unit 300 receives a frame image (product image) from the scanner 20 via the LAN interface 321. The control unit 300 also obtains the product code of the product shown in the product image, as described above, and transmits the obtained product code to the scanner 20 via the LAN interface 321. 【0092】 Furthermore, the control unit 300 transmits (uploads) the product images and product codes that it has determined to be stored (saved) in the product image unit 3031 and used for additional learning and state analysis to the server 40 via the LAN interface 321. The control unit 300 also receives the updated trained model 412 (see Figure 6) and the updated matching dictionary 413 (see Figure 6) from the server 40 via the LAN interface 321. The control unit 300 updates the currently held trained model 312 with the updated trained model 412. The control unit 300 also updates the currently held matching dictionary 313 with the updated matching dictionary 413. 【0093】 (Server hardware configuration) Next, the hardware configuration of server 40 will be described with reference to Figure 6. Figure 6 is a diagram showing the hardware configuration of server 40. 【0094】 Server 40 receives and stores product images and product codes from the image recognition device 30. Using the stored product images and product codes, Server 40 performs additional training on the pre-trained model for product image recognition and updates the pre-trained model and the matching dictionary. Server 40 transmits the updated pre-trained model and the updated matching dictionary to the image recognition device 30. Server 40 also uses the stored product images and product codes to analyze the image recognition state (event) at the image recognition device 30, for example, as needed. Server 40 also manages the product master. Server 40 receives accounting processing information from the POS terminal 10 and manages the product master based on the received accounting processing information. Server 40 transmits the product master appropriate for each POS terminal 10 to that POS terminal 10. 【0095】 Server 40 comprises a control unit 400, a storage unit 410, and a communication unit 421. These control unit 400, storage unit 410, and communication unit 421 are connected to each other via a bus 422 or the like. 【0096】 The control unit 400 consists of a computer equipped with a CPU 401, ROM 402, and RAM 403. The CPU 401, ROM 402, and RAM 403 are connected to each other via a bus 422. 【0097】 The CPU 401 controls the entire server 40. The ROM 402 stores various programs and data, such as the program used to drive the CPU 401. The RAM 403 is used as the work area for the CPU 401 and loads the various programs and data stored in the ROM 402 and the storage unit 410. The control unit 400 executes various control processes of the server 40, for example, by having the CPU 401 operate according to the control program 411 stored in the storage unit 410 and loaded into the RAM 403. 【0098】 The storage unit 410 is composed of a storage medium such as an HDD or flash memory, and retains its contents even when the power is cut off. The storage unit 410 stores the control program 411, the learned model 412, the matching dictionary 413, the product master 414, and the product image unit 415. 【0099】 The control program 411 is a program that implements functions such as receiving product images and product codes uploaded from the image recognition device 30, storing the received product images and product codes in the product image unit 415, updating the trained model 412 by further training, updating the matching dictionary 413, sending the updated trained model 412 and the updated matching dictionary 413 to the image recognition device 30, receiving accounting processing information from the POS terminal 10, managing the product master 414, sending the product master 414 to the POS terminal 10, and sending the product images stored in the product image unit 415 to an external device as needed. The control program 411 may be stored in the ROM 402 instead of the storage unit 410. 【0100】 The pre-trained model 412 is a machine learning model trained to perform image recognition on product images. More specifically, the pre-trained model 412 is an image recognition model that obtains the product code of the product shown in the product image by acquiring features contained in the product image and comparing the acquired features with the matching dictionary 413. 【0101】 The matching dictionary 413 is a data table that manages the correspondence between the product code of a product and the visual features of that product, similar to the matching dictionary 313 held by the image recognition device 30. The matching dictionary 413 includes the matching dictionaries 313 held by multiple image recognition devices 30. The server 40 transmits the matching dictionary 313 appropriate for each image recognition device 30 to that device 30. 【0102】 The product master 414, like the product master 112 held by the POS terminal 10, includes a product code, the product category associated with the product code, the product name, and the price. The product master 414 includes the product masters 112 held by multiple POS terminals 10. The server 40 manages the product master 414 based on accounting processing information received from the POS terminals 10. For example, the server 40 updates the product master 414 based on accounting processing information. The server 40 sends the product master 112 appropriate for each POS terminal 10 to that POS terminal 10. 【0103】 The product image unit 415 stores product images and product codes uploaded from the image recognition device 30 for use in additional training and state analysis. 【0104】 The communication unit 421 is an interface for communicating with the wireless router WR. The control unit 400 sends and receives information (data) with the wireless router WR via the communication unit 421. 【0105】 For example, the control unit 400 receives product images and product codes uploaded from the image recognition device 30 via the communication unit 421 and stores them in the product image unit 415. The control unit 400 uses the stored product images and product codes to further train the trained model 412 and updates the trained model 412 and the matching dictionary 413. The control unit 400 transmits the updated trained model and the updated matching dictionary to the image recognition device 30 via the communication unit 421. The control unit 400 transmits the stored product images to external devices as needed. 【0106】 Furthermore, the server 40 receives accounting processing information from the POS terminal 10 via the communication unit 421. Based on the received accounting processing information, the server 40 manages the product master. The server 40 transmits the product master appropriate for each POS terminal 10 to each POS terminal 10 via the communication unit 421. 【0107】 (POS terminal function configuration) Next, the functional configuration of the POS terminal 10 will be described with reference to Figure 9. Figure 9 is a block diagram showing the functional configuration of the control unit 100 of the POS terminal 10. 【0108】 The control unit 100 includes an input means 1001, a registration means 1002, an accounting processing means 1003, and an output means 1004. The control unit 100 functions as the input means 1001, registration means 1002, accounting processing means 1003, and output means 1004 when the CPU 101 operates according to a control program stored in the ROM 102 or the storage unit 110. These functions may also be configured using hardware such as dedicated circuits. 【0109】 Various information is input to the input means 1001 from the scanner 20, touch panel 52, card reader 54, first weighing unit 71, second weighing unit 81, etc. For example, the product code is input to the input means 1001 from the scanner 20. 【0110】 Furthermore, information based on the operation of the touch panel 52 is input to the input means 1001. For example, transaction start information declaring the start of a transaction is input to the input means 1001. Also, registration completion information indicating that the product registration for the goods related to a transaction has been completed is input to the input means 1001. 【0111】 The registration means 1002 performs product registration of the product that the customer intends to purchase based on the customer's operation. In other words, the registration means 1002 registers product information identified by the product identification information entered into the input means 1001. Specifically, the registration means 1002 reads product information from the product master 112 based on the product code entered into the input means 1001. The registration means 1002 then stores the read product information in the product information unit 1031. The product information includes information such as the product code, product name, and price. 【0112】 The accounting processing device 1003 performs accounting processing related to the payment of goods registered by the registration device 1002. Specifically, the accounting processing device 1003 performs processing such as calculating the total amount (transaction amount) of the registered goods, calculating the amount of change, displaying various information, and issuing a receipt. In addition, if the customer wishes to make a cashless payment such as credit card payment or QR code payment, the accounting processing device 1003 can perform the accounting processing necessary for the payment. 【0113】 The output means 1004 outputs various information to the scanner 20, printer 53, change machine 55, light-emitting unit 571, audio output unit 120, etc. For example, when transaction start information is input to the input means 1001, the output means 1004 outputs an imaging start signal to instruct the scanner 20 to start imaging. Also, when registration completion information is input to the input means 1001, the output means 1004 outputs an imaging stop signal to instruct the scanner 20 to stop imaging. 【0114】 The output means 1004 outputs a control signal to the audio output unit 120 to emit a notification sound when the registration means 1002 completes the registration of a product for that product. The output means 1004 functions as a notification means to notify the notification unit (audio output unit 120) that the registration of product information by the registration means 1002 has been completed. It is also possible to provide the audio output unit 120 on the scanner 20. In this case, the audio output unit 120 may emit a notification sound when the scanner 20 identifies the product code. 【0115】 (Scanner Functional Configuration) Next, the functional configuration of the scanner 20 will be described with reference to Figure 10. Figure 10 is a block diagram showing the functional configuration of the control unit 200 of the scanner 20. 【0116】 The control unit 200 includes an acquisition means 2001, a decoding means 2002, a transmitting and receiving means 2003, a merging means 2004, a transmitting means 2005, and a flag setting means 2006. The control unit 200 functions as the acquisition means 2001, the decoding means 2002, the transmitting and receiving means 2003, the merging means 2004, the transmitting means 2005, and the flag setting means 2006 when the CPU 201 operates according to a control program stored in the ROM 202 or the storage unit 210. Note that each of these functions may be configured with hardware such as dedicated circuits. 【0117】 The acquisition means 2001 acquires one frame image (captured image) as a product image from the moving image captured by the imaging unit 220. The acquisition means 2001 stores the acquired product image in the RAM 203. For example, the acquisition means 2001 acquires all or some of the multiple frame images sequentially captured by the imaging unit 220 as candidate product images, stores all or some of the acquired frame images in the RAM 203, and selects a product image from all or some of the stored frame images. 【0118】 Furthermore, the acquisition means 2001 acquires various other information. For example, the acquisition means 2001 acquires an image capture start signal and an image capture stop signal from the POS terminal 10. When the acquisition means 2001 acquires an image capture start signal from the POS terminal 10, the imaging unit 220 starts capturing images, and the acquisition means 2001 acquires the captured image taken by the imaging unit 220. When the acquisition means 2001 acquires an image capture stop signal from the POS terminal 10, the imaging unit 220 stops capturing images, and the acquisition means 2001 stops acquiring the captured image. 【0119】 The decoding means 2002 detects the product barcode contained in the product image, which is the captured image acquired by the acquisition means 2001, and extracts the product barcode from the product image. The decoding means 2002 decodes the extracted product barcode. As a decoding result of decoding the product barcode, the decoding means 2002 obtains the product code held by the product barcode. 【0120】 The transmitting / receiving means 2003 receives an upload notification from the image recognition device 30 notifying it of the upload of product images stored (memorized) by the image recognition device 30 to the server 40, and a completion notification notifying it of the completion of the upload. In response to the upload notification from the image recognition device 30, the transmitting / receiving means 2003 transmits the product images acquired by the acquisition means 2001 to the image recognition device 30 when the upload flag stored (set) in the flag section 2031 of the RAM 203 is ON "1". The image recognition device 30 performs image recognition on the received product images and transmits the image recognition result (product code of the product shown in the product image) to the scanner 20. The transmitting / receiving means 2003 receives the image recognition result transmitted by the image recognition device 30. Furthermore, the transmitting / receiving means 2003 transmits the decoding result (product code held by the product barcode) from the decoding means 2002 to the image recognition device 30 when the upload flag stored (set) in the flag section 2031 of the RAM 203 is ON "1" in response to the upload notification from the image recognition device 30. 【0121】 The merging means 2004 merges the decoding result (the product code held by the product barcode) and the recognition result (the product code of the product shown in the product image). That is, the merging means 2004 includes an identification means for identifying and obtaining a single product code from the decoding result and the image recognition result. The merged result includes the product code held by the product barcode included in the product image or the product code of the product shown in the product image. 【0122】 The merging means 2004 uses the product code from the image recognition result as the merged result if a decoding result cannot be obtained. Situations in which a decoding result cannot be obtained include when the consumer does not correctly hold the product barcode over the imaging unit 220 of the scanner 20, or when the product barcode is bent or folded in an unnatural way. 【0123】 If both the decoded result and the image recognition result are obtained and they match, the merging means 2004 will naturally use the matching product code as the merged result. If both the decoded result and the image recognition result are obtained but they do not match, the product code from the more reliable decoded result will be used as the merged result. 【0124】 In response to the upload completion notification from the image recognition device 30, the transmission means 2005 transmits the product code resulting from the merge by the merge means 2004 to the POS terminal 10 via the connection interface 221 when the upload flag stored (set) in the flag unit 2031 of the RAM 203 is OFF "0". Also, in response to the upload notification from the image recognition device 30, the transmission means 2005 transmits the product code resulting from the decoding by the decoding means 2002 to the POS terminal 10 via the connection interface 221 when the upload flag stored (set) in the flag unit 2031 of the RAM 203 is ON "1". 【0125】 The flag setting means 2006 stores (sets) the upload flag ON "1" in the flag section 2031 of RAM 203 when an upload notification is received indicating that the image recognition device 30 is sending (uploading) a product image to the server 40, and stores (sets) the upload flag OFF "0" in the flag section 2031 of RAM 203 when an upload completion notification is received. 【0126】 In other words, when the scanner 20 is uploading product images that the image recognition device 30 has determined to use for additional training or state analysis to the server 40, the scanner 20 does not send the captured product image to the image recognition device 30, and the image recognition device 30 does not acquire the product code by image recognition of the product image. In this case, the scanner 20 sends the product code, which is the result of decoding the product barcode, to the POS terminal 10. When the scanner 20 has not uploaded product images that the image recognition device 30 has determined to use for additional training or state analysis to the server 40, the scanner 20 sends the captured product image to the image recognition device 30, and sends the product code obtained by merging the decoding result of the product barcode and the image recognition result of the product image to the POS terminal 10. 【0127】 (Functional configuration of the image recognition device) Next, the functional configuration of the image recognition device 30 will be described with reference to Figure 11. Figure 11 is a block diagram showing the functional configuration of the control unit 300 of the image recognition device 30. 【0128】 The control unit 300 includes a receiving means 3001, an image recognition means 3002, a determination means 3003, an update means 3004, a transmission means 3005, and an image upload means 3006. The control unit 300 functions as the receiving means 3001, image recognition means 3002, determination means 3003, update means 3004, transmission means 3005, and image upload means 3006 when the CPU 301 operates according to a control program stored in the ROM 302 or the storage unit 310. Note that each of these functions may be configured with hardware such as dedicated circuits. 【0129】 The receiving means 3001 receives the product image, which is an image captured from the scanner 20, via the LAN interface 321 when the upload flag stored (set) in the flag section 3032 of the RAM 303 is OFF "0". The receiving means 3001 saves the received product image in the product image section 3031 of the RAM 303. 【0130】 The image recognition means 3002 performs image recognition on the product images stored in the product image unit 3031 using an image recognition function based on the trained model 312. Specifically, the image recognition means 3002 acquires feature quantities contained in the product image, compares the acquired feature quantities with the matching dictionary 313, and obtains a product code associated with the feature quantity closest to the acquired feature quantity. The image recognition means 3002 stores the acquired product code in the RAM 303. 【0131】 The transmission means 3005 transmits the product code obtained from the image recognition result by the image recognition means 3002 to the transmission / reception means 2003 of the scanner 20 via the LAN interface 321. 【0132】 The determination means 3003 determines whether the image recognition by the image recognition means 3002 was successful. For example, if the difference between the acquired feature and the feature closest to the acquired feature is less than a predetermined amount, the determination means 3003 determines that the image recognition was successful. Conversely, if the difference is greater than or equal to the predetermined amount, the determination means 3003 determines that the image recognition was unsuccessful. Furthermore, if the determination means 3003 determines that the image recognition was unsuccessful, it determines that the product image on which the image recognition was performed is a product image to be used for additional training or state analysis. 【0133】 Furthermore, the receiving means 3001 receives the decoded product code from the scanner 20 via the LAN interface 321 when the upload flag stored in the flag section 3032 of the RAM 303 is OFF "0". The receiving means 3001 stores (saves) the received product code in association with the product image that underwent image recognition in the product image section 3031 of the RAM 303. 【0134】 If the determination means 3003 determines that a product image that has undergone image recognition is a product image to be used for additional learning or state analysis, the determination means 3003 stores the product image and product code determined to be used for additional learning or state analysis in the product image section 3031 of RAM 303. Product images and product codes that were not determined to be used for additional learning or state analysis are deleted from the product image section 3031. The transmission means 3005 transmits (uploads) the product image and product code that have been determined to be used for additional learning or state analysis and are stored in the product image section 3031 to the server 40 via the LAN interface 321 at a predetermined timing. The predetermined timing includes a timing predetermined on the image recognition device 30 side or on the server 40 side, or a timing arbitrarily set by the user. In the case of the image recognition device 30 of this embodiment, the predetermined timing is, for example, a predetermined time interval or a timing when the free capacity of the product image section 3031 that stores the product image and product code falls below a predetermined level. 【0135】 Server 40 uses the received product image and product code to further train the pre-trained model 412 for product image recognition and updates the pre-trained model 412 and the matching dictionary 413. Server 40 transmits the updated pre-trained model 412 and the updated matching dictionary 413 to the receiving means 3001 of the image recognition device 30 via the LAN interface 321. Server 40 may use the received product image and product code for various state analyses (state analysis). 【0136】 The receiving means 3001 receives the updated trained model 412 and the updated matching dictionary 413 from the server 40 via the LAN interface 321. The receiving means 3001 stores the received updated trained model 412 and the updated matching dictionary 413 in the RAM 303. 【0137】 The update means 3004 updates the learned model 312 currently held by the storage unit 310 with the received updated learned model 412. The image recognition device 30 also updates the matching dictionary 313 currently held by the storage unit 310 with the received updated matching dictionary 413. 【0138】 The image upload means 3006 sends an inquiry signal to the server 40 via the transmission means 3005 at a predetermined timing (for example, every predetermined time or when the free space in the product image unit 3031 falls below a predetermined level) to ask for permission to upload product images. When the image upload means 3006 receives an permission signal from the server 40 via the receiving means 3001, it sets the upload flag in the flag unit 3032 to ON "1" and sends an upload notification to the scanner 20 via the transmission means 3005. The image upload means 3006 sends (uploads) the product images and product codes stored in the product image unit 3031 that have been determined to be used for additional learning or state analysis to the server 40 via the transmission means 3005. 【0139】 Furthermore, once the upload of the product image and product code from the product image unit 3031 to the server 40 is complete, the image upload means 3006 deletes the uploaded (sent) product image and product code. The image upload means 3006 then sets the upload flag in the flag unit 3032 to OFF "0" and sends an upload completion notification to the scanner 20 via the transmission means 3005. 【0140】 (Server Functional Configuration) Next, the functional configuration of the server 40 will be described with reference to Figure 12. Figure 12 is a block diagram showing the functional configuration of the control unit 400 of the server 40. 【0141】 The control unit 400 includes a receiving means 4001, an additional learning means 4002, a master management means 4003, a transmitting means 4004, and an image storage means 4005. The control unit 400 functions as the receiving means 4001, the additional learning means 4002, the master management means 4003, the transmitting means 4004, and the image storage means 4005 when the CPU 401 operates according to a control program stored in the ROM 402 or the storage unit 410. Note that each of these functions may be configured with hardware such as dedicated circuits. 【0142】 The receiving means 4001 receives product images and their product codes uploaded from the image recognition device 30 for use in additional learning (for state analysis) and state analysis, via the communication unit 421. The receiving means 4001 stores the received product images and product codes in the product image unit 415 of the storage unit 410 using the image storage means 4005. 【0143】 The additional learning means 4002 performs additional learning on the trained model 412 held by the memory unit 410 at an appropriate time, for example, when a certain amount of product images and product codes for additional learning have been accumulated in the product image unit 415, thereby updating the trained model 412. In addition, the additional learning means 4002 updates the matching dictionary 413 held by the memory unit 410 in conjunction with the additional learning of the trained model 412. 【0144】 The transmission means 4004 transmits the updated trained model 412, updated by the additional learning means 4002, and the matching dictionary 413 to the receiving means 3001 of the image recognition device 30 via the communication unit 421, for example, as an image file or a compressed file. 【0145】 Furthermore, the receiving means 4001 receives accounting processing information from the POS terminal 10 via the communication unit 421. The receiving means 4001 stores the received accounting processing information in the RAM 403. 【0146】 The master management means 4003 manages the product master 414 held by the storage unit 410 based on the received accounting processing information. For example, the product master 414 includes a store code that identifies a store, a product master 112 for each store code, and information such as whether or not the product for each product code is handled and the remaining quantity. Based on the received accounting processing information, the master management means 4003 updates the product master 414, for example, the information such as the remaining quantity of the product for each product code. 【0147】 The transmission means 4004 transmits a product master 112 suitable for each store to the POS terminal 10 of the store via the communication unit 421, based on the product master 414 updated by the master management means 4003. 【0148】 The image storage means 4005 stores (stores) the additional learning (state analysis) product images and product codes uploaded from the image recognition device 30 and received by the receiving means 4001 in the product image section 415 of the storage unit 410. When the image storage means 4005 receives an inquiry signal from the image recognition device 30 to inquire about permission to upload via the receiving means 4001, it determines whether the free space in the storage unit 410 is sufficient to store the additional learning (state analysis) product images and product codes. If the image storage means 4005 determines that the free space in the storage unit 410 is not sufficient, it recovers the free space by, for example, deleting old additional learning (state analysis) product images and product codes that have been created for a predetermined period of time (timestamp). If the image storage means 4005 determines that the free space in the storage unit 410 is sufficient, it transmits an permission signal to the image recognition device 30 via the transmitting means 4004 to allow the upload. 【0149】 (Operation of scanner, image recognition device, and server) Next, referring to Figure 13, the operation of the scanner 20, image recognition device 30, and server 40 for uploading additional training (state analysis) product images and product codes from the image recognition device 30 to the server 40 will be described. Figure 13 is a flowchart showing the operation flow of the scanner 20, image recognition device 30, and server 40 in this embodiment. In Figure 13, the operation of the scanner 20 is shown on the left, the operation of the image recognition device 30 is shown in the center, and the operation of the server 40 is shown on the right. The operation of the scanner 20 is performed by each part of the scanner 20 under the control of the control unit 200 which executes the control program 211. The operation of the image recognition device 30 is performed by each part of the image recognition device 30 under the control of the control unit 300 which executes the control program 311. The operation of the server 40 is performed by each part of the server 40 under the control of the control unit 400 which executes the control program 411. 【0150】 In ACT41, the image recognition device 30 determines whether a predetermined time has elapsed. Each time the image recognition device 30 determines that the predetermined time has elapsed (if the answer is Yes in ACT41), in ACT43, it sends an inquiry signal to the server 40 to ask for permission to upload. 【0151】 In ACT42, the image recognition device 30 checks whether the free space in the product image section 3031 of RAM 303 has fallen below a predetermined level. If the free space in the product image section 3031 has fallen below a predetermined level (i.e., the answer is Yes in ACT42), the image recognition device 30 sends an inquiry signal to the server 40 in ACT43 to ask for permission to upload. 【0152】 Furthermore, the upload permission inquiry in ACT43 described above is made to the server 40 at a predetermined timing (either at predetermined intervals or when the free space of the product image section 3031 falls below a predetermined level) by the image recognition device 30. However, it is not limited to this, and the server 40 may also make an upload inquiry to the image recognition device 30 at a predetermined timing on the server 40 side. 【0153】 In ACT61, the server 40 checks whether it has received a query signal from the image recognition device 30. If the server 40 has received a query signal from the image recognition device 30 (in the case of Yes in ACT61), in ACT62 it determines whether the free capacity of the storage unit 410 is greater than or equal to a predetermined amount. 【0154】 In ACT62, if the server 40 determines that the free space of the storage unit 410 is less than a predetermined amount (in the case of No in ACT62), in ACT63, the server 40 recovers the free space by performing a process such as deleting old data in the storage unit 410 (a data cleanup process). 【0155】 In ACT62, if the server 40 determines that there is a predetermined amount of free space in the storage unit 410 (if the answer is Yes in ACT62), in ACT64, the server 40 sends a permission signal to the image recognition device 30 to allow uploading. 【0156】 In ACT44, the image recognition device 30 checks whether it has received a permission signal from the server 40. If the image recognition device 30 receives a permission signal from the server 40 (if the answer is Yes in ACT44), in ACT45, it sets (stores) the upload flag ON "1" in the flag section 3032 of the RAM 303. 【0157】 In ACT46, the image recognition device 30 sends an upload notification to the scanner 20 to inform it that the upload has started. 【0158】 In ACT71, the scanner 20 checks whether it has received an upload notification from the image recognition device 30. If the scanner 20 receives an upload notification from the image recognition device 30 (if the answer is Yes in ACT71), in ACT72, it sets (stores) the upload flag ON "1" in the flag section 2031 of the RAM 203. 【0159】 In ACT47, the image recognition device 30 transmits (uploads) the product images and product codes stored in the product image section 3031 of the RAM 303 for additional training (state analysis) to the server 40. The image recognition device 30 then deletes the product images and product codes from the product image section 3031 that were uploaded to the server 40. 【0160】 In ACT65, the server 40 receives additional training (state analysis) product images and product codes uploaded from the image recognition device 30, and in ACT66, the uploaded additional training (state analysis) product images and product codes are stored in the product image section 415 of the storage unit 410. 【0161】 In ACT48, the image recognition device 30 checks whether the upload of product images and product codes for additional training (state analysis) to the server 40 is complete. If the upload is complete (if the answer is Yes in ACT48), in ACT49, the image recognition device 30 sets the upload flag OFF "0" in the flag section 3032 of RAM 303. 【0162】 In ACT50, the image recognition device 30 sends a completion notification to the scanner 20 to inform it that the upload has finished. 【0163】 In ACT73, the scanner 20 checks whether it has received an upload completion notification from the image recognition device 30. If the scanner 20 receives an upload completion notification from the image recognition device 30 (if the answer is Yes in ACT73), in ACT74, it sets (stores) the upload flag OFF "0" in the flag section 2031 of RAM 203. 【0164】 In this manner, the image recognition device 30 uploads additional training (state analysis) product images and product codes stored in the product image section 3031 of the RAM 303 to the server 40 at a predetermined timing (in this case, at predetermined intervals or when the free capacity of the product image section 3031 falls below a predetermined level). 【0165】 During the upload process by the image recognition device 30, the upload flag in the flag unit 3032 of the image recognition device 30 is set to ON "1", and the upload flag in the flag unit 2031 of the scanner 20 is also set to ON "1". 【0166】 In ACT44, if the image recognition device 30 does not receive a permission signal from the server 40, for example, within a certain period of time (in the case of No in ACT44), in ACT51, the image recognition device 30 sends an error notification to the scanner 20 indicating that the upload is not possible. 【0167】 In ACT75, if the scanner 20 receives an error notification from the image recognition device 30 (if the answer is Yes in ACT75), in ACT76, the scanner 20 sends a notification signal to the POS terminal 10 to notify it of an error indicating that the image recognition device 30 could not upload the data. When the POS terminal 10 receives the notification signal from the scanner 20, it lights up its light-emitting unit 571 to notify the administrator that the image recognition device 30 is unable to upload the data to the server 40. In this case, for example, the store administrator can see from the light-emitting unit 571 of the POS terminal 10 that the image recognition device 30 is unable to upload the data to the server 40 and can quickly begin recovery work. 【0168】 (Operation of scanner and image recognition device) Next, referring to Figures 14 and 15, the operation of the scanner 20 and the image recognition device 30 for identifying the product code of a product from the product image captured by the scanner 20 for each product between the reception of an imaging start signal upon the start of a transaction and an imaging stop signal upon completion of registration from the POS terminal 10. Figure 14 is a flowchart showing the operation flow of the scanner 20 and the image recognition device 30 in this embodiment. In Figure 14, the operation of the scanner 20 is shown on the left, and the operation of the image recognition device 30 is shown on the right. Figure 15 is a flowchart showing the operation flow of the scanner 20 in this embodiment. The operation of the scanner 20 is performed by each part of the scanner 20 under the control of the control unit 200 which executes the control program 211. The operation of the image recognition device 30 is performed by each part of the image recognition device 30 under the control of the control unit 300 which executes the control program 311. 【0169】 In ACT10, the scanner 20 checks whether the upload flag set in the flag section 2031 of RAM 203 is ON "1" or OFF "0", that is, whether the image recognition device 30 is in the process of uploading additional product images for training (state analysis) to the server 40. 【0170】 If the scanner 20 confirms that the upload flag set in the flag unit 2031 is OFF "0", meaning that the image recognition device 30 is not currently performing the process of uploading to the server 40 (in the case of No in ACT10), then in ACT11, the scanner 20 obtains a single captured image, which is a product image, from the moving image captured by the imaging unit 220. For example, first, the scanner 20 saves all or some of the multiple frame images sequentially captured by the imaging unit 220 to the RAM 203 as candidate product images. Next, the scanner 20 selects one frame image from the multiple frame images held in the RAM 203 and uses the selected frame image as the product image. The scanner 20 also assigns an identification code to the product image to identify it. For convenience, in the following, the product image will be assumed to include the identification code. 【0171】 In ACT12, the scanner 20 transmits the product image to the image recognition device 30 via LAN, for example, using TCP communication. 【0172】 In ACT20, the image recognition device 30 checks whether the upload flag set in the flag section 3032 of RAM 303 is ON "1" or OFF "0", that is, whether or not it is currently performing the process of uploading additional product images for training (state analysis) to the server 40. 【0173】 If the image recognition device 30 confirms that the upload flag set in the flag unit 3032 is OFF "0", meaning that it is not currently performing the process of uploading to the server 40 (in the case of No in ACT20), it executes the image recognition process from ACT21 onwards. If the image recognition device 30 confirms that the upload flag set in the flag unit 3032 is ON "1", meaning that it is currently performing the process of uploading to the server 40 (in the case of Yes in ACT20), it stops and does not execute the image recognition process from ACT21 onwards (stopping means). 【0174】 In ACT20, if the image recognition device 30 confirms that the upload flag is OFF "0" (in the case of No in ACT20), then in ACT21, the image recognition device 30 receives the product image and identification code from the scanner 20 via LAN. The image recognition device 30 saves the received product image to the product image section 3031 of the RAM 303. 【0175】 In ACT22, the image recognition device 30 performs image recognition on the product image stored in the product image unit 3031. For example, the image recognition device 30 performs image recognition based on features such as the outline and color of the product shown in the product image. In this case, first, the image recognition device 30 acquires the features contained in the product image. Next, the image recognition device 30 compares the acquired features with the matching dictionary 313 and searches for the feature that is closest to the acquired features. Subsequently, the image recognition device 30 acquires the product code associated with the search result (the feature that is closest to the acquired features). 【0176】 In ACT23, the image recognition device 30 determines whether image recognition was successful. For example, first, the image recognition device 30 calculates the difference between the acquired feature and the feature that is closest to the acquired feature. Next, the image recognition device 30 compares the calculated difference with a predetermined amount. 【0177】 If the difference in the comparison is less than a predetermined amount, the image recognition device 30 determines that the image recognition was successful. In this case, the image recognition device 30 stores the product code acquired in ACT22 as the image recognition result in RAM303. After that, it proceeds to the operation of ACT24. 【0178】 Conversely, if the difference in the comparison is greater than a predetermined amount, the image recognition device 30 determines that the image recognition has failed. In this case, the image recognition device 30 requests the scanner 20 to acquire and transmit another product image and repeats the operations of ACT21 to ACT23. The image recognition device 30 also determines that the product image that underwent image recognition is a product image to be used for additional training and state analysis. 【0179】 In ACT24, the image recognition device 30 transmits the image recognition results stored in the RAM 303 to the scanner 20 via the LAN. The image recognition device 30 also transmits an identification code to the scanner 20. 【0180】 In ACT13, the scanner 20 detects the product barcode in the product image. In other words, the scanner 20 determines whether or not a product barcode is captured in the product image. 【0181】 If a product barcode is detected in ACT13 (Yes in ACT13), then in ACT14, the scanner 20 extracts and decodes the detected product barcode, and obtains the product code held by the product barcode as a result of the decoding. The scanner 20 stores the obtained product code in RAM 203. 【0182】 Next, in ACT15, the scanner 20 transmits the decoded product code (the product code held by the product barcode) to the image recognition device 30. Since the operations of ACT14 and ACT15 are performed when the product barcode is detected in ACT13, the scanner 20 may not transmit the decoded product code in ACT15. 【0183】 In ACT16, the scanner 20 checks whether it has received the image recognition result (product code of the product shown in the product image) from the image recognition device 30. If it has received the image recognition result (Yes in ACT16), the scanner 20 stores the received image recognition result in RAM 203. The scanner 20 may also identify the product image corresponding to the image recognition result based on the identification code received along with the image recognition result. After that, the process moves to the merging operation in ACT17. 【0184】 If the product barcode cannot be detected in ACT13 (in the case of No in ACT13), the actions in ACT14 and ACT15 are skipped, and the process moves on to the action of confirming receipt of the image recognition result in ACT16. 【0185】 In ACT16, if no image recognition result has been received (in the case of No in ACT16), the scanner 20 repeats the operations of ACT11, ACT13 to ACT15. At this time, the image recognition device 30 does not need a new product image, so the product image transmission in ACT12 is omitted. In other words, while the image recognition device 30 is not performing the process of uploading to the server 40, the scanner 20 continues a series of routine operations, such as acquiring the product image in ACT11, detecting the product barcode in ACT13, decoding in ACT14, and transmitting the product code of the decoding result in ACT15, until it receives an image recognition result from the image recognition device 30. 【0186】 In ACT17, the scanner 20 merges the decoded result (the product code held by the product barcode) and the image recognition result (the product code of the product shown in the product image). In other words, the scanner 20 obtains the single product code that it deems to be the most correct from the decoded result and the image recognition result. 【0187】 If a decoding result cannot be obtained, the product code from the image recognition result will be used as the merged result. Situations in which a decoding result cannot be obtained include when the consumer does not correctly hold the product barcode over the imaging unit 220 of the scanner 20, or when the product barcode is bent or folded in an unnatural way. 【0188】 If both the decoded result and the image recognition result are obtained, the scanner 20 compares the decoded result and the image recognition result. If the decoded result and the image recognition result match, the scanner 20 merges the product codes of the matching decoded result and the image recognition result. If the decoded result and the image recognition result do not match, the scanner 20 merges the product code of the more reliable decoded result. 【0189】 In ACT18, the scanner 20 transmits the merged product code (the single product code considered to be the most correct) to the POS terminal 10. 【0190】 In ACTs 16 to 18 of this embodiment, the scanner 20, after receiving the image recognition result from the image recognition device 30 (in the case of Yes in ACT 16), transmits (uploads) to the host device (in this case, the POS terminal 10) a product code obtained by merging the product code obtained by decoding the scanned product barcode and the product code obtained by image recognition. However, the scanner 20 may first transmit the product code obtained by decoding the scanned product barcode to the host device before receiving the image recognition result from the image recognition device 30, and then, after receiving the image recognition result from the image recognition device 30, transmit to the host device a product code obtained by merging the product code obtained by decoding the scanned product barcode and the product code obtained by image recognition. 【0191】 In ACT15, when the scanner 20 transmits the decoded product code (the product code held by the product barcode), in ACT25, the image recognition device 30 receives the decoded product code. The image recognition device 30 stores the received decoded product code in association with the product image that was image-recognized in this instance (in ACT22) in the product image section 3031 of the RAM 303. 【0192】 In ACT26, the image recognition device 30 determines whether there are product images to be used for additional training or state analysis. For example, if there are product images that failed to be recognized in ACT23, and the image recognition device 30 has received a product code from the scanner 20 as a decoding result in ACT25, the image recognition device 30 determines that there are product images to be used for additional training or state analysis. 【0193】 In the judgment of ACT26, if it is determined that there are product images to be used for additional learning or state analysis, in ACT27, the image recognition device 30 retains (saves) the product images that failed to be recognized and the product codes of the decoded results received from the scanner 20, which are stored in the product image section 3031 of the RAM 303. 【0194】 If ACT26 determines that there are no product images to use for additional training or state analysis, the process will skip ACT27 and terminate. 【0195】 In other words, if the image recognition device 30 is not currently performing the process of uploading to the server 40, the scanner 20 merges the product code decoded from the product barcode detected by the scanner 20 and the product code acquired by the image recognition device 30 based on the product image captured by the scanner 20. The scanner 20 then sends the resulting merged product code to the POS terminal 10, and the POS terminal 10 registers the product. 【0196】 For the customer, the operator of the product information registration system RS will experience improved usability when registering products, such as increased flexibility in the orientation of the products held up to the scanner 20. 【0197】 In ACT10, when the scanner 20 confirms that the upload flag set in the flag unit 2031 of RAM 203 is ON "1", that is, that the image recognition device 30 is in the process of uploading to the server 40 (if Yes in ACT10), in ACT31 of Figure 15, the scanner 20 acquires a single captured image, which is a product image, from the moving image captured by the imaging unit 220. 【0198】 In ACT32, the scanner 20 detects the product barcode on the product image. 【0199】 If a product barcode is detected in ACT32 (Yes in ACT32), in ACT33, the scanner 20 extracts and decodes the detected product barcode, and obtains the product code held by the product barcode as a result of the decoding. The scanner 20 stores the obtained product code in RAM 203. 【0200】 In ACT34, the scanner 20 transmits the product code stored in RAM 203 as the result of decoding the product barcode to the POS terminal 10. 【0201】 In other words, if the image recognition device 30 is in the process of uploading to the server 40, the image recognition device 30 does not perform image recognition processing. Instead, it decodes the product barcode detected by the scanner 20 and sends the resulting product code to the POS terminal 10, where the POS terminal 10 registers the product. 【0202】 The product information registration system RS identifies products by detecting the product barcode with the scanner 20 and obtaining the product code, without being affected by the reduction in processing speed or recognition accuracy that can occur when simultaneously performing the process of image recognition and product code acquisition using the image recognition device 30 and the process of uploading the product image and product code to the server 40. 【0203】 In the image recognition device 30, the increased load on each process due to simultaneously performing the process of recognizing product images and the process of uploading product images to the server 40 becomes significant as the available capacity of the memory used for each process, i.e., the available capacity of RAM 303 in this embodiment, becomes strained, resulting in effects such as a decrease in processing speed and a decrease in recognition accuracy. 【0204】 The customer, the operator of the product information registration system RS, can continue product registration regardless of whether the process of uploading additional training (state analysis) product images to the server 40 by the image recognition device 30 is in progress. 【0205】 (Summary of the embodiments) According to the product information management system MS of this embodiment, when the image recognition device 30 is not uploading (transmitting) the product image it has recognized to the server 40 (external storage device), the scanner 20 merges the product code decoded from the product barcode it detected from the product image with the product code acquired by the image recognition device 30, and sends the product code identified as a result of the merge to the POS terminal 10 to register the product. 【0206】 When uploading the product image recognized by the image recognition device 30 to the server 40, the process of recognizing the product image is stopped (stopping means), and the product code, decoded from the product barcode detected by the scanner 20 from the product image, is sent to the POS terminal 10 to register the product. 【0207】 As a result, the operator of the customer product information registration system RS can continue product registration without being affected by a decrease in processing speed or recognition accuracy, even when the image recognition device 30 is uploading product images to the server 40. 【0208】 Therefore, it becomes possible to appropriately control the image recognition process and the process of uploading the images used for image recognition to the server. 【0209】 (others) In the above embodiment, the control programs executed by the POS terminal 10, scanner 20, image recognition device 30, and server 40 may be provided by recording them on a computer-readable recording medium such as a CD-ROM. Alternatively, the control programs executed by the POS terminal 10, scanner 20, image recognition device 30, and server 40 in the above embodiment may be stored on a computer connected to a network such as the Internet and provided by allowing downloads via the network, or even provided via a network such as the Internet. 【0210】 Although embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. The invention described in the original claims of this application is listed below. [1] An information processing device having a communication function with an external storage device, comprising: an image recognition means for image recognition of an image captured by an imaging unit; a transmission means for transmitting the image recognized by the image recognition means to the external storage device; and a stopping means for stopping the image recognition performed by the image recognition means when the transmission means transmits the image captured to the external storage device. [2] The information processing apparatus according to Appendix [1], wherein the transmitting means includes means for transmitting an inquiry signal to the external storage device to request permission to upload the captured image to the external storage device when transmitting the captured image to the external storage device, and the transmitting means transmits the captured image to the external storage device when the receiving means receives the permission signal. [3] An information processing apparatus according to Appendix [1] or Appendix [2], comprising a code acquisition means for acquiring a product code of a product based on code information attached to the product included in the captured image, wherein the image recognition means acquires a product code of a product based on the external appearance characteristics of the product included in the captured image. [4] When the transmission means has not transmitted the captured image to the external storage device, the information processing apparatus according to Appendix [3] further comprises a means for identifying the product code obtained by the code acquisition means or the product code obtained by the image recognition means as the product code of the product. [5] The information processing apparatus according to Appendix [1] or Appendix [2], wherein the transmission means transmits the captured image stored in the image storage unit to the external storage device at predetermined intervals or when the free capacity of the image storage unit that stores the captured image that the image recognition means is to recognize falls below a predetermined level. [6] A program for causing the computer of an information processing device having a communication function with an external storage device to function as an image recognition means for image recognition of an image captured by an imaging unit, a transmission means for transmitting the image recognized by the image recognition means to the external storage device, and a stop means for stopping the image recognition performed by the image recognition means when the transmission means transmits the image captured to the external storage device. [Explanation of symbols] 【0211】 MS…Product Information Management System, RS…Product Information Registration System, 1…Self-POS System, 10…POS Terminal, 100…Control Unit, 1001…Input Means, 1002…Registration Means, 1003…Accounting Processing Means, 1004…Output Means, 101…CPU, 102…ROM, 103…RAM, 1031…Product Information Unit, 110…Storage Unit, 111…Control Program, 112…Product Master, 120…Audio Output Unit, 121…Connection Interface, 122…LAN Interface, 123…Bus, 50…Main Unit, 51…Display, 52…Touch Panel, 53…Printer, 531...Issuing slot, 54...Card reader, 541...Card insertion slot, 55...Change dispenser, 551...Coin slot, 552...Coin outlet, 553...Coin tray, 554...Banknote slot, 555...Banknote outlet, 57...Pole, 571...Light-emitting unit, 70...First basket stand, 71...First weighing unit, 80...Second basket stand, 81...Second weighing unit, 82...Support rod, 83...Temporary stand, 20...Scanner, 200...Control unit, 2001...Acquisition means, 2002...Decoding means, 2003...Transmission / reception means, 2004...Merge means, 2005...Transmission means, 2006...Flag setting means, 201...CPU, 202...ROM, 203...RAM, 2031...Flag section, 210...Storage section, 211...Control program, 212...Processing result, 220...Imaging section, 221...Connection interface, 222...LAN interface, 223...Bus, 230...Reading window, 30...Image recognition device, 300...Control unit, 3001...Receiving means, 3002...Image recognition means, 3003...Determination means, 3004...Update means, 3005...Transmission means, 3006...Image upload means, 301...CPU, 302...ROM, 303...RAM, 3031...Product image section, 3032...Flag section, 310...Storage section 311...Control program, 312...Trained model, 313...Verification dictionary, 321...LAN interface, 322...Bus, 40...Server, 400...Control unit, 4001...Receiving means, 4002...Additional learning means, 4003...Master management means, 4004...Transmission means, 4005...Image storage means, 401...CPU, 402...ROM, 403...RAM, 410...Storage unit, 411...Control program, 412...Trained model, 413...Verification dictionary, 414...Product master, 415...Product image unit, 421...Communication unit, 422...Bus, LH...LAN hub, NW...Network,WR... Wireless router.

Claims

[Claim 1] An information processing device having a communication function with an external storage device, Image recognition means for performing image recognition on the captured image captured by the imaging unit, When the image recognition means transmits the captured image that it has recognized to the external storage device, it transmits an inquiry signal to the external storage device to request permission to upload, and when it receives a permission signal transmitted from the external storage device in response to the transmission of the inquiry signal, if there is a predetermined or greater amount of free space in the storage unit of the external storage device, it transmits the captured image to the external storage device. When the transmission means transmits the captured image to the external storage device, the transmission means includes a stopping means for stopping the image recognition performed by the image recognition means, An information processing device equipped with the following features. [Claim 2] The system includes a receiving means for receiving a permission signal transmitted from the external storage device when there is a predetermined or greater amount of free space in the storage unit of the external storage device in response to the transmission of the inquiry signal. The transmitting means transmits the captured image to the external storage device when the receiving means receives the permission signal. The information processing apparatus according to claim 1. [Claim 3] The system includes a code acquisition means for acquiring the product code of a product based on the code information attached to the product included in the captured image, The image recognition means obtains the product code of the product based on the external appearance features of the product included in the captured image. The information processing apparatus according to claim 1 or claim 2. [Claim 4] When the transmission means has not transmitted the captured image to the external storage device, the system includes a means for identifying the product code obtained by the code acquisition means or the product code obtained by the image recognition means as the product code of the product. The information processing apparatus according to claim 3. [Claim 5] The transmission means transmits the inquiry signal to the external storage device at predetermined intervals or when the free capacity of the image capture unit that stores the captured image targeted for image recognition by the image recognition means falls below a predetermined level. The information processing apparatus according to claim 1. [Claim 6] A computer in an information processing device that has a communication function with an external storage device, Image recognition means for performing image recognition on the captured image taken by the imaging unit. When the image recognition means transmits the captured image that it has recognized to the external storage device, it transmits an inquiry signal to the external storage device to request permission to upload, and when it receives a permission signal transmitted from the external storage device in response to the transmission of the inquiry signal, if there is a predetermined or greater amount of free space in the storage unit of the external storage device, it transmits the captured image to the external storage device, and When the transmission means transmits the captured image to the external storage device, a stopping means is provided to stop the image recognition performed by the image recognition means. A program designed to function as such.

Images