Information processing device and information processing system

Abstract

To provide an information processing apparatus and a server apparatus that can easily use a device without directly connecting a mobile terminal and the device.SOLUTION: An information processing apparatus connected via a network to one or more scanner apparatuses that capture an image of a product and obtain image data of the product includes: receiving means for receiving the image data transmitted from the scanner apparatuses; recognition means for executing recognition processing for recognizing information related to the product from the image data; and transmitting means for transmitting a processing result of the recognition processing to the scanner apparatuses.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] Embodiments of the present invention relate to an information processing apparatus and an information processing system.

Background Art

[0002] Conventionally, in stores such as supermarkets, in order for customers to register the products they purchase, a scanner device is used to recognize a code symbol such as a barcode from an image of the product and read a product code for identifying the product from the code symbol. Also, by using a scanner device, information related to products other than code symbols is also recognized from the image.

[0003] For example, products targeted for discounts or promotions (hereinafter collectively referred to as "discounts") may be attached with a sticker indicating that they are subject to discounts (hereinafter also referred to as a "discount sticker"). In this case, a service is also provided in which a discount sticker is recognized from an image of the product using a scanner device and the amount corresponding to the discount sticker is discounted. In recent years, by using technologies such as general object recognition and deep learning, the variety of products is also recognized from an image of the product.

[0004] By the way, the processing related to the recognition of the above-described discount stickers and the like tends to have a higher load compared to the processing for recognizing code symbols. Therefore, in a scanner device that mainly performs the recognition of code symbols, performing other recognition processes such as discount stickers may increase the load, which may interfere with the original processing such as causing a delay in response.

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the present invention is to provide an information processing apparatus and an information processing system capable of assisting recognition processing using a scanner device.

Means for Solving the Problems

[0006] The information processing device of this embodiment comprises one or more scanner devices that image products and acquire image data of the products, and an information processing device connected via a network, comprising a receiving means, a recognition means, and a transmitting means. The receiving means is The image data, including a predetermined trigger image relating to the aforementioned product, is obtained from the scanner device. The recognition means receives the image data and recognizes information related to the product other than the trigger image. Recognition processing The transmission means performs the above Recognition processing The processing result is transmitted to the scanner device. Recognition processing teeth, Trigger image recognition process that recognizes the trigger image from the image data. It is characterized by a higher load compared to [another method]. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 shows an example of the configuration of a checkout system according to an embodiment. [Figure 2] Figure 2 shows an example of the hardware configuration of a scanner device according to this embodiment. [Figure 3] Figure 3 shows an example of the hardware configuration of the image processing device according to the embodiment. [Figure 4] Figure 4 shows an example of the functional configuration of a scanner device according to this embodiment. [Figure 5] Figure 5 shows an example of the functional configuration of an image processing apparatus according to the embodiment. [Figure 6] Figure 6 is a sequence diagram showing an example of the processing performed by the scanner device and image processing device of the embodiment. [Figure 7] Figure 7 is a flowchart showing an example of the processing performed by the load adjustment unit in Modification Example 2. [Modes for carrying out the invention]

[0008] The embodiments of the information processing device and information processing system will be described in detail below with reference to the drawings. Note that the embodiments described below are just one example of the information processing device and information processing system, and do not limit their configuration or specifications. This embodiment is an example of application to a checkout system installed in a retail store such as a supermarket.

[0009] Figure 1 shows an example of the configuration of the checkout system 1 according to this embodiment. The checkout system 1 includes a scanner device 10 and an image processing device 20.

[0010] The scanner device 10 and the image processing device 20 are connected to a network N by wire or wireless connection. Here, network N is, for example, a LAN (Local Area Network) installed in a store.

[0011] In Figure 1, three scanner devices 10, scanner device 101, scanner device 102, and scanner device 103, are shown, but the number of scanner devices 10 is not limited to these. Also, in Figure 1, two image processing devices 20, image processing devices 201 and image processing devices 202, are shown, but the number of image processing devices 20 is not limited to these. However, it is preferable to have multiple scanner devices 10 and multiple image processing devices 20.

[0012] Scanner device 10 is an example of a scanner device. Scanner device 10 acquires image data of products by capturing images of products purchased by customers. Scanner device 10 also reads information about the products from the image data. For example, scanner device 10 recognizes code symbols such as barcodes attached to products from the image data and reads product codes such as JAN (Japanese Article Number) codes held in those code symbols. Hereinafter, the recognition process performed by scanner device 10 will also be referred to as the first recognition process.

[0013] The scanner device 10 outputs the scanned product code to a product sales data processing device (not shown), such as a POS (Point of Sale) terminal. The product sales data processing device performs data processing related to product sales by registering the product corresponding to the product identifier and performing accounting processing based on the product identifier input from the scanner device 10.

[0014] The scanner device 10 may be installed integrally with the product sales data processing device, or it may be connected to the product sales data processing device by wire or wireless connection. In the latter case, the product sales data processing device may be configured to be connected to a network N. Furthermore, the scanner device 10 may be installed in a production area within the store, or it may be attached to a mobile device such as a shopping cart.

[0015] The image processing device 20 is an example of an information processing device. The image processing device 20 receives image data transmitted from the scanner device 10 and performs processing to recognize information related to the product from the image data. Specifically, the image processing device 20 recognizes a discount sticker attached to the product from the image data and transmits the information corresponding to the recognized discount sticker (e.g., 50 yen discount) to the scanner device 10. Hereinafter, the recognition processing performed by the image processing device 20 will also be referred to as the second recognition processing.

[0016] In this embodiment, of the two image processing devices 20, image processing device 201 and image processing device 202, image processing device 201 is set as the primary system and image processing device 202 is set as the secondary system. Furthermore, each of the scanner devices 10 stores the address of at least the primary image processing device 201 of the two image processing devices 201 and 202 as the destination for transmitting image data.

[0017] In the checkout system 1 described above, an operator who operates the scanner device 10 causes the scanner device 10 to capture an image by aiming a code symbol or the like attached to a product at the imaging unit 16. When the scanner device 10 captures an image of a product, it outputs information such as a product code read from the image data and a discount amount obtained by transmitting the image data to the image processing device 20 to the product sales data processing device.

[0018] In the product sales data processing device, when a product code is input, it identifies the product name and price of the product corresponding to the product code and executes a registration process for registering it as a purchase target. Also, when discount information is input together with the product code, it registers the amount obtained by subtracting the discount amount corresponding to the discount information from the product name and price of the corresponding product. Note that the product sales data processing device identifies the product corresponding to the input product code based on a product master in which the product codes of each product sold in the store are associated with product information such as the product name and price of the product.

[0019] Then, in the product sales data processing device, in response to an operation or the like instructing the end of registration, accounting processing for one transaction of the products registered up to that point is performed. That is, in the checkout system 1, information related to product registration or accounting is input using the scanner device 10 and the image processing device 20.

[0020] Next, the configurations of the scanner device 10 and the image processing device 20 described above will be explained.

[0021] FIG. 2 is a diagram showing an example of the hardware configuration of the scanner device 10. As shown in FIG. 2, the scanner device 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, and a RAM (Random Access Memory) 13.

[0022] The CPU 11 is an example of a processor and comprehensively controls the operation of the scanner device 10. The ROM 12 stores various programs. The RAM 13 is a workspace for deploying programs and various data. The CPU 11, ROM 12, and RAM 13 are connected via a bus or the like and constitute the control unit 14 of the computer configuration. In the control unit 14, the CPU 11 executes various processes by operating according to the control program 151 stored in the ROM 12 and memory unit 15 and deployed in the RAM 13.

[0023] Furthermore, the CPU 11 is connected to the storage unit 15, the imaging unit 16, and the communication unit 17 via a bus or the like.

[0024] The memory unit 15 is a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or flash memory, and retains its contents even when the power is cut off. The memory unit 15 stores the control program 151 and various setting information.

[0025] The imaging unit 16 is an example of an imaging means. The imaging unit 16 is an electronic camera having an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary MOS). Under the control of the CPU 11, the imaging unit 16 generates image data by imaging a subject such as a product, and outputs the generated image data to the CPU 11.

[0026] The communication unit 17 is a communication interface that can be connected to the network N. The communication unit 17 communicates with the image processing device 20 via the network N.

[0027] Figure 3 shows an example of the hardware configuration of the image processing device 20. As shown in Figure 3, the image processing device 20 includes a CPU 21, a ROM 22, and a RAM 23.

[0028] The CPU 21 is an example of a processor and comprehensively controls the operation of the image processing device 20. The ROM 22 stores various programs. The RAM 23 is a workspace for programs and various data. The CPU 21, ROM 22, and RAM 23 are connected via a bus or the like and constitute the control unit 24 of the computer configuration. In the control unit 24, the CPU 21 executes various processes by operating according to the control program 251 stored in the ROM 22 and memory unit 25 and loaded into the RAM 23.

[0029] Furthermore, the CPU 21 is connected to the storage unit 25, the image processing unit 26, and the communication unit 27 via a bus or the like.

[0030] The memory unit 25 is a storage device such as an HDD, SSD, or flash memory, and retains its contents even when the power is cut off. The memory unit 25 stores the control program 251 and various setting information.

[0031] The image processing unit 26 is an arithmetic circuit specialized for image processing and is implemented by, for example, a GPU (Graphics Processing Unit). Under the control of the CPU 21, the image processing unit 26 analyzes the image data and extracts information such as discount stickers and feature quantities. The image processing unit 26 may also be implemented by the CPU 21.

[0032] The communication unit 27 is a communication interface that can be connected to the network N. The communication unit 27 communicates with the scanner device 10 and other image processing devices 20 via the network N.

[0033] Next, the functional configuration of the scanner device 10 will be described with reference to Figure 4. Figure 4 is a diagram showing an example of the functional configuration of the scanner device 10. As shown in Figure 4, the scanner device 10 is equipped with an imaging control unit 111, a first recognition processing unit 112, and a communication control unit 113 as functional units.

[0034] Some or all of the functional components of the scanner device 10 may be implemented as software through the cooperation of the scanner device 10's processor (e.g., CPU 11) and a control program 151 stored in its memory (e.g., storage unit 15). Alternatively, some or all of the functional components of the scanner device 10 may be implemented as hardware through dedicated circuits or the like mounted on the scanner device 10.

[0035] The image capture control unit 111 is an example of an imaging means. The image capture control unit 111 controls the operation of the imaging unit 16 related to imaging. Specifically, the image capture control unit 111 operates the imaging unit 16 under predetermined imaging conditions and acquires image data generated by imaging from the imaging unit 16. For example, the image capture control unit 111 operates the imaging unit 16 at a frame rate such as 30fps and acquires the moving image generated by imaging as image data.

[0036] The first recognition processing unit 112 performs a first recognition process on the image data captured by the imaging unit 16. Specifically, the first recognition processing unit 112 recognizes the code symbol attached to the product from the image data acquired by the imaging control unit 111. The first recognition processing unit 112 also decodes the recognized code symbol to obtain the product code held in the code symbol and outputs the acquired product code to a product sales data processing device or the like.

[0037] It should be noted that the objects recognized by the first recognition processing unit 112 are not limited to code symbols. For example, products with discount stickers may have a flag sticker attached to indicate that a discount sticker has been attached. Flag stickers are typically composed of simple shapes such as double circles and are usually placed near the code symbol. Such flag stickers are used to prevent customers from forgetting to read the discount sticker by recognizing them at the same time as the code symbol.

[0038] The first recognition processing unit 112 may, for example, recognize the flag sticker as described above. Specifically, when the first recognition processing unit 112 recognizes a code symbol, it recognizes a figure corresponding to a flag sticker from the vicinity of the code symbol. When the first recognition processing unit 112 recognizes a flag sticker, it waits until the recognition result of the discount sticker is transmitted from the image processing device 20, and outputs the transmitted recognition result along with the product code to the product sales data processing device, etc. Hereinafter, the images of code symbols, flag stickers, etc. recognized by the first recognition processing unit 112 in the first recognition process will be collectively referred to as "trigger images".

[0039] The communication control unit 113 is an example of a first transmitting means and a first receiving means. The communication control unit 113 transmits image data captured by the imaging unit 16 to the image processing device 20. The communication control unit 113 also receives the recognition results of the image data processed by the image processing device 20 from the image processing device 20.

[0040] Specifically, when the imaging control unit 111 acquires image data, the communication control unit 113 sends a request to the main image processing device 201 for the transmission of the image data.

[0041] When the communication control unit 113 receives an acknowledgment of a request from the image processing device 201, it transmits the image data to the image processing device 201. The communication control unit 113 then receives the recognition result of the image data from the image processing device 201.

[0042] Here, it is preferable for the communication control unit 113 to limit the timing of starting the transmission of image data and the duration of continuing the transmission of image data in order to reduce the load on the image processing device 20. For example, when the image processing device 20 recognizes a discount sticker, the communication control unit 113 starts transmitting image data when the trigger image is recognized by the first recognition processing unit 112 and continues transmitting the image data for a predetermined time (for example, a few seconds or until the recognition process is completed). This reduces the time that the resources of the image processing device 20 are used, thereby reducing the load on the image processing device 20.

[0043] On the other hand, if the image processing device 201 sends a negative response to the request, the communication control unit 113 does not send image data to the image processing device 201, but instead sends image data to the sub-system image processing device 202.

[0044] If the image processing device 20 to which the image data is to be sent is instructed by a negative response, the communication control unit 113 may send the image data to the instructed image processing device 20.

[0045] Next, with reference to Figure 5, the functional configuration of the image processing device 20 will be described. Figure 5 is a diagram showing an example of the functional configuration of the image processing device 20. As shown in Figure 5, the image processing device 20 includes a communication control unit 211, a load adjustment unit 212, and a second recognition processing unit 213 as functional units.

[0046] Some or all of the functional components of the image processing device 20 may be implemented as software through the cooperation of the processor (e.g., CPU 21, image processing unit 26) of the image processing device 20 and a control program 251 stored in memory (e.g., storage unit 25). Alternatively, some or all of the functional components of the image processing device 20 may be implemented as hardware through dedicated circuits or the like mounted on the image processing device 20.

[0047] The communication control unit 211 is an example of a receiving means (second receiving means) and a transmitting means (second transmitting means). The communication control unit 211 receives image data transmitted from the scanner device 10. The communication control unit 211 also works in cooperation with the load adjustment unit 212 and the second recognition processing unit 213 to transmit the recognition results of the image data transmitted from the scanner device 10 to the scanner device 10.

[0048] The load adjustment unit 212 is an example of an acquisition means and a control means. The load adjustment unit 212 acquires the load of the image processing device 20 related to the execution of the second recognition process, and adjusts the number of processes of the second recognition process to be executed by the device based on the acquired load value. Here, the load can be any indicator that quantitatively represents the load state of the image processing device 20, such as CPU usage rate, number of threads, number of processes of the second recognition process, or number of data points of image data that are the target of the second recognition process.

[0049] Specifically, when the load on the image processing device 20 is below a threshold, the load adjustment unit 212 controls the communication control unit 211 and returns an acknowledgment to the request sent from the scanner device 10, thereby causing the scanner device 10 to send image data.

[0050] On the other hand, if the load on the image processing device 20 exceeds a threshold, the load adjustment unit 212 controls the communication control unit 211 and returns a negative response to the request sent from the scanner device 10, thereby suppressing the transmission of new image data from the scanner device 10 and causing the image data to be sent to another image processing device 20.

[0051] The load adjustment unit 212 may be configured to be included in a representative image processing device 20, such as the main image processing device 201. Alternatively, the load adjustment unit 212 may indicate a secondary image processing device 202 to which the image data will be transmitted via a negative response. In this case, the load adjustment unit 212 may include the address of the destination image processing device 202 in the negative response, or it may include information that can identify the destination image processing device 202 in the negative response.

[0052] The second recognition processing unit 213 is an example of a recognition means. The second recognition processing unit 213 works in cooperation with the image processing unit 26, etc., to perform a second recognition process that recognizes information related to products other than the trigger image from the image data captured by the imaging unit 16. The second recognition processing unit 213 also transmits the processing result of the second recognition process as a recognition result to the transmitting scanner device 10.

[0053] Specifically, the second recognition processing unit 213 performs a process to recognize discount stickers from image data transmitted from the scanner device 10. When the second recognition processing unit 213 recognizes a discount sticker from the image data, it transmits information such as the discount amount corresponding to the discount sticker to the scanner device 10 as a recognition result.

[0054] Furthermore, the second recognition process performed by the second recognition processing unit 213 is assumed to have a higher processing load compared to the first recognition process performed by the first recognition processing unit 112 of the scanner device 10. For example, discount stickers generally use more complex shapes than code symbols or flag stickers, which tends to increase the processing load. Also, while code symbols are generally easily recognized because they are imaged towards the imaging unit 16 so that the entire code symbol is included, discount stickers may be imaged while searching for the sticker, and may unintentionally appear in the image data. Therefore, in the case of discount stickers, the entire series of image data must be processed, and the processing load for recognition increases while the image data is being input.

[0055] Thus, in this embodiment, the relatively low-load first recognition process is performed by the scanner device 10, and the second recognition process, which is more load-intensive than the first recognition process, is performed by the image processing device 20. This allows the image processing device 20 to support the recognition process using the scanner device 10.

[0056] The following describes an example of the operation of the scanner device 10 and image processing device 20 of this embodiment. Figure 6 is a sequence diagram showing an example of the processing performed by the scanner device 10 and image processing device 20 of this embodiment. In Figure 6, only scanner device 101 is shown as the scanner device 10, but the other scanner devices 10 (102, 103) will perform the same operation.

[0057] First, in the scanner device 10, the imaging unit 16 starts imaging under the control of the imaging control unit 111 (step S11). The first recognition processing unit 112 performs a first recognition process to recognize a trigger image from the image data captured by the imaging unit 16 (step S12). When the first recognition processing unit 112 recognizes the trigger image, the communication control unit 113 sends a request to the main image processing device 20(201) (step S13).

[0058] When the image processing device 201 receives a request from the scanner device 10, the load adjustment unit 212 acquires the load status of its own device (step S14) and determines whether the load is below a threshold.

[0059] Here, if the load is below the threshold, the load adjustment unit 212 controls the communication control unit 211 to cause the scanner device 101 to send an acknowledgment (step S21). When the communication control unit 113 of the scanner device 10 receives an acknowledgment from the image processing device 201, it transmits the image data to the image processing device 201 (step S22). The second recognition processing unit 213 of the image processing device 201 performs a second recognition process to recognize the discount sticker on the image data transmitted from the scanner device 10 (step S23). Then, the second recognition processing unit 213 transmits the processing result of the second recognition process to the scanner device 10 as a recognition result (step S24).

[0060] On the other hand, if the load on the image processing device 201 exceeds a threshold due to reasons such as processing image data transmitted from scanner devices 102 and 103, the load adjustment unit 212 controls the communication control unit 211 to cause scanner device 101 to send a negative response (step S31). The load adjustment unit 212 may also use the negative response to notify scanner device 101 of the destination image processing device 202.

[0061] When the communication control unit 113 of the scanner device 10 receives a negative response from the image processing device 201, it suppresses the transmission of image data to the image processing device 201 and transmits the image data to the secondary image processing device 202 (step S32). If the negative response specifies a destination image processing device 20 (image processing device 202), the communication control unit 113 may transmit the image data to the specified image processing device 202.

[0062] When image data is transmitted from the scanner device 10, the second recognition processing unit 213 of the image processing device 202 performs a second recognition process on the image data (step S33). Then, the second recognition processing unit 213 transmits the recognition result of the second recognition process to the scanner device 10 (step S34).

[0063] In Figure 6, the request transmission is omitted when sending image data from the scanner device 10 to the secondary image processing device 202. However, similar to the primary system, the request may be sent first, and then the image data may be transmitted after waiting for an acknowledgment.

[0064] As described above, in the checkout system 1 of this embodiment, the image data captured by the scanner device 10 that recognizes the trigger image is transmitted to the image processing device 20, and the recognition result of the discount sticker recognized by the image processing device 20 is returned to the scanner device 10. In this way, the image processing device 20 of this embodiment can share the recognition processing related to the product with the scanner device 10, and can support the recognition processing using the scanner device 10. Furthermore, since the image processing device 20 performs the second recognition processing, which is more computationally intensive than the first recognition processing performed by the scanner device 10, it is possible to prevent the scanner device 10 from falling into a high-load state. As a result, the image processing device 20 can ensure stable operation of the scanner device 10, thereby facilitating the smooth execution of tasks such as product registration.

[0065] Furthermore, if the load on its own device exceeds a threshold, the image processing device 20 will send image data to another image processing device 20, thereby causing that other image processing device 20 to perform the second recognition process. This prevents the image processing device 20 from falling into a high-load state, thus ensuring stable operation of its own device.

[0066] The embodiments described above can also be modified and implemented as appropriate by changing some of the configurations or functions of each of the devices described above. Therefore, several modifications of the embodiments described above will be described below as other embodiments. In the following, the differences from the embodiments described above will be mainly described. Specifically, the same reference numerals will be used for parts that are common to the content already described, and detailed explanations will be omitted. Furthermore, the modifications described below may be implemented individually or in combination as appropriate.

[0067] (Variation 1) In the above-described embodiment, the image processing device 20 was divided into a main system and a sub-system, but the configuration is not limited to this, and for example, multiple image processing devices 20 may all be used as the main system. In this case, the scanner device 10 may be configured to randomly send requests to any one of the multiple image processing devices 20.

[0068] (Modification 2) In the above embodiment, the load adjustment unit 212 is configured to monitor the load status of its own device, but it is not limited to this and may also monitor the load status of other image processing devices 20. Specifically, the load adjustment unit 212 provided in each image processing device 20 monitors the load status of its own device and other image processing devices 20 by lending the network N to send and receive the load status of each other's devices.

[0069] When this modified configuration is adopted, for example, the load adjustment unit 212 selects one image processing device 20 from among the other image processing devices 20 whose load is below the threshold when the load of its own device is above the threshold. The image processing device 20 then instructs the scanner device 10 of the address of the selected image processing device 20 via a negative response. The method of selecting the image processing device 20 is not particularly limited and may be random or round-robin. Alternatively, the image processing device 20 with the lowest load may be selected.

[0070] Figure 7 is a flowchart showing an example of the process performed by the load adjustment unit 212 of this modified example. This process can be performed, for example, instead of the process in step S14 described in Figure 6.

[0071] First, the load adjustment unit 212 acquires the load status of its own device (step S41) and determines whether the load is below a threshold (step S42). If the load of its own device is below the threshold (step S42; Yes), the load adjustment unit 212 proceeds to step S21 in Figure 6 described above.

[0072] On the other hand, if the load of the device itself is above a threshold (step S42; No), the load adjustment unit 212 acquires the load status of the other image processing devices 20 (step S43). Then, the load adjustment unit 212 selects one of the other image processing devices 20 whose load is below the threshold and has the lowest load (step S44).

[0073] Then, the load adjustment unit 212 proceeds to step S31 in Figure 6 described above, and transmits the address of the image processing device 20 selected in step S44 to the scanner device 10 via a negative response.

[0074] As described above, the image processing device 20 according to this modified example selects an image processing device 20 to which the image data will be sent based on the load status of other image processing devices 20 when the load of the device itself exceeds a threshold. As a result, the image processing device 20 according to this embodiment can perform the second recognition process considering the load of not only the device itself but also the entire set of image processing devices 20, thereby ensuring stable operation of the entire set of image processing devices 20.

[0075] In this configuration, the load adjustment unit 212 selects one image processing device 20 from among the other image processing devices 20 when the load of its own device exceeds a threshold. However, it may also be configured to select one image processing device 20 from all image processing devices 20, including its own device, that has a load below the threshold and the lowest load.

[0076] (Variation 3) In the embodiment described above, the image processing device 20 is configured to recognize a discount sticker attached to a product, but the objects recognized by the image processing device 20 are not limited to this. For example, the second recognition processing unit 213 of the image processing device 20 may extract feature quantities representing the external characteristics of the product from the image data and perform a second recognition process to recognize the product that has been photographed based on these feature quantities. In this case, the second recognition process can use known techniques related to object recognition using general object recognition or deep learning. Furthermore, when a product is recognized in the second recognition process, the scanner device 10 may be configured not to perform the first recognition process.

[0077] The programs executed in each of the above-described embodiments are provided pre-installed in ROM, storage units, etc. Alternatively, the programs executed in each of the above-described embodiments may be provided as installable or executable files recorded on a computer-readable recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD (Digital Versatile Disk).

[0078] Furthermore, the programs executed by each of the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Alternatively, the programs executed by each of the above-described embodiments may be provided or distributed via a network such as the Internet.

[0079] Although embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments and their variations can be implemented in a variety of other forms, and various omissions, substitutions, changes, and combinations can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0080] 1. Checkout System 10, 101, 102, 103 Scanner devices 111 Imaging control unit 112 First Recognition Processing Unit 113 Communication Control Unit 20, 201, 202 Image processing device 211 Communication Control Unit 212 Load adjustment section 213 Second Recognition Processing Unit N Network [Prior art documents] [Patent Documents]

[0081] [Patent Document 1] Japanese Patent Publication No. 2019-215892

Claims

1. An information processing device connected via a network to one or more scanner devices that image products and acquire image data of said products, Receiving means for receiving image data including a predetermined trigger image relating to the said product from the scanner device, Recognition means that performs a recognition process to recognize information related to the product other than the trigger image from the image data, A transmission means for transmitting the processing result of the recognition process to the scanner device, Equipped with, The information processing apparatus is characterized in that the recognition process is more computationally intensive than a trigger image recognition process that recognizes a trigger image from the image data.

2. An acquisition means for acquiring the load of the device itself related to the execution of the aforementioned recognition process, Control means for controlling the scanner device to transmit the image data transmitted from the scanner device to another information processing device connected to the network when the load exceeds a threshold, The information processing apparatus according to claim 1, further comprising the following:

3. Prior to receiving the image data, the receiving means receives a request from the scanner device for the transmission of the image data. The control means causes the scanner device to send an affirmative response via the transmission means to permit the transmission of the image data when the load of the device is below a threshold, and causes the scanner device to send a negative response via the transmission means to refuse the transmission of the image data when the load of the device is above a threshold. The information processing apparatus according to claim 2.

4. The control means uses the negative response to notify the scanner device of the other information processing device to which the image data will be transmitted. The information processing apparatus according to claim 3.

5. The acquisition means acquires the load of the other information processing device related to the execution of the recognition process, The control means, when the load of its own device is above a threshold, selects a destination for the image data from among the other information processing devices whose load is below the threshold, and notifies the scanner device of the selected destination. The information processing apparatus according to claim 4.

6. The receiving means receives the image data including the trigger image indicating that a discount sticker indicating that the product is subject to a discount is attached to the product. The recognition means performs the recognition process to recognize the discount sticker from the image data. The information processing apparatus according to any one of claims 1 to 5.

7. An information processing system comprising one or more scanner devices and one or more information processing devices connected to the scanner devices via a network, The scanner device is Imaging means, A first recognition means that performs a first recognition process to recognize a predetermined trigger image relating to the product from the image data of the product captured by the imaging means, When the trigger image is recognized in the first recognition process, a first transmission means transmits the image data to one of the information processing devices, A first receiving means for receiving information transmitted from the aforementioned information processing device, Equipped with, The aforementioned information processing device is A second receiving means for receiving the image data transmitted from the scanner device, A second recognition means that performs a second recognition process to recognize information related to the product other than the trigger image from the image data, A second transmission means for transmitting the processing result of the second recognition process to the scanner device, Equipped with, An information processing system characterized in that the second recognition process has a higher load compared to the first recognition process.

Images